Data Engineer designing and maintaining data pipelines at Agile Defense. Focused on integrating technologies for vital national security and civilian missions.
About the role
- Senior Data Engineer at Shopmonkey building and maintaining data infrastructure. Driving strategic decisions for tools and processes while ensuring data quality across platforms.
Responsibilities
- Continuous Enhancement: Build, maintain and elevate Shopmonkey's data infrastructure, ensuring peak performance and dependability.
- Strategic Leadership: Drive the decision-making process for the selection and implementation of data tools and technologies.
- Streamlining: Design and refine data pipelines to ensure smooth and efficient data flow.
- Troubleshooting: Manage the daily operations of the Shopmonkey platform, swiftly identifying and resolving data-related challenges.
- Cross-Functional Synergy: Partner with cross-functional teams to develop new data requirements and refine existing processes.
- Guidance: Provide mentorship to junior engineers, supporting their growth and assisting with complex projects.
- Collaborative Innovation: Contribute to ongoing platform improvements, ensuring a culture of continuous innovation.
- Knowledge Expansion: Stay informed on industry trends and best practices in data infrastructure and cloud technologies.
- Dependability: Guarantee consistent data delivery to customers and stakeholders, adhering to or surpassing service level.
- Oversight: Monitor and sustain the data infrastructure, covering areas like recalls, message delivery, and reporting functions.
Requirements
- 5+ years of data engineering experience and Bachelor's Degree in STEM preferred *additional experience is also accepted in lieu of a degree*
- Proven experience with Kubernetes and Cloud infrastructure (GCP preferred)
- Strong proficiency in Python and SQL for data processing and automation.
- Expertise in orchestration tools such as Airflow, Docker, etc..
- Understanding of performance optimization and cost-effectiveness in data warehouses like Snowflake, ClickHouse, etc.
- Ability to work effectively in a collaborative, cross-functional environment.
- Strong problem-solving skills with a proactive and solution-oriented mindset.
- Experience with additional orchestration tools like Dogster or Meltano.
- Knowledge of DBT, particularly in setting up new projects.
- Demonstrated ability to build and maintain complex data pipelines and data flows.
Benefits
- Medical, dental, vision, and life insurance benefits available the 1st of the month following hire date
- Short term and long term disability
- Employee assistance program
- Reimbursement for a personal health and wellness membership
- Generous parental leave
- 401(k) available upon hire
- 11 paid holidays
- Flexible time off - take the time off you need!
- Matching donations for approved charitable organizations
- Group volunteer efforts
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Engineer responsible for Cloud Data Lake design and development in financial services. Collaborate with management and technical teams to execute technology product roadmap.
Senior Data Architect for the Chief Data Office at State Street driving Global Data Architecture and Management. Collaborating with stakeholders to streamline data processes and enhance data quality.
Senior Data Engineer responsible for reliable data integration and transformation at Evertec. Collaborating with stakeholders and engineering teams using SQL and cloud platforms.
Data Engineer needed to build and maintain cloud data pipelines for a digital transformation consultancy. Collaborate on analytics initiatives and ensure data quality in São Paulo.
Senior Data Engineer at Verity designing and evolving data architectures. Building scalable pipelines and implementing data engineering best practices in cloud environments.
Data Engineer responsible for building and maintaining data solutions on AWS and GCP. Focus on Lakehouse architecture to support analytics, reporting, and AI/ML use cases.
Data Engineer for Verity, a digital transformation consultancy, designing data architectures and building scalable pipelines. Collaborates on data quality and analytical dataset structuring.
Data Engineer Pleno at Verity focusing on building data pipelines and analytics frameworks. Engage with teams to ensure data quality and enhance cloud - based solutions.
Data Engineer at GFT managing data systems and workflows, focusing on data engineering and data science collaboration. Leveraging technologies like Python, Airflow, and AWS.