Develop and maintain Snowflake data warehouse and data marts
Design, construct, and maintain robust, scalable ETL/ELT pipelines using dbt and Airflow to integrate new data sources and manage changes to SQL jobs
Troubleshoot issues with existing SQL/ETL processes and data loads
Design and build extensible data models and integration solutions using Snowflake, Airflow, Soda, DBT, AWS s3
Implement and enforce best practices for data quality, testing, and documentation
Continuously optimize Snowflake data warehouse for query performance, scalability, and cost-efficiency
Work closely with Data Engineering and wider P&T teams to build secure, high-performing data solutions
Requirements
3+ years of experience in a Data Engineering or similar role
Hands-on experience with building data pipelines, data models and implementing data quality
Experience accessing and manipulating structured and semi-structured data(JSON) in various cloud data environments (Snowflake, Redshift, Hadoop, Spark, Cloud Storage, AWS, consuming data from APIs)
Expert proficiency in Python(or scala) for data manipulation and scripting
Advanced SQL and database stored procedures for complex querying and data modelling
Experience with orchestration and monitoring tools such as Airflow
Solid understanding of ETL/ELT design patterns, data modelling principles and database architecture
Experience of full stack development, implementing continuous integration and automated tests e.g. GitHub, Jenkins
Proven ability to work creatively and analytically in a fast-paced, problem-solving environment
Excellent communication (verbal and written) and interpersonal skills
Proven ability to communicate complex analysis in a clear, precise, and actionable manner
Benefits
hybrid working policy with two mandatory days a week in our Dublin office
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.
Data Engineer focusing on development and optimization of data pipelines in an insurance context. Ensuring data integrity and supporting data - driven decision - making processes.
Full Stack Data Engineer on a Central Engineering Portfolio Team in Chennai delivering curated data products and collaborating with data engineers and product owners.
Data Engineer designing and implementing data pipelines and services for Ford Pro analytics. Working with diverse teams and technologies to drive data - driven solutions.
Data Engineer developing best - in - class data platforms for ClearBank with a focus on data insights and automation. Collaborating closely with stakeholders and supporting data science initiatives.
Data Engineer operating cloud - based data platform for Business Intelligence and Data Science. Collaborating on data architectures and ETL processes for Sparkassen - Finanzgruppe.