Data Engineer focusing on SQL database management and Azure Data Factory pipelines for a consulting firm in Spain. Collaborating on data integration and ensuring data accuracy in cloud environments.
Responsibilities
SQL Database Management: Design, implement, and maintain SQL databases to ensure efficient data storage and retrieval.
Optimize and tune SQL queries for maximum performance.
Elasticsearch Integration: Work with Elasticsearch to index, search, and analyze large volumes of data efficiently.
Collaborate with cross-functional teams to integrate Elasticsearch into our data ecosystem.
Azure Data Factory Pipelines: Develop and manage data pipelines using Azure Data Factory.
ETL Development and Maintenance: Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into our data warehouse.
Implement data quality checks and ensure the integrity of data throughout the ETL process.
Ensure the reliability, scalability, and efficiency of data movement within the Azure cloud environment.
Work in migrating our data sources into Snowflake.
Proactive Problem Solving: Proactively identify and address data-related issues, ensuring data accuracy and consistency.
Collaborate with other teams to understand their data requirements and provide effective solutions.
Clearly communicate complex technical concepts to non-technical stakeholders.
Collaborate with data scientists, analysts, and other team members to understand data needs and deliver solutions.
Documentation: Maintain thorough documentation for all data engineering processes, ensuring knowledge transfer and best practices.
Requirements
Bachelors degree in Computer Science, Information Technology, or related field.
Proven experience in SQL database design and optimization.
Experience with github or gitlab.
Experience with dbt.
Strong ETL development skills.
Experience with data modeling.
Hands-on experience with Snowflake or Databricks.
Proficiency in creating and managing data pipelines using Azure Data Factory.
Excellent problem-solving and analytical skills.
Proactive mindset with the ability to work independently and collaboratively.
Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.