Senior Data Engineer designing and maintaining data processing pipelines for analytics and machine learning in a fast - paced startup. Collaborating with cross - functional teams to ensure data accuracy and security.
About the role
- Azure Data Engineer designing and implementing robust data solutions leveraging Microsoft Azure technologies. Collaborating with stakeholders to create efficient data pipelines and ensure data integrity.
Responsibilities
- Design, build, and maintain data pipelines and ETL processes in Azure.
- Utilize Azure tools such as Data Lake, Data Factory, and Synapse Analytics to manage and analyze data.
- Good exposure in Fabric and ETL.
- Ensure the quality and integrity of data, troubleshooting and rectifying any data issues.
- Collaborate with analytics teams to support their data needs and enhance data-driven decision-making.
- Optimize data models and storage solutions for performance and cost efficiency.
- Implement data security practices to protect sensitive information.
- Stay current with technology trends and best practices in data engineering and cloud platforms.
Requirements
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5+ years of experience as a Data Engineer with a strong focus on Azure technologies.
- Proficiency in SQL and cloud data services such as Azure Data Lake, Azure Data Factory, and Azure Synapse.
- Strong background in data modeling, ETL processes, and data warehousing concepts.
- Experience with data visualization tools is a plus.
- Ability to analyze large datasets and derive meaningful insights.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork skills to work effectively with cross-functional teams.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer developing data pipelines and ETL processes for Stefanini's data architecture modernization. Involves data migration from AS400 to Microsoft Fabric Lakehouse.
Senior Data Engineer responsible for overseeing data ingestion and delivery at Kpler. Leading engineering best practices and collaborating with teams on client - facing data solutions.
Senior Data Engineer working on GCP cloud data solutions and ETL processes in AI & Data Engineering team. Collaborating within a hybrid work setup in Bangalore, India.
Lead Data Engineer designing and managing AWS data pipelines and platforms for AI & Data Engineering team. Involves collaborating with data scientists, analysts, and stakeholders for data - driven solutions.
Senior Data Engineer designing and developing scalable data pipelines using DBT and Python. Collaborating with internal stakeholders for analytics and reporting solutions.
Senior Data Engineer designing and optimizing the core data layer for Degreed's upskilling platform. Collaborating with internal teams and clients to ensure access to reliable and performant data.
Big Data Engineer handling both internal and external stakeholders for data processing related to fraud and compliance at ING. Managing and transforming high volume data and working closely with project teams.
Big Data Engineer role developing state - of - the - art solutions for financial crime prevention at ING. Collaborating with teams to manage high volume data and deliver effective technical solutions.
Senior Data Engineer focusing on Databricks in a market - leading company. Designing data architectures and optimizing data workflows in a collaborative environment.