Data Engineer role focusing on building reliable data pipelines and architectures. Collaborate to ensure high - quality data availability for analytics, BI, and AI initiatives.
About the role
- Design and maintain data pipelines for enterprise analytics and reporting, using SQL Server and Azure technologies. Collaborate with stakeholders to ensure data quality and performance optimization.
Responsibilities
- Design, build, and maintain data pipelines and infrastructure supporting enterprise analytics and reporting
- Develop and maintain incremental data pipelines using SSIS, PySpark notebooks, and Python
- Implement and optimize ETL/ELT processes for Azure SQL databases and data lake environments
- Build meta-driven, scalable data ingestion frameworks supporting SCD Type 2 methodology
- Write and optimize T-SQL stored procedures, views, and dynamic SQL for data transformations
- Develop Python-based automation including Azure Functions, blob triggers, and API integrations
- Maintain data quality, perform root cause analysis, and resolve data pipeline issues
- Support CI/CD processes including code reviews, Git version control, and Azure DevOps workflows
- Monitor pipeline performance and implement optimization strategies
- Assist with data modeling, indexing strategies, and schema evolution
- Collaborate with business stakeholders and Analytics team to meet reporting requirements
- Participate in data platform modernization and improvement initiatives
Requirements
- Proficiency with SQL Server, T-SQL, and database concepts (indexing, query optimization)
- Experience with ETL/ELT tools and concepts (SSIS or similar preferred)
- Understanding of data warehousing, dimensional modeling, and SCD methodologies
- Familiarity with Azure cloud services (especially Azure SQL Database)
- Ability to troubleshoot data issues and perform data analysis
- Strong problem-solving skills and attention to detail
- Experience with version control (Git) and collaborative development
Benefits
- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer facing challenges in diverse sectors at Smarthis. Implementing data integration solutions and applying machine learning models for optimization.
Senior Manager leading a team focused on scalable, reliable data products. Driving engineering excellence at Grainger with innovative technology solutions.
Data Engineer designing and managing data platforms using Snowflake for Grainger. Leading collaboration and mentorship while optimizing data workflows and infrastructure.
Data Architect for Invinity developing data management and analytics platform. Collaborating with cross - functional teams to provide reliable and efficient data systems.
Data Engineer building and enhancing a modern Data Lake architecture on AWS for game analytics and event tracking. Collaborating with multiple teams for data analysis and reporting.
Manager, Quality - Business Data Engineer responsible for managing RQA data governance and analytics. Collaborate with teams to enhance data solutions and drive technological advancements.
Data Engineer designing and implementing data foundations for automation and AI solutions at RHI Magnesita. Collaborating with technical experts and ensuring data quality with occasional project - based travel.
Data Warehouse Tech Lead leading GCP data projects at Derevo. Collaborating with internal teams to deliver high - quality data solutions in a hybrid role.
Senior Data Engineer transforming core business processes for Ørsted commodity trading. Developing data pipelines and working with a globally distributed team in IT and digital solutions.