Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.
About the role
- Senior Data Engineer developing and maintaining scalable data solutions in AWS for analytical decision-making. Focusing on data governance, performance, and quality across the data lifecycle.
Responsibilities
- Develop, maintain and evolve data pipelines in an AWS environment
- Implement ETL/ELT processes using AWS Glue and EMR
- Create and maintain analytical dashboards using Amazon QuickSight
- Create, optimize and maintain SQL queries in Amazon Athena
- Perform data modeling for Data Warehouse and Data Lake
- Implement data governance practices, data quality, versioning and access control
- Work in Big Data and distributed processing environments, ensuring scalability and performance.
Requirements
- Strong knowledge of AWS services, including: S3, Athena, Glue, EMR, QuickSight
- Experience with DynamoDB
- Experience with RDS PostgreSQL
- Solid knowledge of data modeling, including: Star Schema, Snowflake, Data Warehouse, Data Lake, normalization and denormalization
- Experience with SQL, Python and Apache Spark (PySpark)
- Proven experience in Big Data and distributed processing environments
- Experience with Data Lakes and Data Lakehouses, especially with Apache Iceberg.
Benefits
- Flexible work arrangements
- Professional development
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Senior Data Engineer at Yü Group responsible for leading data engineering team and optimizing data solutions within the energy sector.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.
Data Engineer developing tools for maintaining data integrity in cargo tracking at Kpler. Collaborating with analysts and engineers to enhance data quality management.
Lead Azure Data Engineer designing and optimizing data ecosystems on Microsoft Cloud. Responsible for building scalable data platforms and pipelines for analytics and reporting.
Data Engineer providing support for IBM DataStage ETL jobs at Callibrity. Collaborating with stakeholders and working to modernize technology solutions in a hybrid work environment.
Cloud Data Engineer implementing tailored solutions for Volkswagen Group data processing. Building ETL/ELT pipelines while collaborating with technical experts.
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.