Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
About the role
- Data Engineer responsible for creating and maintaining data pipelines for machine learning models at a financial services company. Requires proficiency in modern database technologies and programming skills.
Responsibilities
- Support the deployment of machine learning models to production environments, supplying models with data stored in a warehouse or coming directly from sources, configuring data attributes, managing compute resources, and setting up monitoring tools (AWS CloudWatch, AWS EventBridge);
- Manage stored data and structure it appropriately using database management systems;
- Monitor the overall performance and stability of automated data pipelines and make necessary modifications according to requirements;
- Collect and integrate data from different environments from structured and unstructured sources; serve as a technical point of reference;
- Track the results of the team's action plans, ensuring value-driven and high-quality deliveries aligned with organizational objectives;
- Build and maintain data catalogs;
- Perform code reviews of ETL code.
Requirements
- Proficient knowledge of leading database models and technologies (OLTP, OLAP, Data Lake, Data Warehouse, and Big Data);
- Programming skills to develop, customize, and manage integration tools, databases, warehouses, and analytical systems (AWS DMS, AWS Glue, AWS Lambda, Step Functions, Glue Crawler, Athena, Redshift, S3, DynamoDB, Delta Tables);
- Knowledge of file formats such as JSON, PARQUET, AVRO, ORC, etc.;
- Experience with data cataloging tools such as Amundsen and AWS Glue Catalog;
- Experience with ETL code pipelines (CI/CD);
- Extensive experience working as a Data Engineer.
Benefits
- CAJU Flexible Benefits Card - Food/Meal/Mobility vouchers and more.
- Health insurance.
- Dental plan (Bradesco).
- Life insurance.
- Study incentive programs.
- English course - English Pass (partnership available to all DM employees).
- Wellhub for exercising.
- DM VISA card with a pre-approved limit.
- Flexible working hours.
- Private pension.
- ShortDay - log off earlier so you can take care of yourself!
- No dress code – what matters is that you feel comfortable.
- Day off on your birthday - a gift from DM to you!
- PPR (Profit Sharing Program).
- For parents: daycare assistance for children up to 6 years old.
- For parents: extended maternity and paternity leave — 180 days for mothers and 20 days for fathers.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.