Data Engineer responsible for creating and maintaining data pipelines for machine learning models at a financial services company. Requires proficiency in modern database technologies and programming skills.
Responsibilities
Support the deployment of machine learning models to production environments, supplying models with data stored in a warehouse or coming directly from sources, configuring data attributes, managing compute resources, and setting up monitoring tools (AWS CloudWatch, AWS EventBridge);
Manage stored data and structure it appropriately using database management systems;
Monitor the overall performance and stability of automated data pipelines and make necessary modifications according to requirements;
Collect and integrate data from different environments from structured and unstructured sources; serve as a technical point of reference;
Track the results of the team's action plans, ensuring value-driven and high-quality deliveries aligned with organizational objectives;
Build and maintain data catalogs;
Perform code reviews of ETL code.
Requirements
Proficient knowledge of leading database models and technologies (OLTP, OLAP, Data Lake, Data Warehouse, and Big Data);
Programming skills to develop, customize, and manage integration tools, databases, warehouses, and analytical systems (AWS DMS, AWS Glue, AWS Lambda, Step Functions, Glue Crawler, Athena, Redshift, S3, DynamoDB, Delta Tables);
Knowledge of file formats such as JSON, PARQUET, AVRO, ORC, etc.;
Experience with data cataloging tools such as Amundsen and AWS Glue Catalog;
Experience with ETL code pipelines (CI/CD);
Extensive experience working as a Data Engineer.
Benefits
CAJU Flexible Benefits Card - Food/Meal/Mobility vouchers and more.
Health insurance.
Dental plan (Bradesco).
Life insurance.
Study incentive programs.
English course - English Pass (partnership available to all DM employees).
Wellhub for exercising.
DM VISA card with a pre-approved limit.
Flexible working hours.
Private pension.
ShortDay - log off earlier so you can take care of yourself!
No dress code – what matters is that you feel comfortable.
Day off on your birthday - a gift from DM to you!
PPR (Profit Sharing Program).
For parents: daycare assistance for children up to 6 years old.
For parents: extended maternity and paternity leave — 180 days for mothers and 20 days for fathers.
Associate Data Engineer supporting data engineering projects at The Hartford in Hartford, CT and Charlotte, NC. Engaging in projects that involve data analysis and developing data assets using various technologies.
Senior Data Engineer / Snowflake Architect leading the design and optimization of data solutions. Working closely with clients and internal teams to build scalable architectures in a hybrid environment.
Data Engineer II developing ETL/ELT solutions for higher education data warehouse. Ensuring reliable institutional data for strategic decision - making by university leaders.
Associate Data Engineer building and maintaining data systems at Incedo. Transforming raw information into accessible datasets for decision - making and collaborating with analysts and data scientists.
Intern Data Engineer at Flutter Studios learning to create applications in the gaming industry. Join a cross - functional team to implement a basic application in an Agile environment.
AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.