Senior Data Architect responsible for building data infrastructure at Trexquant, integrating diverse datasets for research and simulation applications. Collaborating with teams to enhance data accessibility and quality.
About the role
- Data Engineer designing and developing data pipelines and infrastructure for processing and analyzing large data volumes at CIAL. Collaborating with data scientists to meet data requirements.
Responsibilities
- Design and develop data pipelines to transfer, transform, and load data from various sources into a data warehouse or data lake.
- Build and maintain the data infrastructure required for storing, processing, and analyzing data.
- Develop and maintain data models for data storage, processing, and analysis.
- Ensure data quality and integrity through data validation checks, data cleansing, and data profiling techniques.
- Manage large volumes of data, including data storage, retrieval, and processing.
- Collaborate with data scientists and analysts to understand their data requirements and provide the necessary data infrastructure.
- Develop and maintain ETL workflows for moving data from source systems to data storage systems.
- Optimize data performance by implementing indexing, partitioning, and other techniques.
- Ensure data security by implementing data access controls, data encryption, and other security measures.
- Stay up-to-date with emerging data technologies and industry trends to continuously improve data engineering processes and practices.
Requirements
- Degree in Mathematics (statistics or financial) or Physics
- Proficiency in Python (and Jupyter Notebooks)
- Proficiency with ETL/ELT workflows
- Familiarity with PostgreSQL and MongoDB
- Good documentation writing skills
- Good time-management skills
- Good problem-solving skills
- Attention to detail
- English fluency is mandatory, Spanish and Portuguese a plus
Benefits
- A truly competitive salary based on experience
- Challenging work that makes a difference
- Great team environment
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer responsible for developing data solutions and integrating systems for advanced analytics at Lilly. Focusing on data pipelines and solutions ensuring data quality and compliance.
Junior Data Engineer assisting with data - driven use - cases in the payment sector. Contributing to the establishment of a central data platform at S - Payment.
Senior Data Engineer leading tailored data - driven solutions delivery for public sector clients. Involves data transformation projects and building AI - powered tools for decision making.
Technical Lead in Data Engineering at Intentsify, building scalable applications for B2B marketing solutions. Leading a small team and making key technological decisions.
Data Engineer developing scalable data pipelines for RunBuggy's automotive logistics platform. Collaborate with cross - functional teams to unlock powerful insights and optimize data infrastructure.
Working Student in Data Engineering supporting the development of an energy management app's data backbone across Europe. Collaborate with diverse teams to ensure data quality and optimization.
Senior Data Engineer at Minsait responsible for designing and maintaining data infrastructure. Ensuring efficient and secure data collection, storage, and processing across various sectors.
Senior Data Engineer developing and maintaining scalable data pipelines at Quality Digital. Ensuring data quality, security, and compliance with best practices while collaborating with data teams.
AI Data Engineer at Convatec designing and deploying data and AI workflows. Collaborating with AI Engineers and Data Scientists to maintain data pipelines and support analytics.