Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
About the role
- Senior Data Engineer developing and maintaining scalable data pipelines at Quality Digital. Ensuring data quality, security, and compliance with best practices while collaborating with data teams.
Responsibilities
- Design, build, and maintain scalable and efficient data pipelines.
- Integrate data from multiple sources and ensure its quality and consistency.
- Support data science and BI teams with required data.
- Ensure data governance, security, and compliance with best practices.
- Optimize query performance and storage models.
- Automate data ingestion, transformation, and loading processes (ETL/ELT).
- Collaborate with analysts, data scientists, and other engineers.
Requirements
- Strong experience in data engineering.
- Proficiency in languages such as Python or Scala for data processing.
- Knowledge of relational and non-relational databases (e.g., PostgreSQL, MongoDB, SQL Server).
- Experience with ETL/ELT tools (e.g., Airflow, dbt, DataStage, Luigi).
- Experience with cloud environments (AWS, GCP, Azure) and their data services (e.g., S3, BigQuery, Redshift, Databricks).
- Knowledge of data modeling and data lake/data warehouse architecture.
- Familiarity with code versioning (Git) and CI/CD.
- Differentials:
- Experience with streaming tools (e.g., Kafka, Spark Streaming).
- Knowledge of DataOps practices.
- Cloud or data engineering certifications.
- Experience with data governance and catalog tools (e.g., Apache Atlas, Alation).
- Desired soft skills:
- Analytical mindset and problem-solving focus.
- Strong communication skills for working in multidisciplinary teams.
- Proactivity and autonomy.
- Organization and attention to detail.
Benefits
- Meal and/or grocery allowance to help with food and market purchases 🍴
- Medical and dental assistance to keep you and your family healthy 💙
- Pharmacy discounts through partner pharmacies 💊
- Childcare assistance according to company policy 🍼
- Gym partnership to encourage physical activity 🤸♀️🤸♂️
- Partnership with SESC for cultural and leisure programs ✈
- Partnerships for language studies, technology courses, and learning platforms 📚
- Payroll-deductible loans with attractive rates + financial education program 💰
- Corporate University and learning paths with content on technology, soft skills, market trends, and more 👨💻
- Employee referral program with possible rewards and bonuses 🎁
- Group life insurance ⛑
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.