Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
About the role
- AI Engineer enhancing data processing with generative AI solutions. Working with the Azure ecosystem to automate and optimize data workflows.
Responsibilities
- Design and implement GenAI-based solutions that optimize critical stages of the DDLC (Data Development Life Cycle).
- Develop agents that act as assistants in creating Databricks notebooks, pipelines in ADF (Azure Data Factory), and structures in Microsoft Fabric.
- Build workflows that integrate LLMs into our ecosystem (SQL Server and Power BI), automating tasks such as data documentation and creation of DAX measures.
- Apply advanced prompt engineering techniques to ensure the AI generates optimized, secure, and high-performance PySpark and T-SQL code.
- Define quality metrics to validate AI-generated artifacts (e.g., ensuring the efficiency of generated queries).
- Ensure solutions align with Data Governance practices, security, and privacy.
- Stay up to date on AI capabilities within Microsoft Fabric and Databricks to maximize the use of native tools versus custom developments.
Requirements
- Degree in Computer Science, Data Engineering, Statistics, or a related field.
- Strong experience in Data Engineering and a deep understanding of CI/CD pipelines applied to data.
- Required experience with AI agent orchestration frameworks (e.g., LangChain, Semantic Kernel, or AutoGen).
- Technical expertise in the Azure Data ecosystem (Databricks, Data Factory, and Fabric) and in SQL and Python/PySpark.
- Hands-on experience building GenAI solutions (OpenAI API, Azure OpenAI, or open-source models) with a strong focus on prompt engineering is essential.
- Ability to translate business challenges into agents that can assist in data modeling and dashboard creation.
- DataOps mindset: understanding that data requires testing, versioning, and monitoring.
Benefits
- Health and dental insurance;
- Meal and food allowance;
- Childcare assistance;
- Extended parental leave;
- Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) / TotalPass;
- Profit Sharing (PLR);
- Life insurance;
- Continuous learning platform (CI&T University);
- Discount club;
- Free online platform dedicated to physical and mental health and wellbeing;
- Pregnancy and responsible parenthood course;
- Partnerships with online course platforms;
- Language learning platform;
- And many others
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.