Data Engineer delivering data for Financial Crime Prevention teams and supporting consistent data layer. Collaborating with multiple teams and defining expected solution details.
About the role
- Data Engineer I developing data services with Azure technology for global risk management insights. Collaborating with teams to optimize data processes and ensure quality standards.
Responsibilities
- Design and implement data pipelines to efficiently extract, transform, and load (ETL) data from various sources into a central data lake using Azure Data Factory and Azure Databricks
- Transform and process data using Python, PySpark, and SQL to create valuable insights
- Collaborate with peers and senior team members to optimize data processes and solve complex challenges
- Ensure data quality by performing thorough checks and troubleshooting issues
- Apply best practices in data engineering for reliability and performance
- Optimize pipelines for maximum efficiency and cost-effectiveness
- Document comprehensively and maintain data mapping across multiple systems
- Provide hands-on troubleshooting and consulting for data challenges when needed
- Perform basic unit testing to maintain data quality standards
Requirements
- Bachelor's or master's degree in computer science, information technology, or a related field
- Approximately 2-3 years of experience in a data-related role, preferably data engineering
- Hands-on expertise with programming languages such as Python, PySpark, and SQL
- Working knowledge of data processing frameworks or ETL tools like Azure Data Factory and Azure Databricks
- Experience with Azure DevOps or similar CI/CD tools
- Experience in agile software engineering methodologies (nice to have)
- Strong analytical and problem-solving skills to tackle complex data challenges (nice to have)
- Excellent interpersonal and communication skills, both written and verbal (nice to have)
- Meticulous attention to detail and commitment to data accuracy (nice to have)
- Knowledge of AI tools like CoPilot, ChatGPT, etc. (nice to have)
- Eagerness to learn and collaborate with team members (nice to have)
Benefits
- hybrid work model where expectation is to be in office at least three days per week
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior consultant at Infosys designing enterprise data solutions and leading technical teams. Collaborating across business pillars in a high - growth consulting environment focused on analytics and data strategy.
Senior Data Engineer designing and overseeing data pipelines in Databricks on AWS. Responsible for data quality and performance for enterprise analytics and AI workloads.
Data Engineer responsible for developing ETL/ELT pipelines for Whow Games. Work includes optimizing data models and managing databases for analysis.
Global digital business services organization seeks Data Engineer to enhance data processes through innovative solutions and collaboration.
AI Data Pipeline Engineer designing and operating high - throughput systems for petabyte - scale data delivery. Collaborating across teams to ensure data flows into AI workloads efficiently.
AWS Data Engineer role focusing on AWS technologies in Gurugram, Haryana, India. Responsibilities include AWS data engineering tasks and collaboration with team members.
Data Engineer implementing innovative technology for various domains at Quantexa. Building data pipelines and providing insights to help clients solve complex business problems.
Principal Consultant Data Architecture leading complex Data and Analytics projects in a hybrid environment. Responsible for designing enterprise data architectures and mentoring technical teams.
Consultant / Senior Consultant in Data Engineering & Data Science contributing to data solutions. Collaborating with cross - functional teams in a hybrid environment in Germany.