Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
About the role
- Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.
Responsibilities
- Driving value for customers by building data solutions
- Carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture
- Performing data extractions, transforming data for usability by data analysts and scientists, and loading data into data platforms
- Developing comprehensive knowledge of the bank’s data structures and metrics, advocating change for product development
- Practicing DevOps adoption in data engineering delivery, proactively performing root cause analysis
- Collaborating closely with core technology and architecture teams to build data knowledge and solutions
- Developing an understanding of data platform cost levers for strategic solutions
- Sourcing new data and integrating it into the overall solution for customers
Requirements
- At least six years of experience in Data Engineering, PySpark, Python and SQL
- Experience of ETL technical design, including data quality testing, cleansing and monitoring, and data warehousing and data modelling capabilities
- Experience using programming languages alongside knowledge of data and software engineering fundamentals
- Good knowledge of modern code development practices
- Strong communication skills with the ability to proactively engage with a wide range of stakeholders.
Benefits
- Professional development opportunities
- Health insurance
- Paid time off
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Technical Lead for data engineering and reporting in healthcare technology at Dedalus. Shaping innovative software solutions and leading cross - functional technical teams in Australia.
Senior ML Data Engineer working on data pipeline curation for Mobileye's autonomous vehicle dataset. Collaborating across teams to enhance ML engineering and vision model applications.
Data Engineer managing customer datasets to enhance industrial research and development. Responsible for ETL pipelines and data ingestion for the Uncountable Web Platform.
Data Engineer designing and maintaining scalable data solutions on Databricks for clinical trials. Collaborating with teams to overcome data challenges and ensure the smooth logistics of clinical supplies.
Senior Manager leading a team of database engineers to manage CCC's data platform. Overseeing mission - critical applications and collaborating with cross - functional teams in a hybrid environment.
As a Principal Data Architect at Solstice, lead the design and implementation of data architecture solutions. Ensure data integrity, security, and accessibility to meet strategic organizational goals.
Data Platform Specialist overseeing data workflows and enhancing data quality for Stackgini's AI - driven IT solutions. Collaborating with teams to drive improvements and stakeholder support.