Data Engineer deploying Azure Databricks solutions at EY, leading a team and optimizing data models. Collaborating with clients to meet business needs in a cloud environment.
Responsibilities
Develop & deploy Azure Databricks in a cloud environment using Azure Cloud services.
ETL design, development, and deployment to Cloud Service.
Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams.
Design and optimize model codes for faster execution.
Lead and mentor a team of data engineers and analysts, ensuring high-quality delivery and fostering professional growth.
Collaborate with cross-functional teams to manage project timelines and deliverables.
Requirements
9 to 14 years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.
Extensive hands-on experience implementing data migration and data processing using Azure services: Databricks, ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Azure Data Catalog, Cosmos DB, etc.
Familiar with cloud services like Azure.
Hands-on experience on Spark/PySpark.
Hands-on experience in programming languages such as Python/Scala.
Knowledge in DevOps and CI/CD deployments.
Must have hands-on experience in SQL and procedural SQL languages.
Strong analytical skills and enjoys solving complex technical problems.
Proven ability to lead teams, manage resources, and drive projects to successful completion.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.