Data Engineer deploying Azure Databricks solutions at EY, leading a team and optimizing data models. Collaborating with clients to meet business needs in a cloud environment.
Responsibilities
Develop & deploy Azure Databricks in a cloud environment using Azure Cloud services.
ETL design, development, and deployment to Cloud Service.
Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams.
Design and optimize model codes for faster execution.
Lead and mentor a team of data engineers and analysts, ensuring high-quality delivery and fostering professional growth.
Collaborate with cross-functional teams to manage project timelines and deliverables.
Requirements
9 to 14 years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions.
Extensive hands-on experience implementing data migration and data processing using Azure services: Databricks, ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Azure Data Catalog, Cosmos DB, etc.
Familiar with cloud services like Azure.
Hands-on experience on Spark/PySpark.
Hands-on experience in programming languages such as Python/Scala.
Knowledge in DevOps and CI/CD deployments.
Must have hands-on experience in SQL and procedural SQL languages.
Strong analytical skills and enjoys solving complex technical problems.
Proven ability to lead teams, manage resources, and drive projects to successful completion.
Senior Data Engineer role at Dun & Bradstreet focused on data analytics and visualization. Collaborating with teams to optimize data processes and deliver actionable insights.
Senior Data Engineer with AWS expertise leading financial data architecture and scalable solutions. Collaborating in wealth management to enhance data quality and systems.
Data Migration Specialist handling large - scale data migration from legacy to enterprise PLM platform. Analyzing data structures, developing strategies, and ensuring integrity across systems.
Director leading strategy, governance, and delivery of enterprise data platform at Phillips 66. Partnering with AI, Data Science, and business teams to enhance analytics and business systems.
Product Owner driving ERP data migration initiatives for BioNTech’s global landscape. Leading effective data management and ensuring compliance with regulatory standards in a fast - paced environment.
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.