Data Engineer responsible for developing and maintaining data pipelines. Collaborating with US business team and utilizing in-house data platform.
Responsibilities
You will be responsible and accountable for the development and maintenance of data pipelines.
You will work with the business team in the US to gather requirements and provide efficient solutions to business requests by utilizing the in-house enterprise data platform.
Design, build, and maintain efficient, reusable, and reliable code.
Ensure the best performance and quality of applications.
Identify the issues and provide solutions to mitigate and address these issues.
Help maintain code quality, organisation, and automation to ensure optimal performance.
Continuously expand the body of knowledge via research.
Comply with corporate quality policies and procedures.
Ensure all training requirements are completed promptly.
Requirements
At least 3 years of Python programming experience, including data transformations using Pandas/PySpark libraries.
CDW (Commercial Data Warehouse) experience in the US Pharmaceuticals market is strongly preferred.
Experience implementing or supporting HCP and HCO data management, and MDM (Master Data Management) in US pharmaceuticals market is preferred.
Having experience working on different Python libraries and willing to learn/work on new libraries.
Having advanced analytical and problem-solving skills.
Understands the business processes and business data used in data transformations.
Knowing SQL queries, Snowflake, Databricks, Azure blob storage and AWS.
Senior Google Data Architect designing and delivering scalable data solutions on Google Cloud Platform. Collaborating across teams to shape target - state data architectures and influence enterprise data strategy.
Sr. ETL/Data Warehouse Lead at Huntington designing, developing, and supporting ETL and Data Warehousing framework. Analyzing systems based on specifications and providing technical assistance.
Data Engineer developing scalable data lake solutions and optimizing data pipelines at U.S. Bank. Collaborating with teams to manage data governance and cloud migration activities.
Lead AI, MLOps & Data Engineer at WedR, guiding complex data projects and AI innovation. Collaborate with diverse experts in a Product Studio for digital transformations.
Lead Azure Databricks Data Engineer implementing data solutions for data engineering projects at Ryan Specialty. Collaborating with stakeholders and mentoring junior staff on data pipelines and ETL processes.
Lead Azure Databricks Data Engineer at Ryan Specialty focused on implementing data solutions and collaborating with cross - functional teams to enhance data architecture.
Senior Data Engineer designing and implementing sustainable data solutions for diverse clients. Collaborating closely with stakeholders to enhance data services and platforms in a hybrid environment.
Risk Data Engineer and Architect at Lincoln Financial supporting risk analytics through AWS data solutions. Building scalable data pipelines and collaborating with cross - functional teams.
Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.