Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
Responsibilities
Collaborate with Data architects, Enterprise architects, Solution consultants and Product engineering teams to capture customer data integration requirements, conceptualize solutions & build required technology stack
Collaborate with enterprise customer's engineering team to identify data sources, profile and quantify quality of data sources, develop tools to prepare data and build data pipelines for integrating customer data sources and third party data sources with Adobe solutions
Develop new features and improve existing data integrations with customer data ecosystem
Encourage team to think out-of-the-box and overcome engineering obstacles while incorporating new innovative design principles.
Collaborate with a Project Manager to bill and forecast time for customer solutions
Requirements
Experience as an enterprise Data Engineer from a consulting background
AWS Certified Data Engineer – Associate or AWS Certified Cloud Practitioner
5+ years experience in building/operating/maintaining fault tolerant and scalable data processing integrations using AWS
7+ years experience in Python programming language preferably using PySpark
Software development experience working with Apache Airflow, MongoDB, MySQL
Strong capacity to manage numerous projects are a must
Experience using Docker or Kubernetes is a plus
BS/MS degree in Computer Science or equivalent industry experience
Ability to identify and resolve problems associated with production grade large scale data processing workflows
Excellent communication skills (we’re a geographically distributed team)
Experience creating and maintaining unit tests and continuous integration.
Passion for creating Intelligent data pipelines that customers love to use.
Associate Delivery Manager leading CDW and MDM solutions at Beghou Consulting, improving commercialization strategies for life sciences clients. Ensuring high - quality delivery of data solutions and mentoring junior staff.
Azure Data Engineer developing scalable data pipelines and collaborating with data teams for EU institutions. Working remotely from EU locations with a focus on high - quality data management.
Data Engineer/BI Analyst developing ETL processes and analyzing datasets at highly growing software solutions company in Athens. Focus on Azure Databricks and BI tools for data - driven insights.
Senior Data Engineer for iKnowHow S.A. designing scalable data pipelines and mentoring a team. Leading technical decisions and ensuring data quality in the software and robotics sector.
Vice President of Data Engineering leading the Reference Data Master team in transforming data strategies. Driving cloud - native solutions and modernizing party reference data management practices.
Cloud Data Engineer at BCBSNE using advanced technologies to enhance healthcare solutions. Collaborating with stakeholders and delivering scalable data pipelines with a focus on automation.
Data Engineer participating in a 1 - month intensive academy focused on Snowflake and Databricks. Opportunity to work on enterprise - level projects after training in Monterrey, Mexico.
Data Engineering professional enhancing skills through a specialized academy on Snowflake and Databricks. Program leads to permanent contract with a big client post - completion.
Senior Data Engineer responsible for data platform management in a Stockholm - based public transport company. Working with Azure and AWS tech in a hybrid role.
Data Migration Engineer creating and maintaining valuable datasets supporting health service technology team. Collaborate with cross - functional teams to ensure data integrity and project success.