Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
About the role
- Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
Responsibilities
- Collaborate with Data architects, Enterprise architects, Solution consultants and Product engineering teams to capture customer data integration requirements, conceptualize solutions & build required technology stack
- Collaborate with enterprise customer's engineering team to identify data sources, profile and quantify quality of data sources, develop tools to prepare data and build data pipelines for integrating customer data sources and third party data sources with Adobe solutions
- Develop new features and improve existing data integrations with customer data ecosystem
- Encourage team to think out-of-the-box and overcome engineering obstacles while incorporating new innovative design principles.
- Collaborate with a Project Manager to bill and forecast time for customer solutions
Requirements
- Experience as an enterprise Data Engineer from a consulting background
- AWS Certified Data Engineer – Associate or AWS Certified Cloud Practitioner
- 5+ years experience in building/operating/maintaining fault tolerant and scalable data processing integrations using AWS
- 7+ years experience in Python programming language preferably using PySpark
- Software development experience working with Apache Airflow, MongoDB, MySQL
- Strong capacity to manage numerous projects are a must
- Experience using Docker or Kubernetes is a plus
- BS/MS degree in Computer Science or equivalent industry experience
- Ability to identify and resolve problems associated with production grade large scale data processing workflows
- Excellent communication skills (we’re a geographically distributed team)
- Experience creating and maintaining unit tests and continuous integration.
- Passion for creating Intelligent data pipelines that customers love to use.
Benefits
- Health insurance
- 401(k) matching
- Paid time off
- Work from home options
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Data Engineer II focusing on strategic ingestion product for Travelers. Building data solutions and collaborating across teams to support analytic transformation.
Data Engineer at Tatum focusing on scalable data solutions and blockchain technology. Collaborating with teams to ensure data integrity and manage data infrastructure in a hybrid setup.
Senior Lead Data Engineer at Capital One collaborating with Agile teams and mentoring developers. Leading full - stack development and driving cloud - based solutions for financial empowerment.