Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
About the role
- Full-Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
Responsibilities
- Analyze large, and complex, data sets
- Design, develop and coordinate the generation of Data Pipelines
- Work collaboratively with team to plan and solve complex problems
- Design for, or optimize existing pipelines, for performance and cost
Requirements
- Expert Python Developer
- Strong SQL Developer
- Strong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)
- Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)
- Strong Automation Experience
- Experience with Databricks (Delta Lake, Notebooks, SQL Analytics)
- Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)
- Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
- Experience with Git and Azure DevOps
- Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)
- Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)
Benefits
- Excellent career growth and promotional opportunities
- Stellar compensation
- Ability to work with the world's premier provider of aftermarket automotive data
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Senior Data Engineer at A Kube Inc responsible for building and maintaining data pipelines for product performance. Collaborating with product, engineering, and analytics teams to ensure data quality and efficiency.
Data Engineer designing and building data pipelines at LexisNexis. Collaborating with partners for high - quality analytics and AI - ready data.
Data Engineer implementing data pipelines on Snowflake platform with a focus on innovation and collaboration for Zurich's data projects.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.
Data Engineer developing cloud solutions and software tools on Microsoft Azure big data platform. Collaborating with various teams for data analysis and visualization in healthcare.
Seeking a Boomi Integration Architect specializing in Data Warehouse and Master Data Hub implementations. Responsible for designing high - performance integration solutions across enterprise platforms.