Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.
About the role
- Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
Responsibilities
- Design and evolve the enterprise data platform
- Lead complex solution design
- Embed governance enforcement through technical controls
- Set engineering standards and mentor engineers
- Collaborate with decentralized analytics teams across the Global Operations, Finance, and Sales departments to accelerate value delivery
Requirements
- Bachelor’s degree required, with a concentration in Computer Science, Statistics, Applied Mathematics, or a related quantitative field preferred.
- Master’s degree in a related field preferred.
- A minimum of 8 years of data engineering or data platform development experience with at least 5 years as a senior or principal-level technical leader required.
- Expert-level proficiency in Structured Query Language, Python programming language, and large-scale processing with Apache Spark or PySpark.
- Deep experience with major cloud platforms such as Amazon Web Services, Microsoft Azure, or Google Cloud Platform, and with modern data platforms such as Databricks or Snowflake.
- Strong understanding of streaming technologies such as Apache Kafka or Amazon Kinesis, orchestration tools such as Apache Airflow, and transformation frameworks such as Data Build Tool.
- Mastery of data modeling, semantic modeling, and performance tuning across data warehouse, lakehouse, and streaming architectures.
- Ability to implement technical governance (data quality, lineage, metadata, access management, and privacy controls) and establish engineering standards (CI/CD, infrastructure as code, and automated testing).
- Ability to lead complex technical design, influence without authority, and mentor engineers to raise the technical bar.
- Strong written and oral communication skills, including the ability to present ideas and suggestions clearly and effectively.
- Ability to work with different functional groups and levels of employees to effectively and professionally achieve results.
- Strong organizational skills; ability to accomplish multiple tasks within the agreed-upon timeframes through effective prioritization of duties and functions in a fast-paced environment.
Benefits
- healthcare coverage
- 401(k) savings plan
- paid time off
- company holidays
- sick leave
- parental leave
- access to an Employee Assistance Program focused on mental and financial wellness
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Engineer at Yü Group responsible for leading data engineering team and optimizing data solutions within the energy sector.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.
Data Engineer developing tools for maintaining data integrity in cargo tracking at Kpler. Collaborating with analysts and engineers to enhance data quality management.
Lead Azure Data Engineer designing and optimizing data ecosystems on Microsoft Cloud. Responsible for building scalable data platforms and pipelines for analytics and reporting.
Data Engineer providing support for IBM DataStage ETL jobs at Callibrity. Collaborating with stakeholders and working to modernize technology solutions in a hybrid work environment.
Cloud Data Engineer implementing tailored solutions for Volkswagen Group data processing. Building ETL/ELT pipelines while collaborating with technical experts.
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.