Lead Data Engineer responsible for leading data engineering projects within the AI & Data Engineering team in Pune, India.
About the role
- Senior Data Engineer developing Data Warehouse solutions using BigQuery/Snowflake at Zendesk. Collaborating in an Agile environment and implementing data architecture best practices.
Responsibilities
- Collaborate with team members and business partners to collect business requirements, define successful analytics outcomes and design data models
- Serve as Data Model subject matter expert and data model spokesperson, demonstrated by the ability to address questions quickly and accurately
- Implement Enterprise Data Warehouse by transforming raw data into schemas and data models for various business domains using SQL & dbt
- Design, build, and maintain ELT pipelines in Enterprise Data Warehouse to ensure reliable business reporting using Airflow, Fivetran & dbt
- Optimize data warehousing processes by refining naming conventions, enhancing data modeling, and implementing best practices for data quality testing
- Build analytics solutions that provide practical insights into customer 360, finance, product, sales and other key business domains
- Build and Promote best engineering practices in areas of version control system, CI/CD, code review, pair programming
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery
- Work with data and analytics experts to strive for greater functionality in our data systems
Requirements
- 5+ years of data engineering experience building, working & maintaining data pipelines & ETL processes on big data environments
- 5+ years of experience in Data Modeling and Data Architecture in a production environment
- 5+ years in writing complex SQL queries
- 5+ years of experience with Cloud columnar databases (We use Snowflake)
- 2+ years of production experience working with dbt and designing and implementing Data Warehouse solutions
- Ability to work closely with data scientists, analysts, and other stakeholders to translate business requirements into technical solutions.
- Strong documentation skills for pipeline design and data flow diagrams.
- Intermediate experience with any of the programming language: Python, Go, Java, Scala, we primarily use Python
- Integration with 3rd party API SaaS applications like Salesforce, Zuora, etc
- Ensure data integrity and accuracy by conducting regular data audits, identifying and resolving data quality issues, and implementing data governance best practices.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Benefits
- Bonuses
- Benefits
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Manager leading coordination between teams for data engineering at DPR Construction. Supporting core markets and account management through data analytics and technical delivery.
Data Engineer utilizing Databricks and AWS for scalable data solutions. Collaborating on analytics with business teams at Travelers.
Program Manager leading enterprise - wide data migration efforts for Boeing's transition to modern data platforms. Overseeing complex processes to ensure secure and effective migrations across multiple systems.
Senior Data Engineer responsible for developing data products for Disney's immersive digital experiences. Collaborating with teams to ensure data quality and operational efficiency in a fast - paced environment.
Senior Data Engineer crafting and developing data products for analytical insights at Zendesk. Collaborating in an Agile environment with a focus on data warehousing and process optimization.
Senior Data Engineer designing and building data warehouse solutions with Snowflake for a fintech company. Collaborating with cross - functional teams to facilitate data insights and analytics.
Data Engineer developing and maintaining data pipelines and applications at EvidenceCare. Collaborating across teams to generate actionable insights from healthcare data for better decision - making.
Data Engineer managing and expanding enterprise business intelligence and data platform. Focusing on Tableau development and administration with a strong engineering background.
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.