Data Engineer at Vistra designing and maintaining data pipelines for analytics. Collaborating with teams and optimizing data integration using modern cloud technologies.
About the role
- Data Engineer working on ingesting, transforming, and analyzing data on Google Cloud Platform. Collaborating with cross-functional teams in Chennai to deliver analytical data products.
Responsibilities
- Work on a Central Engineering Portfolio Team based in Chennai to deliver curated data products and perform end to end Full stack Data engineer role.
- Work effectively with fellow data engineers, product owners, data champions and other technical experts.
- Demonstrate technical knowledge and communication skills with the ability to advocate for well-designed solutions.
- Develop exceptional analytical data products using both streaming and batch ingestion patterns on Google Cloud Platform with solid data warehouse principles.
- Be the Subject Matter Expert in Data Engineering with a focus on GCP native services and other well integrated third-party technologies.
Requirements
- 5+ years of SQL development and analytics/data product development experience.
- 3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale.
- Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc.
- Experience working with Airflow for scheduling and orchestration of data pipelines.
- Experience working with Terraform to provision Infrastructure as Code.
- 2 + years professional development experience in Java or Python.
- Bachelor’s degree in computer science or related scientific field.
- Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Intern in Data Analysis and Data Engineering at a startup in Köln, focusing on software engineering and data analytics. Participate in the launch of an interactive sports app.
Snowflake Data Engineer responsible for data pipelines and warehouses for enterprise analytics at Liberty Coca - Cola. Collaborating across business functions to ensure high data quality and performance.
Full - Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Senior Data Engineer at A Kube Inc responsible for building and maintaining data pipelines for product performance. Collaborating with product, engineering, and analytics teams to ensure data quality and efficiency.
Data Engineer designing and building data pipelines at LexisNexis. Collaborating with partners for high - quality analytics and AI - ready data.
Data Engineer implementing data pipelines on Snowflake platform with a focus on innovation and collaboration for Zurich's data projects.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.