Senior Data Engineer responsible for data pipeline projects at Suprema Gaming. Focus on batch and streaming data solutions while collaborating with business teams.
About the role
- Data Engineer responsible for developing scalable data solutions and optimizing pipelines at Mindera. Collaborating with stakeholders to ensure data quality and performance in Chennai, India.
Responsibilities
- Design, develop, and maintain scalable **data pipelines** and transformation workflows using Databricks and Spark.
- Build and optimize **ETL/ELT processes** to ingest, cleanse, and prepare large datasets.
- Work with AWS services such as **S3, Lambda, IAM, ECS and CloudWatch** to support data architecture and operational needs.
- Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and translate them into technical solutions.
- Ensure data quality, reliability, and performance across all data systems.
- Implement and enforce **best practices** for coding, version control, CI/CD, and environment management.
- Monitor and troubleshoot data pipelines, ensuring high availability and timely delivery.
- Contribute to architectural decisions, documentation, and process improvements.
Requirements
- Strong hands-on experience with **AWS Cloud** (S3, Lambda, IAM, EC2 or equivalent).
- Extensive experience with **Databricks**, Delta Lake, and Unity Catalog.
- Proficiency in **Apache Spark** (PySpark preferred).
- Strong programming skills in **Python**.
- Excellent command of **SQL**, including performance tuning and working with large datasets.
- Experience working in fast-paced, agile environments.
- Strong problem-solving abilities and a proactive approach to identifying improvements.
- Excellent communication and stakeholder management skills; able to collaborate across multiple teams.
- Experience with data governance frameworks and tools (e.g., DataHub, Soda).
- Experience with CI/CD tools (GitHub Actions).
Benefits
- Fun, happy and politics-free work culture built on the principles of lean and self organisation;
- Work with large scale systems powering global businesses;
- Competitive salary and benefits.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior data leader managing the enterprise data architecture at Breakthru Beverage. Leading high - performing teams in data engineering and defining modern data strategies.
Data Engineer at Equinix implementing data architecture solutions for scalability and analytics. Collaborating with teams to design data pipelines and maintain data models for business objectives.
Data Warehouse Architect developing and optimizing robust data warehouse environments on SAP BW/4HANA. Critical for enabling advanced analytics and reporting across the organization.
Data Engineering Manager leading a new Data Engineering team in Bengaluru. Shaping the design and scaling of core data engineering practices across the organization.
Sr. ETL/Data Warehouse Lead at Huntington designing, developing, and supporting ETL and Data Warehousing framework. Analyzing systems based on specifications and providing technical assistance.
Senior Google Data Architect designing and delivering scalable data solutions on Google Cloud Platform. Collaborating across teams to shape target - state data architectures and influence enterprise data strategy.
Data Engineer developing scalable data lake solutions and optimizing data pipelines at U.S. Bank. Collaborating with teams to manage data governance and cloud migration activities.
Lead AI, MLOps & Data Engineer at WedR, guiding complex data projects and AI innovation. Collaborate with diverse experts in a Product Studio for digital transformations.
Lead Azure Databricks Data Engineer at Ryan Specialty focused on implementing data solutions and collaborating with cross - functional teams to enhance data architecture.