Work closely with Cloud product owners to understand, analyze product requirements and provide feedback
Develop conceptual, logical, physical models and meta data solutions
Design and manage an array of data design deliverables including data models, data diagrams, data flows and corresponding data dictionary documentations
Determine database structural requirements by analyzing client operations, applications, and data from existing systems
Technical leadership of software design in meeting requirements of service stability, reliability, scalability, and security
Guiding technical discussions within engineer group and making technical recommendations
Design review and code review with peer engineers
Guiding testing architecture for large scale data ingestion and transformations
Customer facing engineering role in debugging and resolving field issues
Requirements
10-12 years of software engineering experience delivering quality products
10+ years of development experience performing Data modeling, master data management and building ETL/data pipeline implementations
Proficiency in both Google Cloud Platform (GCP) services (BigQuery, Dataflow, Dataproc, PubSub/Kafka, Cloud Storage) and AWS services (Redshift, Glue, Kinesis, S3)
Proven experience in designing, building, and maintaining scalable data pipelines across GCP and AWS
Knowledge of big data processing frameworks such as Apache Spark, Flink and Beam
Proficient in using dbt/Dataform for data transformation and modeling within the data warehouse environment
Strong knowledge of SQL and at least one programming language (Python, Java, or Scala)
Understanding of Docker and Kubernetes for deploying data applications
Knowledge of data catalog tools (e.g., DataHub, Collibra, Alation) to ingest and maintain metadata
Strong analytical and troubleshooting skills, particularly in complex data scenarios
Ability to work effectively in a team environment and engage with cross-functional teams
Proficient in conveying complex technical concepts to stakeholders
Knowledge of data governance, security best practices, and compliance regulations in both GCP and AWS environments
Bachelor’s degree in Computer Science, Information Technology, or a related field
Relevant certifications (e.g., Google Cloud Professional Data Engineer, AWS Certified Data Analytics – Specialty)
Benefits
Flexible hybrid work model - work from Bangalore office for 20 days in a quarter
Data Engineer developing architecture and pipelines for data analytics at NinjaTrader. Empowering analysts and improving business workflows through data - driven solutions.
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.
Data Engineer focusing on development and optimization of data pipelines in an insurance context. Ensuring data integrity and supporting data - driven decision - making processes.