Calix Cloud Data Engineer involved in architecture design, data ingestion, and analytics for service provider transformation. Collaborating with cross-functional teams in a flexible hybrid work model.
Responsibilities
Work closely with Cloud product owners to understand, analyze product requirements and provide feedback
Develop conceptual, logical, physical models and meta data solutions
Design and manage an array of data design deliverables including data models, data diagrams, data flows and corresponding data dictionary documentations
Determine database structural requirements by analyzing client operations, applications, and data from existing systems
Technical leadership of software design in meeting requirements of service stability, reliability, scalability, and security
Guiding technical discussions within engineer group and making technical recommendations
Design review and code review with peer engineers
Guiding testing architecture for large scale data ingestion and transformations
Customer facing engineering role in debugging and resolving field issues
Requirements
10-12 years of software engineering experience delivering quality products
10+ years of development experience performing Data modeling, master data management and building ETL/data pipeline implementations
Proficiency in both Google Cloud Platform (GCP) services (BigQuery, Dataflow, Dataproc, PubSub/Kafka, Cloud Storage) and AWS services (Redshift, Glue, Kinesis, S3)
Proven experience in designing, building, and maintaining scalable data pipelines across GCP and AWS
Knowledge of big data processing frameworks such as Apache Spark, Flink and Beam
Proficient in using dbt/Dataform for data transformation and modeling within the data warehouse environment
Strong knowledge of SQL and at least one programming language (Python, Java, or Scala)
Understanding of Docker and Kubernetes for deploying data applications
Knowledge of data catalog tools (e.g., DataHub, Collibra, Alation) to ingest and maintain metadata
Strong analytical and troubleshooting skills, particularly in complex data scenarios
Ability to work effectively in a team environment and engage with cross-functional teams
Proficient in conveying complex technical concepts to stakeholders
Knowledge of data governance, security best practices, and compliance regulations in both GCP and AWS environments
Bachelor’s degree in Computer Science, Information Technology, or a related field
Relevant certifications (e.g., Google Cloud Professional Data Engineer, AWS Certified Data Analytics – Specialty)
Benefits
Flexible hybrid work model - work from Bangalore office for 20 days in a quarter
Senior Google Data Architect designing and delivering scalable data solutions on Google Cloud Platform. Collaborating across teams to shape target - state data architectures and influence enterprise data strategy.
Sr. ETL/Data Warehouse Lead at Huntington designing, developing, and supporting ETL and Data Warehousing framework. Analyzing systems based on specifications and providing technical assistance.
Data Engineer developing scalable data lake solutions and optimizing data pipelines at U.S. Bank. Collaborating with teams to manage data governance and cloud migration activities.
Lead AI, MLOps & Data Engineer at WedR, guiding complex data projects and AI innovation. Collaborate with diverse experts in a Product Studio for digital transformations.
Lead Azure Databricks Data Engineer implementing data solutions for data engineering projects at Ryan Specialty. Collaborating with stakeholders and mentoring junior staff on data pipelines and ETL processes.
Lead Azure Databricks Data Engineer at Ryan Specialty focused on implementing data solutions and collaborating with cross - functional teams to enhance data architecture.
Senior Data Engineer designing and implementing sustainable data solutions for diverse clients. Collaborating closely with stakeholders to enhance data services and platforms in a hybrid environment.
Risk Data Engineer and Architect at Lincoln Financial supporting risk analytics through AWS data solutions. Building scalable data pipelines and collaborating with cross - functional teams.
Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.