Senior Data Engineer responsible for designing and developing big data solutions on GCP cloud. Working on transformation and modernization of data products with Google's cloud services.
Responsibilities
Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment of Data Platform.
Implement methods for automation of all parts of the pipeline to minimize labor in development and production.
Identify, develop, evaluate, and summarize Proof of Concepts to prove out solutions.
Test and compare competing solutions and report out a point of view on the best solution.
Experience with large scale solutioning and operationalization of data warehouses and analytics platforms on GCP.
Design and build production data engineering solutions to deliver pipeline patterns using Google Cloud Platform (GCP) services: BigQuery, DataFlow, Pub/Sub, DataProc, SQL, Compute Engine, Cloud Functions.
Orchestration tools like Apache Airflow.
Build new/enhance data products in GCP.
Requirements
Minimum 5 Years of Experience in Java/python in-depth
Minimum 5 Years of Experience in data engineering pipelines/ building data warehouse systems with ability to understand ETL/ELT principles and write complex sql queries.
Minimum 5 Years of GCP experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Google Cloud Storage, PubSub, Data Fusion, Dataproc
Minimum 2 years of experience in development using Data warehousing, Big Data
3 Years of experience deploying google cloud services using Terraform
Bachelors or masters in required field
Experience working with AI/LLM models, leveraging Generative AI
Understands data architectures and design independent of the technology
Experience with Big Query, SQL
Experience with Python, Apache Airflow
Exceptional problem solving and communication skills and management of multiple stakeholders
Experience in working with Agile and Lean methodologies
Experience with Test-Driven Development
Exposure to AI/LLM
Benefits
Immediate medical, dental, vision and prescription drug coverage
Flexible family care days, paid parental leave, new parent ramp-up programs, subsidized back-up child-care and more
Family building benefits including adoption and surrogacy expense reimbursement, fertility treatments, and more
Vehicle discount program for employees and family members and management leases
Tuition assistance
Established and active employee resource groups
Paid time off for individual and team community service
A generous schedule of paid holidays, including the week between Christmas and New Year’s Day
Paid time off and the option to purchase additional vacation time
Modeling Engineer developing software for system - level modeling of communication systems. Collaborating with architects and design teams in a semiconductor company focused on innovation.
Engineer tracking performance failure trends and enhancements for Automatic Train Control systems at TfL. Collaborating with cross - functional teams and mentoring ATC staff while delivering project management.
Digital Workplace Engineer improving digital workplace for BAM, a leading construction company in Europe. Managing VDI environments and optimizing technology solutions for efficiency and safety.
Deployed Engineer at LangChain working on LLM applications and collaborating with customers and enterprise sales. Leading technical demos and training workshops for developer audiences.
Engineer I role in project planning and control for projects in Process, Manufacturing, Production Industry at AtkinsRéalis. Focus on cost management, scheduling, and project delivery.
Engineer I developing and maintaining project control systems in construction. Collaborating with stakeholders to optimize project performance and reporting.
Engineer managing design, planning, implementation, and operations for outdoor radio networks. Leading mobile cell site deployments and collaborating with RF engineers and subcontractors.
InfoSec Enablement Engineer driving security transformation for new and legacy systems. Collaborating on complex architectures and providing proactive security solutions.
Field Service Engineer working at client laboratories to install and maintain atomic spectroscopy products. Requires a chemistry degree and significant analytical techniques experience.
Flying Doctor & ECU Validation Engineer delivering automotive electronics support in dynamic environments. Handling ECU validation, diagnostics, and multimedia system updates.