Data Engineer designing, developing, and maintaining data pipelines and Snowflake data warehouses at Liberty Coca - Cola. Collaborating with teams for analytics, forecasting, and optimizing performance.
About the role
- Principal Data Architect at KION designing and building enterprise-scale data platforms. Collaborating with teams to ensure robust and scalable data ecosystems across various technologies.
Responsibilities
- As the sole hands-on enterprise data architect, you will be responsible for ideation, architecture, design and development of new enterprise data platform.
- Collaborate with other cloud and security architects to ensure seamless alignment within our overarching technology strategy.
- Architect and design core components with a microservices architecture, abstracting platform, and infrastructure intricacies.
- Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.
- Design and develop connector frameworks and modern connectors to source data from disparate systems both on-prem and cloud.
- Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices while keeping costs in check.
- Architect and design the best security patterns and practices.
- Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.
- Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
- Design and develop advanced analytics and machine learning capabilities on the data platform.
- Design and develop observability and data governance frameworks and practices.
- Stay up to date with the latest data engineering trends, technologies, and best practices.
- Drive the deployment and release cycles, ensuring a robust and scalable platform.
Requirements
- 15+ of proven experience in modern data engineering
- Broader data landscape experience and exposure
- Solid software engineering experience
- Prior experience architecting and building successful enterprise scale data platforms in a green field environment
- Proficiency in building end to end data platforms and data services in GCP
- Proficiency in tools and technologies: BigQuery, SQL, Python, Spark, DBT, Airflow, Kafka, Kubernetes, Docker
- Solid experience designing and developing distributed microservices based data architectures
- Proficiency in architecting and designing and development experience with batch and real time streaming infrastructure
- Proficiency with IoT architectures
- Solid experience with architecting and implementing metadata management including data catalogues, data lineage, data quality and data observability for big data workflows
- Hands-on experience with GCP ecosystem and data lakehouse architectures
- Strong experience with container technologies such as Docker, Kubernetes
- Strong understanding of data modeling, data architecture, and data governance principles
- Excellent experience with DataOps principles and test automation
- Excellent experience with observability tooling: Grafana, Datadog
- Previous experience working with engineers of all levels – Principal, Senior and Junior
Benefits
- Career Development
- Competitive Compensation and Benefits
- Pay Transparency
- Global Opportunities
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Sr. Analyst, Actuarial Data Engineer leading design and implementation of technology solutions for Lincoln Financial. Develop data & analytics solutions to improve data warehousing, financial reporting, reserve analytics, and automation efforts.
Actuarial Data Engineer Analyst leading the design and implementation of technology solutions at Lincoln Financial. Develop data & analytics solutions for improved financial reporting and automation efforts.
Microsoft Data Architect guiding the implementation of Microsoft Data Architectures for clients in various industries. Leading technical consultations and team coaching with focus on Azure and BI technologies.
Data Engineer GCP Consultant developing scalable solutions in GCP. Collaborating with teams to implement data - driven business strategies in the financial services sector.
Lead Data Engineer at Capital One collaborating across Agile teams to develop cloud - based solutions. Utilizing programming languages and data technologies to empower financial services for millions.
Data Engineer developing modern data models and ETL processes for RUF's BI solutions based on Microsoft technologies. Focusing on data quality, performance, and automation in a cloud environment.
Senior Data Engineer at Cifas focusing on data pipeline design and management using Microsoft Fabric tools. Collaborating with teams to ensure data integrity and analytics performance.
Data Engineer responsible for designing and maintaining data pipelines and infrastructure, converting requirements into complex reports and dashboards. Consults with clients for data visualization dashboards and applications.
Senior Data Engineer developing scalable data pipelines for AI - driven decision - making in e - commerce. Join a team innovating online business management with autonomous agents.