Data Engineer/Solution Architect leading the design and optimization of data platforms for Jetfly Group. Collaborating with stakeholders and mentoring junior engineers to enhance data engineering practices.
Responsibilities
Lead the end-to-end design, development, deployment and maintenance of data pipelines using Databricks
Architect solutions for ingestion, transformation, storage and serving layers
Collaborate with stakeholders (operations, finance, safety, etc.) to understand business needs
Define and enforce data governance, data quality, metadata management, security, access controls
Work with cloud infrastructure (Azure) to provision, monitor and optimize data compute, storage, and networking resources
Implement CI/CD, testing, monitoring, alerting for data pipelines
Mentor and coach more junior engineers, define best practices, code reviews, knowledge sharing
Troubleshoot performance issues, data discrepancies, failures; ensure high availability, disaster recovery
Requirements
Deep hands-on experience with Databricks (or similar platforms like Spark on cloud)
Strong proficiency in data engineering: building batch & streaming pipelines; ETL/ELT; data modeling
Solid programming skills in Python, Scala or SQL (at least two)
Experience with cloud platforms (ideally Azure), infrastructure as code (Terraform, ARM templates, or similar)
Familiarity with data storage technologies: relational databases, NoSQL, data lakes, Delta Lake / Parquet / parquet-like formats
Understanding of distributed computing, partitioning, scaling, performance tuning
Hands-on experience with data governance, data lineage, data quality frameworks
Experience with CI/CD tooling, version control, automated testing, monitoring and alerting
Experienced IT Solution Architect designing secure technology solutions for ICON's clinical and enterprise platforms leveraging 15 - 18 years in IT with a focus on security and compliance.
Solutions Engineer bridging technical knowledge with client needs at OfficeRnD. Designing tailored solutions and providing technical guidance for product implementation and integrations.
Customer Solutions Consultant providing technical support and assistance to SiteMinder customers. Engage with diverse customers while maintaining strong relationships through high levels of customer service.
Resiliency Client Technical Solutioner at Kyndryl working with customers to develop tailored IT solutions. Collaborating with teams in a flexible environment to address customer challenges and drive success.
Vehicle Dynamics Simulation Integration Engineer at GM leading integration of full - vehicle co - simulation packages. Responsible for vehicle dynamics and related disciplines with a focus on innovation and collaboration.
Enterprise Solution Architect leading WMS implementation projects at Blue Yonder. Driving value through defining business processes and providing technical architectural solutions.
Senior Solutions Developer designing, developing, and supporting hybrid cloud solutions at HPE. Leading technical strategies and collaborating on significant project work.
Solutions Architect leading Google Cloud pre - sales engagements at Qodea. Collaborating with commercial teams and technical clients to create innovative cloud solutions.
Senior Software Solutions Architect leading technology solution design within Christian Care Ministry’s domain pillars. Working with stakeholders and software delivery for quality feature development.