data-engineer

Deeplight AI is an AI-driven digital risk prediction and prevention platform that specializes in cyber insurance. By utilizing innovative technology and expert insights, Deeplight helps businesses assess and manage their digital risks, providing customized insurance policies that reflect the specific risk profiles of individual organizations. Their services include detailed risk intelligence scans, operational resilience enhancement, and continuous risk assessment to ensure businesses are adequately covered and can save on insurance costs.

Welcome to Deeplight, the pioneering consultancy dedicated to guiding businesses through every facet of the AI adoption journey. From initial industry awareness to seamless integration and optimization, Deeplight is your strategic partner for unlocking the full potential of Artificial Intelligence.

The Enterprise Innovation Roadmap: Navigating Your AI Journey

EXECUTIVE COACHING: Propel your leadership team to new heights with personalized coaching driven by AI insights and guidance. Deeplight ensures your leadership makes informed decisions and drives innovation at the highest level.

CURRENT STATE ASSESSMENT: Embark on your AI journey with clarity by conducting a data-driven assessment. Gain a comprehensive understanding of your organization's AI readiness, identifying key strengths, weaknesses, and opportunities to maximize your return on AI investment.

DATA READINESS INITIATIVES: Elevate your data game with Deeplight's tailored data cleansing, organization. Bridge the gap between your current data and the needs of successful AI implementation, ensuring your AI models have the fuel they need to thrive.

USE CASE WORKSHOPS: Collaboratively explore the most impactful AI applications for your unique business needs. Deeplight facilitates brainstorming sessions, feasibility studies, and prioritization to identify use cases with the highest potential for success. Turn ideas into actionable strategies with our expert guidance.

CUSTOM MODEL DESIGN: Deeplight goes beyond basic AI models with custom "AiGent" design. Craft intelligent agents tailored to your challenges and goals, ensuring optimal performance and alignment with your strategic vision. Redefine what's possible with AI for your business.

Ready to elevate your business through the power of AI? 

Deeplight serves as your beacon of innovation, guiding businesses through the complex process of AI adoption. Connect with us to embark on a transformative AI journey that propels your enterprise to new heights.

Deeplight AI

• Design, build, and optimise scalable data solutions, primarily utilising the Lakehouse architecture to unify data warehousing and data lake capabilities.
• Advise stakeholders on the strategic choice between Data Warehouse, Data Lake, and Lakehouse architectures based on specific business needs, cost, and latency requirements.
• Design, develop, and maintain scalable and reliable data pipelines to ingest, transform, and load diverse datasets from various sources, including structured and unstructured data, streaming data, and real-time feeds.
• Implement standards and tooling to ensure ACID properties, schema evolution, and high data quality within the Lakehouse environment.
• Implement robust data governance frameworks (security, privacy, integrity, compliance, auditing).
• Continuously optimize data storage, compute resources, and query performance across the data platform to reduce costs and improve latency for both BI and ML workloads.
• Develop and maintain CI/CD pipelines to automate the entire machine learning lifecycle, from data validation and model training to deployment and infrastructure provisioning.
• Deploy, manage, and scale machine learning models into production environments, utilizing MLOps principles for reliable and repeatable operations.
• Establish and manage monitoring systems to track model performance metrics, detect data drift (changes in input data), and model decay (degradation in prediction accuracy).
• Ensure rigorous version control and tracking for all components: code, datasets, and trained model artifacts (using tools like MLflow or similar).
• Create comprehensive documentation, including technical specifications, data flow diagrams, and operational procedures, to facilitate understanding, collaboration, and knowledge sharing.

Data Engineer

Data Engineer designing, implementing, and optimizing data pipelines for DeepLight AI. Collaborating closely with a multidisciplinary team to analyze large-scale data.

Envision Employment Solutions is a recruitment agency that provides tailored employment services for clients and candidates. Founded in 2013, the company focuses on matching top talents globally with businesses in need of skilled professionals across various sectors. They offer services like recruitment, headhunting, manpower outsourcing, and both technical and psychometric assessments to ensure a perfect fit for roles, making them a key player in the MENA region's recruitment landscape.

Envision was founded in 2013 to support the Egyptian market with both temporary and permanent recruitment solutions. We now successfully support some of the country’s largest businesses across the EMEA regions with hard-to fill roles. We have been immensely successful in creating a global network of highly adept intelligent workforce that can help a company achieve their mission critical projects and goalsEnvision was founded in 2013 to support the Egyptian market with both temporary and permanent recruitment solutions. We now successfully support some of the country’s largest businesses across the EMEA regions with hard-to fill roles. We have been immensely successful in creating a global network of highly adept intelligent workforce that can help a company achieve their mission critical projects and goals. Keeping Pace with projects and being on the lookout for extremely talented individuals has become ever more challenging. Here is where Envision comes into play to bring the best suited talents for your company. Our recruiters are exceptionally skilled in identifying top talent around the globe and matching them with the client’s needs. 

Envision Employment Solutions

• Design, build, and maintain robust ETL processes and data pipelines using Informatica (PowerCenter, IDQ, or Cloud Data Integration)
• Develop and optimize data integration workflows for structured and unstructured data sources
• Ensure data quality, integrity, governance, and security across enterprise platforms
• Participate in data modeling and architecture discussions
• Collaborate with data architects, business analysts, and application teams to align data solutions with business requirements
• Maintain documentation of data flows, transformations, and system architecture
• Troubleshoot performance bottlenecks and resolve complex data-related issues
• Support enterprise data governance and metadata management initiatives


Senior Data Management Engineer

Senior Data Management Engineer designing and implementing data solutions for a global IT consulting leader. Collaborating with teams to ensure data accessibility, quality, and governance.

***Your responsibilities as a DataOps Engineer will include, but not be limited to;***

- ***Monitoring & Alerting***

- Monitor and act on incidents related to:

- AWS Glue job executions
- Current DMS and dbt pipelines
- Kafka lag and streaming health
- Data freshness SLA breaches
- Data quality issues
- Platform health alerts

- Perform L1 triage or distribute incidents to L2/L3 teams as needed.

- ***Incident Management***

- Own the incident response process:

- Initial triage and severity assessment.
- Coordinate with development teams for resolution.
- Create and assign JIRA tickets with full context.
- Track incident resolution and closure.

- Escalate high-priority or long-running incidents to management.

- ***Root Cause Analysis & Prevention***

- Conduct post-incident root cause analysis.
- Maintain incident logs and post-mortem documentation.
- Implement preventive measures for recurring issues in collaboration with dev teams.

- ***Operational Reporting***

- Manage the TV dashboard providing real-time status of critical flows (with color-coded indicators).
- Deliver a daily 10–15 min operational review of previous day’s executions, open incidents, and follow-ups.
- Share daily summary emails with the team.

- ***Continuous Awareness***

- Stay up-to-date on the status of all critical flows and remediation efforts.
- Ensure proactive communication on risks and delays.

DataOps Engineer – Lakehouse Operations

DataOps Engineer managing Lakehouse Operations at DeepLight AI, ensuring data ecosystem reliability and efficiency in Abu Dhabi. Role involves monitoring, incident management, and reporting for data pipelines.

• Design and enforce Medallion Architecture for the Lakehouse.
• Drive architectural decision-making through SAF/ARB architecture forums.
• Lead design for all Data Factory squads working on data initiatives.
• Define standards for Apache Iceberg tables, including partitioning strategy, schema evolution, time travel and snapshot retention, and table optimization schedules.
• Establish data modeling standards (e.g., dimensional modeling for Gold layer, SCD2, naming conventions, metadata management).
• Define lineage standards leveraging OpenMetadata.
• Coordinate with platform teams on Iceberg-related activities.
• Collaborate with Data Quality leads to implement validation rules.
• Proactively manage escalations and communicate progress with senior stakeholders.
• Provide guidance to Glue Data Engineers.
• Establish code review processes and best practices.
• Create reusable design patterns and templates for consistency.

Data Architect

Data Architect responsible for designing and enforcing Medallion Architecture for AI consultancy's Lakehouse implementations with a focus on data modeling and standards.

***Your responsibilities as the AWS Glue Data Engineer will include:***

- **Data Ingestion Development**

- Building and implementing AWS Glue jobs for Bronze layer ingestion using defined standards and templates.
- Implementing correct loading methods based on source requirements (CDC, full load, delta, snapshot).
- Designing and executing historical loading mechanisms to bring legacy data into the Lakehouse.

- **Performance Optimisation**

- Optimising Glue job performance (DPU allocation, parallelization, partitioning) according to best practices.
- Collaborating with platform teams to ensure tooling and optimization alignment.

- **Migration & Automation**

- Aggressively migrating source tables to Bronze layer, initially using manual approaches with standards/templates, later leveraging AI-enabled acceleration.
- Ensuring jobs are version-controlled and production deployment is automated via Git and Terraform.

- **Governance & Monitoring**

- Implementing source system connectivity into CDP in collaboration with source system owners.
- Ensuring jobs comply with data contracts and are properly monitored.
- Preparing documentation and handover to operational support teams.

- **Collaboration**

- Working closely with Data Architect for ingestion patterns and standards.
- Coordinating with Data Assurance Lead to apply quality checks across all jobs.
- Partnering with platform engineers for tooling and optimisation.

AWS Glue Data Engineer

AWS Glue Data Engineer at DeepLight AI responsible for data ingestion and pipeline performance optimisation. Collaborate with teams to build scalable solutions in a hybrid work environment.

Hybrid Data Engineers roles in United Arab Emirates

Browse 5 hybrid data engineers roles hiring in United Arab Emirates plus related opportunities such as data architect, analytics engineer and product analyst.

5 jobs found

Data Engineer

Deeplight AI

Senior Data Management Engineer

Envision Employment Solutions

DataOps Engineer – Lakehouse Operations

Deeplight AI

Data Architect

Deeplight AI

AWS Glue Data Engineer

Deeplight AI