Senior Data Engineer developing data infrastructure and pipelines for fintech platform mylo in Egypt. Collaborating on data solutions using Python, SQL, and AWS services in a hybrid work environment.
Responsibilities
Design, develop, and maintain large-scale, reliable data pipelines using Python, SQL, and big data technologies such as Apache Spark and Kafka.
Build and optimize ETL/ELT processes for data transformation, loading, and integration from multiple sources.
Develop and maintain data storage solutions using both relational and NoSQL databases, including SQL Server, PostgreSQL, MySQL, and MongoDB.
Implement and manage CI/CD pipelines for data workflows, enabling automated deployments and version control.
Work with AWS services to build, deploy, and monitor cloud-based, scalable data solutions.
Leverage Apache Airflow for orchestrating workflows and PostHog for analytics tracking and event data.
Manage and enhance data warehousing solutions to support business intelligence and analytics needs.
Ensure data accuracy, consistency, and security across diverse systems and sources.
Troubleshoot and optimize data systems for performance, scalability, and cost efficiency.
Actively promote and contribute to a collaborative, innovative, and agile team
Requirements
5+ years of experience in data engineering, building and maintaining production-grade data pipelines and architectures.
Proficient in Python and SQL.
Hands-on with relational databases (SQL Server, PostgreSQL, MySQL) and NoSQL (MongoDB).
Experience with big data and stream processing tools (e.g., Apache Spark, Kafka).
Skilled in implementing CI/CD pipelines for data workflows.
Strong understanding of AWS services (S3, Redshift, Lambda, Glue).
Experience with Apache Airflow for workflow orchestration.
Familiarity with PostHog or Amplitude for analytics tracking and event management.
Comfortable with Docker, Kubernetes, and Linux shell scripting.
Solid grasp of data modeling, warehousing, scalability, and reliability best practices.
Proven ability to ensure data quality, governance, and security.
Strong communication skills and a collaborative mindset.
Passion for continuous learning and staying updated on emerging technologies.
Benefits
Office environment: When you come to our b_labs office, you'll find creative workspaces and an open design to foster collaboration between teams.
Flexibility: You know best whether you want to work from home or in the office.
Equipment: From "Day 1" you will receive all the equipment you need be successful at work.
Director leading strategy, governance, and delivery of enterprise data platform at Phillips 66. Partnering with AI, Data Science, and business teams to enhance analytics and business systems.
Product Owner driving ERP data migration initiatives for BioNTech’s global landscape. Leading effective data management and ensuring compliance with regulatory standards in a fast - paced environment.
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.