Snowflake Data Engineer optimizing data pipelines using Snowflake for a global life science company. Collaborate with cross - functional teams for data solutions and performance improvements in Madrid.
About the role
- Senior Data Engineer developing data infrastructure and pipelines for fintech platform mylo in Egypt. Collaborating on data solutions using Python, SQL, and AWS services in a hybrid work environment.
Responsibilities
- Design, develop, and maintain large-scale, reliable data pipelines using Python, SQL, and big data technologies such as Apache Spark and Kafka.
- Build and optimize ETL/ELT processes for data transformation, loading, and integration from multiple sources.
- Develop and maintain data storage solutions using both relational and NoSQL databases, including SQL Server, PostgreSQL, MySQL, and MongoDB.
- Implement and manage CI/CD pipelines for data workflows, enabling automated deployments and version control.
- Work with AWS services to build, deploy, and monitor cloud-based, scalable data solutions.
- Leverage Apache Airflow for orchestrating workflows and PostHog for analytics tracking and event data.
- Manage and enhance data warehousing solutions to support business intelligence and analytics needs.
- Ensure data accuracy, consistency, and security across diverse systems and sources.
- Troubleshoot and optimize data systems for performance, scalability, and cost efficiency.
- Actively promote and contribute to a collaborative, innovative, and agile team
Requirements
- 5+ years of experience in data engineering, building and maintaining production-grade data pipelines and architectures.
- Proficient in Python and SQL.
- Hands-on with relational databases (SQL Server, PostgreSQL, MySQL) and NoSQL (MongoDB).
- Experience with big data and stream processing tools (e.g., Apache Spark, Kafka).
- Skilled in implementing CI/CD pipelines for data workflows.
- Strong understanding of AWS services (S3, Redshift, Lambda, Glue).
- Experience with Apache Airflow for workflow orchestration.
- Familiarity with PostHog or Amplitude for analytics tracking and event management.
- Comfortable with Docker, Kubernetes, and Linux shell scripting.
- Solid grasp of data modeling, warehousing, scalability, and reliability best practices.
- Proven ability to ensure data quality, governance, and security.
- Strong communication skills and a collaborative mindset.
- Passion for continuous learning and staying updated on emerging technologies.
Benefits
- Office environment: When you come to our b_labs office, you'll find creative workspaces and an open design to foster collaboration between teams.
- Flexibility: You know best whether you want to work from home or in the office.
- Equipment: From "Day 1" you will receive all the equipment you need be successful at work.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineer designing and implementing big data solutions at DATAIS. Collaborating with clients to deliver actionable business insights and innovative data products in a hybrid environment.
SAP Data Engineer supporting MERKUR GROUP in becoming a data - driven company. Responsible for data integration, ETL processes, and collaboration with various departments.
Big Data Engineer designing and managing data applications on Google Cloud. Join Vodafone’s global tech team to optimize data ingestion and processing for machine learning.
Data Engineer building and maintaining data pipelines for Farfetch’s data platform. Collaborating with the Data team to improve data reliability and architecture in Porto.
Senior Data Engineer at Razer leading initiatives in data engineering and AI infrastructure. Collaborating across teams to develop robust data solutions and enhancing AI/ML projects.
Data Engineering Intern working with data as Jua builds AI for climate and geospatial datasets. Contributing to the integration and validation of new datasets with experienced mentors.
Data Engineer supporting a fintech company in building and maintaining data pipelines. Collaborating with tech teams and enhancing data processing in a high - volume environment.
Senior Data Engineer developing and optimizing data pipelines for Scene+’s cloud - native platform in Toronto. Collaborating across teams to enhance data governance and analytics capabilities.
Staff Engineer developing innovative data solutions for dentsu's B2B marketing vision. Collaborating using cutting - edge cloud technologies and mentoring engineers in their careers.