Data Engineer designing and optimizing data solutions for Qualco Intelligent Finance. Focus on data integrity, consistency, and reusability in analytics deliverables within a hybrid environment.
About the role
- Data Engineer developing and maintaining scalable data pipelines for Kognia Sports Intelligence. Collaborating with engineers and data scientists to support data-driven decision making.
Responsibilities
- Design, build and support modern and scalable data pipelines using data processing frameworks, technologies, and platforms
- Use best practices around CI/CD, automation, testing, and monitoring of analytics pipelines
- Collaborate with software engineers, researchers, data scientists, and stakeholders to understand what data is required and how best to make it available in our platform
- Improve our cloud architecture and design new architectures as the need arises
- Identify and address possibilities for improvement in areas such as speed of delivery and infrastructure cost reduction
- Investigate new technologies and approaches as needed
- Willingness to take part in an on-call rotation with your team members
Requirements
- Minimum 1 year in a similar position or 3 years in other engineering roles with relevant responsibilities
- Fluent with one or more high-level programming languages (Python preferred, but also Ruby, Java, Scala, Go, or similar)
- Willing to work mostly in Python but possibility for other stacks as the team may decide on a service-by-service basis
- Experience working with SaaS production architectures in GCP (preferred) or AWS
- Ability to adapt to a fast-paced, changing agile environment
- Interest (if not experience) in DevOps technologies such as Kubernetes
- Excellent team player with strong verbal and written communication skills
- Comfortable working in English - we’re an international team based in Barcelona, with English as our shared language.
- Experience providing data and infrastructure for building and deploying ML models to production (preferred)
- Experience working in multi-functional teams with end-to-end responsibility for product development and delivery within your mission (preferred)
- Front-end experience in React (preferred)
- Interested in being the glue between engineering and research (preferred)
- Experience in data quality and governance (preferred)
- Specific knowledge of GitLab CI/CD (preferred)
- Knowledge of containerization, GitOps, and Linux (preferred)
- Kubernetes experience especially is a big plus (preferred)
- Familiarity with Apache Kafka (preferred)
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Architect leading data architecture and design for LifeByte's technology ecosystem. Collaborating with multiple teams to ensure robust data governance, compliance, and innovative strategies.
Data Engineer developing data solutions for major UK consumer brands. Collaborating with the Product & Technology team to meet diverse data requirements.
Senior Data Engineer building and managing data pipelines at Immediate Media. Collaborating with cross - functional teams to deliver robust data solutions and ensure data quality.
Data Engineer Team Lead at iKnowHow S.A leading Data Engineering team for outsourced projects. Driving scalable data solutions and fostering team collaboration with technical expertise.
Associate Data Engineer undergoing training in data engineering tools and collaborating with senior engineers on projects. Hands - on experience with real - world datasets and cloud - based platforms.
Data Engineer developing data infrastructures and pipelines for Motive's Enterprise clients. Collaborating across teams to enhance data processing with modern tools and frameworks.
Senior Data Engineer writing production code and maintaining data pipelines for commercial banking insights. Collaborating with other teams to deliver powerful data solutions.
Lead Data Engineer responsible for designing and implementing data solutions. Work with AWS and Snowflake in a global data and AI company headquartered in New York.
Data Engineer designing and optimizing ETL workflows using Snowpark. Collaborating with the CTO to enhance parcel shipping analytics software.