Intern working on data engineering tasks for machine learning in the automotive field. Collaborating with Data Engineers and learning about data management tools.
About the role
- Senior Data Engineer for Semrush, developing scalable data pipelines and optimizing data systems. Collaborating with teams for analytics and mentoring junior engineers in best practices.
Responsibilities
- Lead the Design and development of scalable data pipelines and infrastructure
- Optimize the performance of data systems and troubleshoot complex data issues
- Collaborate with data scientists to ensure data is structured and available for advanced analytics
- Mentor and guide junior data engineers, providing technical leadership and support
- Ensure data security, privacy, and compliance with organizational policies
- Manage the integration of new data sources and ensure data quality
- Continuously evaluate and adopt new technologies to improve data engineering practices
- Contribute to architecture decisions
Requirements
- High level of proficiency in Python, SQL
- Good knowledge of Linux and Unix Shell scripting
- Experience with GCP, or other cloud providers
- Experience with Airflow or similar workflow orchestration tools
- Experience with column and/or transactional databases
- Understanding of distributed systems and scalable data architectures
- Experience writing clean, maintainable, and well-tested code
- Strong sense of delivery ownership, balancing speed of execution with adherence to established engineering standards, best practices, and quality requirements
- Shipping solutions efficiently without compromising code quality, reliability, or maintainability, even under tight timelines
- Actively driving alignment and collaboration across cross-functional teams
- Not required, but a plus: Experience with ClickHouse; Pipeline testing experience in Airflow (DAG validation, unit/integration testing); Expertise with containerisation and infrastructure-as-code (Docker, k8s, Terraform); Familiarity with monitoring and logging tools (Grafana, Prometheus, ELK); Hands-on experience with CI/CD pipelines and automated deployment workflows
Benefits
- Flexible working hours
- Unlimited PTO
- Flexi Benefit for your hobby
- Employee Support Program
- Loss of family member financial aid
- Employee Resource Groups
- Meals, snacks, and drinks at the office
- Corporate events
- Teambuilding
- Training, courses, conferences
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer developing and maintaining ETL processes using Azure Data Factory and Snowflake. Collaborating with teams to ensure reliable data for analytical purposes.
Senior Data Engineer at a fast - growing MNC designing scalable data pipelines and infrastructure for AI. Collaborate with teams while building solutions for analytics and energy optimization.
Senior Principal Engineer managing data quality framework implementation at Mercer. Collaborating with international stakeholders and ensuring robust data governance practices.
Data Engineer designing and implementing architectures in cloud environments. Collaborating with teams to define technical standards and achieve business goals.
Lead Data Engineer modernizing design standards for imagery models. Collaborate with stakeholders to build and optimize data pipelines and oversee integration efforts.
Data Engineer at Yü Group Plc shaping data strategy for the energy supplier in the UK. Collaborating with cross - functional teams to leverage data for business insights.
Data Engineer responsible for building scalable ETL/ELT data pipelines using Azure and Python. Collaborating with teams to ensure data quality and support analytics needs.
Senior Data Engineer at McKesson focusing on claims data, designing data pipelines and ensuring data integrity. Collaborating with teams to support analytics and reporting initiatives.
Data Engineer Student role at Canada Life focusing on connected data products for Canadian business needs. Collaborating with data teams to support analytics and decision - making initiatives.