Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
About the role
- Senior Data Engineer delivering high-quality data solutions at a leading Google Cloud consultancy. Designing, building, and maintaining scalable data pipelines and infrastructure for complex data analysis.
Responsibilities
- How You’ll Shape Our SuccessThe purpose of this role is to design, build, and maintain scalable data pipelines and infrastructure that enable the efficient processing and analysis of large, complex data sets.
- What You’ll DoDevelop and maintain automated data processing pipelines using Google Cloud:
- Design, build, and maintain data pipelines to support data ingestion, ETL, and storage
- Build and maintain automated data pipelines to monitor data quality and troubleshoot issues
- Implement and maintain databases and data storage solutions:
- Stay up-to-date with emerging trends and technologies in big data and data engineering
- Ensure data quality, accuracy, and completeness
- Implement and enforce data governance policies and procedures to ensure data quality and accuracy:
- Collaborate with data scientists and analysts to design and optimise data models for analytical and reporting purposes
- Develop and maintain data models to support analytics and reporting
- Monitor and maintain data infrastructure to ensure availability and performance
Requirements
- What You’ll Need to Succeed
- Experience in contributing to technical decision making during in-flight projects.
- A track record of being involved in a wide range of projects with various tools and technologies, and solving a broad range of problems using your technical skills.
- Demonstrable experience of utilising strong communication and stakeholder management skills when engaging with customers
- Significant experience with cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).
- Strong proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle.
- Experience with big data technologies such as Hadoop, Spark, or Hive.
- Familiarity with data warehousing and ETL tools such as Amazon Redshift, Google BigQuery, or Apache Airflow.
- Proficiency in Python and at least one other programming language such as Java, or Scala.
- Willingness to mentor more junior members of the team.
- Strong analytical and problem-solving skills with the ability to work independently and in a team environment.
Benefits
- **Financial:**
- Competitive base salary.
- Discretionary company bonus scheme.
- Employee referral scheme
- Meal Vouchers
- **Health & Wellbeing:**
- Health Care Package
- Life and Health Insurance
- Bookster
- **Time Off & Flexibility: **
- 28 days of annual leave
- Floating bank holidays
- An extra paid day off on your birthday.
- Ten paid learning days per year.
- Flexible working hours
- Sabbatical leave (after 5 years).
- Work from anywhere (up to 3 weeks per year).
- **Development & Recognition: **
- Industry-recognised training & certifications.
- Bonusly: employee recognition and rewards platform.
- Clear opportunities for career development.
- Length of Service Awards.
- **Extra Perks:**
- Regular company events.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.
Data Engineer shaping modern data architecture to drive golf’s digital transformation. Collaborating with teams to enhance data pipelines and insights for customer engagement and revenue growth.
Staff Data Engineer overseeing complex data systems for CITY Furniture. Responsible for architecting and optimizing data ecosystems in a hybrid work environment.
Data Engineer strengthening data platform team at Samba TV to improve data analytics and reporting capabilities. Building on AWS, Databricks, BigQuery, and Snowflake technology.
Data Engineer focusing on secure ETL/ELT data pipelines and compliance in healthcare. Designing scalable ingestion frameworks and ensuring alignment with federal standards.