Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
About the role
- Data Engineer joining Quantexa to implement innovative data solutions in multiple domains. Collaborating with teams to manage and cleanse high volume data while solving business problems.
Responsibilities
- **What you’ll be doing.**
- Writing defensive, fault tolerant and efficient code for production level data processing systems.
- Configuring and deploying Quantexa software using tools such as Spark, Hadoop, Scala, Elasticsearch, with our platform being hosted on both private and public virtual clouds, such as Google cloud, Microsoft Azure and Amazon.
- You’ll be a trusted source of knowledge for your clients. And you’ll articulate technical concepts to a non-technical audience so they can make key decisions.
- Collaborate with both our solution architects and our R&D engineers to champion solutions and standards for complex big data challenges. You proactively promote knowledge sharing and ensure best practice is followed.
Requirements
- **What you’ll bring.**
- You’ll have a background in hands-on technical development, with at least 18 months’ of industry experience in a data engineering role or equivalent, and preferably some software industry experience.
- Proficiency in Scala, java, python, or a programming language associated with data engineering. Our primary language is Scala, but don’t worry if that’s not currently your strongest language. We believe that strong engineering principles are universal and transferable.
- As an expert in building and deploying production level data processing batch systems, you’ll share an appreciation of what makes a high quality, operationally stable system and how to streamline all areas of development, release, and operations to achieve this.
- Experience with a variety of modern development tooling (e.g. Git, Gradle, Nexus) and technologies supporting automation and DevOps (e.g. Jenkins, Docker and a little bit of good old Bash scripting). You’ll be familiar with developing within a version-controlled process that regularly makes use of these tools and technologies.
- A strong technical communication ability with demonstrable experience of working in rapidly changing client environments.
- Knowledge of testing libraries of common programming languages (such as ScalaTest or equivalent). Importantly, you’ll know the difference between varying test types (unit test, integration test) and can cite specific examples of what they have written themselves.
Benefits
- **Our perks and quirks.**
- What makes you Q will help you to realize your full potential, flourish and enjoy what you do, while being recognized and rewarded with our broad range of benefits.
- Competitive salary
- Company bonus
- Annual leave, plus national holidays + your birthday off!
- Regularly bench-marked salary rates
- Well-being days
- Volunteer Day off
- Work from Home Equipment
- Free Calm App Subscription #1 app for meditation, relaxation and sleep
- Continuous Training and Development, including access to Udemy Business
- Spend up to 2 months working outside of your country of employment over a rolling 12-month period with our ‘Work from Anywhere’ policy
- Employee Referral Program
- Team Social Budget & Company-wide Socials
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.