Data Engineer transforming data into easily analyzable formats at Sprout Solutions. Designing systems and frameworks to support data science initiatives in the HR tech space.
Responsibilities
Transforming data into a format that can be easily analyzed
Designing and developing Sprout’s data system
Processing and extracting data features
Deploying the data science team’s machine learning models
Supporting software engineers, architects and data scientists on data initiatives
Ensuring optimal data delivery architecture is consistent throughout ongoing projects
Building, optimizing and maintaining conceptual, logical and physical database models
Developing database solutions to store and retrieve information
Assembling datasets that meet functional/non-functional business requirements
Building the infrastructure for optimal ETL from a wide variety of data sources
Monitoring data integrity and adopting appropriate tools
Improving system performance
Optimizing or re-designing data architecture to support Sprout’s next generation of products and data initiatives
Designing, developing, testing and deploying web service APIs
Working with Data Scientists to identify future needs and requirements
Deploying models and algorithms developed by the Data Science team
Requirements
Extensive knowledge on databases (SQL and/or NoSQL) and data engineering best practices
Expertise in SQL and other programming languages(e.g. Python, Java, Scala, shell scripting etc.)
Experience with data modeling (data warehouse, data lake) and designing data storage schemes
Familiarity with data engineering and ETL software tools, hadoop, spark, talend, SSAS, etc. is also helpful
Experience building and optimizing data pipelines, architecture and datasets
Experience in software development
Experience with Azure
A successful history of manipulating, processing and extracting value from large disconnected datasets
Familiarity with data visualization tools (e.g. PowerBI)
Familiarity with agile development as a project management methodology is a plus
Strong problem-solving and analytical skills
Must be self-motivated and comfortable supporting the data needs of multiple teams, systems and products
A good team player and willingness to learn
Strong innate desire and proven track record of continuous self-improvement (in learning, job expansion, extracurricular activities, etc.)
Data Engineer managing and expanding enterprise business intelligence and data platform. Focusing on Tableau development and administration with a strong engineering background.
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.