Cloud Data Engineer at Regions designing, building, and maintaining data structures and pipelines. Collaborating on data initiatives, ensuring optimal architecture, working closely with technical partners.
About the role
- Data Engineer transforming data into easily analyzable formats at Sprout Solutions. Designing systems and frameworks to support data science initiatives in the HR tech space.
Responsibilities
- Transforming data into a format that can be easily analyzed
- Designing and developing Sprout’s data system
- Processing and extracting data features
- Deploying the data science team’s machine learning models
- Supporting software engineers, architects and data scientists on data initiatives
- Ensuring optimal data delivery architecture is consistent throughout ongoing projects
- Building, optimizing and maintaining conceptual, logical and physical database models
- Developing database solutions to store and retrieve information
- Assembling datasets that meet functional/non-functional business requirements
- Building the infrastructure for optimal ETL from a wide variety of data sources
- Monitoring data integrity and adopting appropriate tools
- Improving system performance
- Optimizing or re-designing data architecture to support Sprout’s next generation of products and data initiatives
- Designing, developing, testing and deploying web service APIs
- Working with Data Scientists to identify future needs and requirements
- Deploying models and algorithms developed by the Data Science team
Requirements
- Extensive knowledge on databases (SQL and/or NoSQL) and data engineering best practices
- Expertise in SQL and other programming languages(e.g. Python, Java, Scala, shell scripting etc.)
- Experience with data modeling (data warehouse, data lake) and designing data storage schemes
- Familiarity with data engineering and ETL software tools, hadoop, spark, talend, SSAS, etc. is also helpful
- Experience building and optimizing data pipelines, architecture and datasets
- Experience in software development
- Experience with Azure
- A successful history of manipulating, processing and extracting value from large disconnected datasets
- Familiarity with data visualization tools (e.g. PowerBI)
- Familiarity with agile development as a project management methodology is a plus
- Strong problem-solving and analytical skills
- Must be self-motivated and comfortable supporting the data needs of multiple teams, systems and products
- A good team player and willingness to learn
- Strong innate desire and proven track record of continuous self-improvement (in learning, job expansion, extracurricular activities, etc.)
Benefits
- Equal Opportunity Employment
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer in Veepee's Data Factory working on data ingestion pipelines and improving data quality. Collaborative environment utilizing Kubernetes, Python, Java, and modern data architectures.
Data Architect designing and maintaining enterprise data architecture at Envalior. Driving enterprise - wide impact ensuring scalability and reliability of systems, reporting, and AI initiatives.
Data Engineer role at Valmont focused on data analytics and technology for sustainable agricultural practices. Collaborating with cross - functional teams to enhance data management and analytics tools.
Senior Data Engineer at Barclays building and maintaining data pipelines and warehouses. Collaborating with data scientists and ensuring data accuracy, accessibility, and security.
Lead Data Engineer guiding a team in designing scalable data solutions for iKnowHow S.A. Overseeing development of data pipelines while collaborating with cross - functional teams.
Data Engineer at LPL Financial developing Python - based ETL pipelines. Collaborating with cross - functional teams to ensure reliable data delivery and optimizing pipeline performance.
Senior Data Engineer at Keyrus focusing on data solutions and projects to drive performance. Collaborating with teams globally to enhance data transformation and governance processes.
Data Engineer developing scalable data pipelines for ETL/ELT processes using GCP services. Collaborating with team members to optimize data workflows and ensure data integrity.
Data Governance Engineer in Fintech developing a formal cyber data governance framework. Collaborating with cyber security, analytics, and platform engineering teams on metadata and lineage capabilities.