Data Engineer role focusing on integrating SAP data sources and maintaining data platforms using Microsoft Fabric. Collaborating with teams to build scalable data solutions and ensure data quality.
About the role
- Data Engineer developing sustainable data assets for machine learning and analytics solutions. Collaborating with teams and using modern technologies in a hybrid work setting.
Responsibilities
- Participate in developing high quality, scalable software modules for next generation analytics solution suite
- Engage in activities with cross-functional IT unit stakeholders (e.g., database, operations, telecommunications, technical support, etc.)
- Formulates logical statements of business problems and devises, tests and implements efficient, cost-effective application program solutions
- Identify and validate internal and external data sources for availability and quality
- Work with SMEs to describe and understand data lineage and suitability for a use case
- Create data assets and build data pipelines that align to modern software development principles for further analytical consumption
- Perform data analysis to ensure quality of data assets
- Perform preliminary exploratory analysis to evaluate nulls, duplicates and other issues with data sources
- Assist in developing code that enables real-time solutions to be ingested into front-end systems and platforms
- Produce code artifacts and documentation using GitHub for reproducible results and hand-off to other data science teams.
Requirements
- 2+ years of relevant experience recommended
- Bachelor’s degree in Computer Science, Engineering, IT, Management Information Systems, or a related discipline
- Experience in Python and SQL
- Experience in ingesting data from a variety of structures including relational databases, Hadoop/Spark, cloud data sources, XML, JSON
- Experience in ETL concerning metadata management and data validation
- Experience in Unix and Git
- Experience in Automation tools (Autosys, Cron, Airflow, etc.)
- Exposure to AWS or GCP services a plus
- Experience with Cloud data warehouses, automation, and data pipelines (i.e. Snowflake, Redshift) a plus
- Experience with ELT tools (i.e. DBT, Talend) a plus
- Able to communicate effectively with both technical and non-technical teams
- Able to translate complex technical topics into business solutions and strategies
- Candidate must be authorized to work in the US without company sponsorship.
Benefits
- Other rewards may include short-term or annual bonuses
- long-term incentives
- on-the-spot recognition
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer Developer focused on data collection and analysis at Dev4Side Software. Collaborating on diverse projects with Italian and European partners.
Senior Manager Data Engineering spearheading cloud - native solutions and operational excellence at Reckitt. Championing data engineering practices and mentoring teams to drive impactful business outcomes.
Senior Data Engineer delivering creative solutions for market - leading clients in life sciences and retail. Supporting teams with data initiatives and mentoring engineering teams for project success.
Early career technologist working on high impact projects at Fidelity Investments. Collaborating with experts to develop automation solutions using modern technologies.
Data Engineer at Octopus Energy improving data systems and applications for the Energy Markets team. Responsible for critical data applications, databases, and pipeline solutions.
Data Engineer supporting ingestion of mission - critical data into big data environment at IAMUS Consulting. Leading department with extensive experience in software and data engineering.
Data Engineer developing data solutions for Travelers' analytics landscape. Building pipelines and supporting AI and business intelligence initiatives.
Data Scientist III leveraging sophisticated analytics and data science solutions for business improvement at Truist. Leading projects and providing actionable insights in a collaborative environment.
Senior Manager leading Data Strategy and DataOps for cybersecurity at Wells Fargo. Building modern cyber data platforms and driving analytics enablement with high - quality security insights.