Data Engineer developing sustainable data assets for machine learning and analytics solutions. Collaborating with teams and using modern technologies in a hybrid work setting.
Responsibilities
Participate in developing high quality, scalable software modules for next generation analytics solution suite
Engage in activities with cross-functional IT unit stakeholders (e.g., database, operations, telecommunications, technical support, etc.)
Formulates logical statements of business problems and devises, tests and implements efficient, cost-effective application program solutions
Identify and validate internal and external data sources for availability and quality
Work with SMEs to describe and understand data lineage and suitability for a use case
Create data assets and build data pipelines that align to modern software development principles for further analytical consumption
Perform data analysis to ensure quality of data assets
Perform preliminary exploratory analysis to evaluate nulls, duplicates and other issues with data sources
Assist in developing code that enables real-time solutions to be ingested into front-end systems and platforms
Produce code artifacts and documentation using GitHub for reproducible results and hand-off to other data science teams.
Requirements
2+ years of relevant experience recommended
Bachelor’s degree in Computer Science, Engineering, IT, Management Information Systems, or a related discipline
Experience in Python and SQL
Experience in ingesting data from a variety of structures including relational databases, Hadoop/Spark, cloud data sources, XML, JSON
Experience in ETL concerning metadata management and data validation
Experience in Unix and Git
Experience in Automation tools (Autosys, Cron, Airflow, etc.)
Exposure to AWS or GCP services a plus
Experience with Cloud data warehouses, automation, and data pipelines (i.e. Snowflake, Redshift) a plus
Experience with ELT tools (i.e. DBT, Talend) a plus
Able to communicate effectively with both technical and non-technical teams
Able to translate complex technical topics into business solutions and strategies
Candidate must be authorized to work in the US without company sponsorship.
Benefits
Other rewards may include short-term or annual bonuses
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.
Data Engineer shaping modern data architecture to drive golf’s digital transformation. Collaborating with teams to enhance data pipelines and insights for customer engagement and revenue growth.
Staff Data Engineer overseeing complex data systems for CITY Furniture. Responsible for architecting and optimizing data ecosystems in a hybrid work environment.