Data Engineer II analyzing data across platforms including Disney, ESPN, and ABC. Ensuring data quality to enhance user personalization and drive content creation for millions.
Responsibilities
Partner with development and product leads to capture and understand software specifications and test requirements.
Evaluate software for intended functional capabilities and properties.
Design data quality metrics with accompanying queries and reports to be run on a consistent basis.
Effectively communicate findings with development and product teams to improve the product.
Run tests and generate reports on a consistent basis.
Work in an Agile environment that focuses on collaboration and teamwork
Requirements
3+ years designing and executing queries and reports to ensure data quality and discover anomalies
3+ years experience with Databricks or similar data lake
3+ years experience with Spark, Python, or SQL
Advanced knowledge of debugging code and software development languages
Ability to collate data and compile test reports
Excellent software troubleshooting skills
Excellent communication skills with product and development team to ensure highest test coverage possible.
Expert level experience with various data lakes (preferred)
Experience leading and mentoring colleagues on best practices and technical concepts of building large scale solutions (preferred)
Extensive experience defining data quality metrics (preferred)
Experience with real-time analytics on the level of billions of events per week (preferred)
A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
Data Scientist developing customer - focused data products to improve customer journey at Noibu. Collaborating with teams to analyze feedback data and shape analytics strategies.
Data Engineer at fundcraft ensuring seamless data movement and storage. Focus on data migrations, ETL maintenance, and collaboration with the Product team for insights.
Senior Engineer with expertise in AWS, Microsoft Fabric, and Purview at EXL. Driving architecture, development, and implementation of scalable cloud and data governance solutions.
Senior Engineer with expertise in AWS, Microsoft Fabric, and Purview at EXL. Leading development of scalable cloud and data governance solutions while mentoring engineering teams.
Azure Data Engineer responsible for designing ETL pipelines with Azure Data Factory and Snowflake. Collaborating with teams to ensure data integration and quality.
Databricks Data Engineer developing scalable data pipelines within the insurance domain. Building ETL workflows on Azure and Databricks for analytics and business decision - making.
Data Engineer Intern building and maintaining data pipelines for AI - driven financial insights. Opportunity to work at forefront of technology in a collaborative start - up environment.
Data Architect responsible for designing and maintaining data architecture at Uriage & Apivita. Leading data management efforts to support analytics and ensure high - quality data flows across systems.
Data Engineer at Flip building and maintaining scalable data pipelines for ingestion into BigQuery and collaborating with data analysts to enable insights.