Data Engineer II analyzing data across platforms including Disney, ESPN, and ABC. Ensuring data quality to enhance user personalization and drive content creation for millions.
Responsibilities
Partner with development and product leads to capture and understand software specifications and test requirements.
Evaluate software for intended functional capabilities and properties.
Design data quality metrics with accompanying queries and reports to be run on a consistent basis.
Effectively communicate findings with development and product teams to improve the product.
Run tests and generate reports on a consistent basis.
Work in an Agile environment that focuses on collaboration and teamwork
Requirements
3+ years designing and executing queries and reports to ensure data quality and discover anomalies
3+ years experience with Databricks or similar data lake
3+ years experience with Spark, Python, or SQL
Advanced knowledge of debugging code and software development languages
Ability to collate data and compile test reports
Excellent software troubleshooting skills
Excellent communication skills with product and development team to ensure highest test coverage possible.
Expert level experience with various data lakes (preferred)
Experience leading and mentoring colleagues on best practices and technical concepts of building large scale solutions (preferred)
Extensive experience defining data quality metrics (preferred)
Experience with real-time analytics on the level of billions of events per week (preferred)
A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
Intern Data Engineer at Flutter Studios learning to create applications in the gaming industry. Join a cross - functional team to implement a basic application in an Agile environment.
AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.
Data Engineer developing data solutions for reporting and analytics at Assurant. Implementing and optimizing Data Warehouse solutions in cloud and on - premise environments with Agile methodology.
AI Engineer developing AI - driven analytics for trading at Deloitte. Focusing on scalable data pipelines and collaboration with traders for actionable insights.
Data Engineer involved in delivering scalable enterprise systems and digital transformation platforms for Qualysoft. Collaborate with global teams across various industries and technologies.