AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
About the role
- Data Engineer joining a global FinTech business to support next-generation data engineering capabilities. Focused on designing and delivering robust, scalable data solutions in a hybrid team.
Responsibilities
- Design, develop and maintain scalable data pipelines for ingestion, transformation and storage
- Write efficient SQL queries to support data extraction, manipulation and analysis
- Use Apache Spark and Python to process large datasets and automate workflows
- Partner with data scientists, engineers and business stakeholders to translate requirements into data solutions
- Implement data quality checks and validation to ensure accuracy and reliability
- Analyse complex datasets to identify trends, patterns and anomalies
- Produce and maintain clear documentation covering data processes and architecture
- Support stakeholders with data visualisation and interpretation of outputs
Requirements
- Strong experience in SQL for data manipulation and analysis
- Hands-on experience with Apache Spark (Java, SQL or PySpark) and Python
- Experience working with large, complex datasets in enterprise environments
- Exposure to cloud data platforms (AWS, Azure or GCP) and big data technologies
- Confident communicator, comfortable working across technical and non-technical teams
- Background or exposure to financial services or capital markets
- **Nice to have**
- Experience using Java in data processing or integration contexts
- Knowledge of ETL processes and data warehousing concepts
- Experience with data visualisation tools (Power BI, Tableau, Qlik)
- Familiarity with data science notebooks (e.g. Jupyter, Zeppelin)
- Version control experience (Git, GitHub, Bitbucket, Azure DevOps)
Benefits
- Initial 6-month contract, with strong possibility of extension and/or permanency.
- Salary to be discussed.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.
AS
Data Engineer developing data solutions for reporting and analytics at Assurant. Implementing and optimizing Data Warehouse solutions in cloud and on - premise environments with Agile methodology.
AI Engineer developing AI - driven analytics for trading at Deloitte. Focusing on scalable data pipelines and collaboration with traders for actionable insights.
Big Data Engineer developing and optimizing data systems at ESET. Collaborating with cross - functional teams to handle and transform vast datasets.
Data Engineer involved in delivering scalable enterprise systems and digital transformation platforms for Qualysoft. Collaborate with global teams across various industries and technologies.
Program Manager leading development of AI - driven data platform to enhance revenue intelligence across global business functions. Collaborating across teams and regions in a hybrid work environment.