Associate Data Engineer building and maintaining data systems at Incedo. Transforming raw information into accessible datasets for decision - making and collaborating with analysts and data scientists.
About the role
- Data Engineer developing data products and solutions within Equifax's data analytics team. Building scalable data pipelines and enabling AI capabilities for better insights.
Responsibilities
- Build complex batch and streaming pipelines to ingest data from upstream Equifax cloud systems.
- Design and implement data engineering frameworks to scale the development and deployment of data pipelines across the D&A organization.
- Leverage AI-powered coding assistants to accelerate development, optimize code, and generate documentation for data pipelines and infrastructure.
- Develop and refine prompts for Large Language Models (LLMs) to assist in data-related tasks such as data cleansing, transformation logic generation, and automated data documentation.
- Design, build, and maintain scalable data pipelines that support AI/ML applications.
- Explore and implement AI agents to automate repetitive data management tasks, monitor data quality, and orchestrate complex data workflows.
- Play an active role in setting engineering standards and best practices in EWS D&A.
Requirements
- At least 5 years of experience in data engineering, data architecture, or a related field.
- A strong understanding of data engineering principles and best practices, including data modeling, data warehousing, and data integration.
- At least 1 year of experience working in a GCP big data environment.
- Experience building complex data pipelines and solutions using two or more of the following: BigQuery, DataFlow, DataProc, Pub/Sub, Cloud Functions.
- Experience with Airflow or Cloud Composer.
- Experience with Vertex AI.
- Proficiency in Python development.
- Professional experience with SQL.
- Proven ability to effectively communicate complex technical concepts to both technical and non-technical stakeholders.
- A Bachelor's degree or higher in Computer Science, Information Systems, or a related field.
Benefits
- comprehensive compensation and healthcare packages
- 401k matching
- paid time off
- organizational growth potential through our online learning platform with guided career tracks
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Intern Data Engineer at Flutter Studios learning to create applications in the gaming industry. Join a cross - functional team to implement a basic application in an Agile environment.
AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.
AS
Data Engineer developing data solutions for reporting and analytics at Assurant. Implementing and optimizing Data Warehouse solutions in cloud and on - premise environments with Agile methodology.
AI Engineer developing AI - driven analytics for trading at Deloitte. Focusing on scalable data pipelines and collaboration with traders for actionable insights.
Big Data Engineer developing and optimizing data systems at ESET. Collaborating with cross - functional teams to handle and transform vast datasets.