Associate Data Engineer building and maintaining data systems at Incedo. Transforming raw information into accessible datasets for decision - making and collaborating with analysts and data scientists.
About the role
- Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.
Responsibilities
- Develop an innovative data landscape for driving the business with analytics solutions up to real-time with state-of-the- art Data, AI & Analytics technologies on AWS and RDBMS.
- Develop and implement AI large language models(LLMs) using concepts like deep learning techniques, natural language processing, computer vision, machine learning etc.
- Analyze and preprocess large datasets to ensure high-quality input for LLM models thereby optimizing the AI solution for performance and scalability.
- Design & Build pipelines with Continuous Delivery practices, to collect, normalize, index, integrate and publish data coming from multiple sources to our AWS-based data platform and in-memory data warehouse Exasol / Oracle.
- Orchestrate our cloud (AWS) resources, automatic scheduling (Airflow), pipelining (Spark, DBT), monitoring and performance reporting.
- Build data platform tooling and capabilities that enable data analysts, scientists and engineers build and operate analytic workloads through self-service.
- Stay up-to-date with the latest advancements in AI and machine learning technologies.
Requirements
- Understanding what it takes to design, build and maintain successful Data/AI platforms, services and products.
- Hands-on experience in data extraction and integration along with environment & deployment automation.
- Experience in cloud engineering services using private and public cloud resources.
- Expertise in hosting large language models in AWS and training with data for answering business related questions.
- Expertise in Data Warehousing, ETL, Analytics, and reporting.
- Skill preferred SQL, Python, AWS, Spark, Microstrategy, Oracle/Exasol and Superset.
- Excellent communication skills to collaborate with business stakeholders, technical engineers and management.
- Fluency in English is a must.
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Remote work options
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Intern Data Engineer at Flutter Studios learning to create applications in the gaming industry. Join a cross - functional team to implement a basic application in an Agile environment.
AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
AS
Data Engineer developing data solutions for reporting and analytics at Assurant. Implementing and optimizing Data Warehouse solutions in cloud and on - premise environments with Agile methodology.
AI Engineer developing AI - driven analytics for trading at Deloitte. Focusing on scalable data pipelines and collaboration with traders for actionable insights.
Big Data Engineer developing and optimizing data systems at ESET. Collaborating with cross - functional teams to handle and transform vast datasets.
Data Engineer involved in delivering scalable enterprise systems and digital transformation platforms for Qualysoft. Collaborate with global teams across various industries and technologies.