Associate Data Engineer building and maintaining data systems at Incedo. Transforming raw information into accessible datasets for decision - making and collaborating with analysts and data scientists.
About the role
- Data Engineer 3 optimizing Market Place processes for Walmart Global Tech's Chennai team. Developing data pipelines and ensuring efficient utilization of Market Place systems.
Responsibilities
- Develop and implement best-in-class Data pipeline and Data lake, Consumption/Acceleration layers to ensure best capacity utilization and meet SLAs
- Demonstrate and transform business requirements to code, specific analytical reports and tools
- Design, build, test and deploy cutting edge solutions at scale, impacting multi-billion-dollar business
- Work closely with product owner and technical lead and play a major role in the overall delivery of the assigned project/enhancements
- Learn & Research on the go and work on both new requests/projects as well as support production
- Provide business insights while leveraging internal tools and systems, databases and industry data
Requirements
- Bachelor’s degree in computer science or related discipline with 3+ years’ experience
- Minimum 2 years of experience in Big Data and distributed computing
- Proven experience building pipelines on Big Data Technologies/Stack – Hadoop, Spark, Hive, dataproc, BigQuery, Kafka and Airflow Scheduler
- Deep understanding of the Hadoop ecosystem and strong conceptual knowledge in Hadoop architecture components
- Experience working on at least one Big Data technology with Java, Python or Scala
- Strong knowledge of deploying and managing applications in AWS or Azure or GCP
- Strong scripting skills to process large amounts of data and highly proficient in SQL
Benefits
- Incentive awards for performance
- Maternity and parental leave
- Paid time off
- Health benefits
- Other best-in-class benefits
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Intern Data Engineer at Flutter Studios learning to create applications in the gaming industry. Join a cross - functional team to implement a basic application in an Agile environment.
AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.
AS
Data Engineer developing data solutions for reporting and analytics at Assurant. Implementing and optimizing Data Warehouse solutions in cloud and on - premise environments with Agile methodology.
AI Engineer developing AI - driven analytics for trading at Deloitte. Focusing on scalable data pipelines and collaboration with traders for actionable insights.
Big Data Engineer developing and optimizing data systems at ESET. Collaborating with cross - functional teams to handle and transform vast datasets.