Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
About the role
- Data Engineer responsible for designing and developing data solutions for a major corporation in the food distribution industry. Collaborate in a dynamic team environment and implement scalable data applications.
Responsibilities
- Designing and developing data solutions for one of the world’s largest corporations involved in the marketing and distribution of food products
- Implementing distributed and highly available data processing applications that scale for enterprise demands
- Adhering to Continuous Integration and Continuous Delivery (CI/CD) of solutions
- Ensuring high code quality by following software engineering best practices
- Working collaboratively in a cross-functional team within an Agile delivery environment
- Adhering to DevOps principles and being involved in projects throughout their full software lifecycle — from development, QA, and deployment to post-production support
Requirements
- A Bachelor’s Degree in Computer Science or equivalent
- 5 years of experience in developing enterprise-grade data processing applications
- A strong programming background in data operations (Python, Shell, SQL)
- Experience in processing large volumes of data
- Hands-on experience working with relational/ NoSQL databases and distributed storage engines (HDFS, S3, Redshift)
- Hands-on experience in ETL design and development using ETL tools (preferably Informatica and cloud tools such as AWS Data Pipelines, Glue, Lambda, EMR, Spark, Hive, and data engineering tools/services on Google Cloud Platform)
- Experience in working with streaming data (using tools such as Kinesis, Kafka, Storm, Spark) will be an added advantage
- Experience in API development and user interfaces and related tools (NodeJS, AngularJS, HTML) will be an added advantage
- Experience working in a Scrum Agile delivery environment and DevOps practices
- Experience in code management and CI/CD tools such as GitHub, GitLab, and Jenkins
- Experience in an agile environment and aligning pod members on technical visions and implementation paths
- A strong desire to continue to grow your skillset
- Strong communication skills that are influential and convincing
Benefits
- Competitive compensation
- Recognition & appreciation
- Training & certifications funded
- International exposure
- Open work culture
- Recreational activities & events
- Medical claims & insurance
- Bonus entitlement
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.
IT Data Engineering Co‑Op at BlueRock Therapeutics supports development of scientific data systems. Collaboration on data workflows and foundational AWS data engineering tasks.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.
Data Engineer shaping modern data architecture to drive golf’s digital transformation. Collaborating with teams to enhance data pipelines and insights for customer engagement and revenue growth.
Staff Data Engineer overseeing complex data systems for CITY Furniture. Responsible for architecting and optimizing data ecosystems in a hybrid work environment.
Data Engineer strengthening data platform team at Samba TV to improve data analytics and reporting capabilities. Building on AWS, Databricks, BigQuery, and Snowflake technology.