Data Engineer building and optimising data infrastructure at LifeByte. Collaborating with data scientists and analysts to improve data processing efficiency.
Responsibilities
Design, build, install, test and maintain scalable data management systems, ensuring that the system meets business requirements and industry standards.
Integrate emerging data management and software engineering technologies into existing data structures, ensuring compliance with data management and security policies.
Monitor performance and data accuracy of data processing systems.
Maintains Cl/CD systems and code base.
Establishes and operates to maintain high quality standards and maintains cloud architecture systems across accounts.
Mentor and guide junior data engineers.
Adopt new technologies while leveraging your accumulated expertise in modern big data tools and cloud services.
Requirements
Bachelor's degree or above in Computer Science, Engineering or a related field, English can be used as a working language.
At least 1 years of relevant experience in data engineering with project experience in designing and implementing complex data solutions.
Proficiency in Python and experience in developing robust, maintainable, and scalable data processing pipelines.
Experience with CI/CD systems, automated workflows, and integrating data quality checks into deployment processes.
Strong experience with cloud services (preferably AWS), including the use of AWS data services and knowledge of Snowflake as a data warehouse solution.
Expertise in working with all forms of data infrastructure and adept at managing streaming and batch data systems.
Solid understanding of data modelling, ETL (Extract, Transform, Load) processes and data warehousing principles with a commitment to improving data quality and accuracy.
Benefits
Celebrate your tenure with us! Receive generous milestone anniversary gifts that grow with each year of service.
Join a vibrant workplace culture with fantastic team-building activities, fostering camaraderie and collaboration among colleagues.
Prioritize your well-being! Access our Flexible Spending Account (FSA) for various health and wellness needs.
Welcome your newest family member with a special gift!
Data Architect defining data domains, models, and principles for Intelance's EA function. Collaborating with architects to ensure data lineage and integration.
Senior Data Architect responsible for building data infrastructure at Trexquant, integrating diverse datasets for research and simulation applications. Collaborating with teams to enhance data accessibility and quality.
Data Engineer responsible for developing data solutions and integrating systems for advanced analytics at Lilly. Focusing on data pipelines and solutions ensuring data quality and compliance.
Junior Data Engineer assisting with data - driven use - cases in the payment sector. Contributing to the establishment of a central data platform at S - Payment.
Senior Data Engineer leading tailored data - driven solutions delivery for public sector clients. Involves data transformation projects and building AI - powered tools for decision making.
Technical Lead in Data Engineering at Intentsify, building scalable applications for B2B marketing solutions. Leading a small team and making key technological decisions.
Data Engineer developing scalable data pipelines for RunBuggy's automotive logistics platform. Collaborate with cross - functional teams to unlock powerful insights and optimize data infrastructure.
Working Student in Data Engineering supporting the development of an energy management app's data backbone across Europe. Collaborate with diverse teams to ensure data quality and optimization.
Senior Data Engineer at Minsait responsible for designing and maintaining data infrastructure. Ensuring efficient and secure data collection, storage, and processing across various sectors.
Senior Data Engineer developing and maintaining scalable data pipelines at Quality Digital. Ensuring data quality, security, and compliance with best practices while collaborating with data teams.