Senior Data Engineer leading a team of Data Engineers at Optasia, a fintech company. Responsible for building data infrastructure and delivering scalable data solutions.
Responsibilities
Lead, mentor, and support a team of Data Engineers, fostering collaboration, technical excellence, and professional growth.
Provide technical expertise and direction in data engineering, guiding the team to deliver high quality scalable data analytical pipelines.
Support the testing, selection and deployment of data engineering tools, technologies, and methodologies.
Design, build, and optimize end-to-end batch and streaming data analytical pipelines.
Develop, maintain, and evolve the company’s big data infrastructure and core libraries for large-scale ingestion and processing.
Work closely with Solution Architects, Data Assurance Engineers, ML Engineers, and System Administrators for the design, delivery, and support of end-to-end data workflows.
Drive best practices in code quality, testing, CI/CD, and data governance, ensuring scalability, performance, and compliance with data protection regulations (e.g., GDPR).
Conduct code reviews, align coding standards, and oversee configuration management of the big data infrastructure.
Requirements
Bachelor’s or Master’s degree in Computer Science or Informatics.
3+ years of experience in Data Engineering.
Strong hands-on expertise with the Apache Hadoop ecosystem (HDFS, Hive, Spark, YARN).
Proficiency in Scala, Java, Python, SQL, scripting (Bash/Python).
Experience with relational and NoSQL technologies.
System administration skills in Linux.
Practical experience with deployment, configuration, and maintenance of distributed systems and data/software engineering tools.
Experience with CI/CD orchestration.
Worked extensively in Hadoop / Spark / Spark Streaming / Hive (optional).
Experience with data and ML flow engines and tools, e.g. Apache Airflow, Apache NiFi, Druid (optional).
Hands-on exposure to modern data lake storage and table formats, e.g. Apache Iceberg, Apache Hudi (optional).
Experience in working with secure code development guidelines and coding practices (i.e. OWASP, NIST) (optional).
Benefits
💸 Competitive remuneration package
🏝 Extra day off on your birthday
💰 Performance-based bonus scheme
👩🏽⚕️ Comprehensive private healthcare insurance
💻 All the tech gear you need to work smart
🎌 Be a part of a multicultural working environment
🎯 Meet a very unique and promising business and industry
🌌 Gain insights for tomorrow market’s foreground
🎓 A solid career path within our working family is ready for you
📚 Continuous training and access to online training platforms
🥳 CSR activities and festive events within any possible occasion
🍜 Enjoy comfortable open space restaurant with varied meal options every day
🎾 🧘️ Wellbeing activities access such as free on-site yoga classes, plus available squash court on our premises
Data Engineer joining Contour Software's development team to handle various big data projects. Focus on cloud data lake architecture and machine learning implementation.
Enterprise Architect Sr position at PNC collaborating with technology stakeholders to build enterprise data architecture. Focus on data models, governance, and guiding data decisions for business strategy.
Data Engineer architecting and maintaining data products using Databricks and Power BI for Nitro's digital transformation efforts. Collaborating to optimize processes and leverage cloud technologies.
Lead Data Engineer driving major transformation in enterprise technology at Capital One. Collaborating with Agile teams to develop, test, and implement innovative full - stack solutions.
Senior Data Engineer at Teya, focusing on scalable data product development and architectural design. Join to help build the modern data platform for advanced analytics and AI.
Seeking a Data Engineer with Palantir expertise, focusing on scalable solutions and data workflows. Join EXL, a leader in data analytics and digital operations.
Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.