Data Platform Engineer improving Smartbroker's cloud-based data platform. Responsible for developing data pipelines and collaborating with data engineers and analysts in a fintech environment.
Responsibilities
Develop and improve our cloud based data platform for data analytic and business insights using most innovative data technologies
Build end-to-end data pipelines from raw data ingestion to consumable data: prepare and clean structured and unstructured data and develop high-quality data models for advanced analytics and AI use cases
Implement data quality monitoring to ensure accuracy and reliability of data pipelines
Architect, code, and deploy data infrastructure components
Collaborate closely with highly ambitious data engineers and analysts in our growing Data, AI & MarTech Department as well as product technology colleagues
Stay up to date with latest market developments in data cloud architecture and share your knowledge
Requirements
University degree in computer science, mathematics, natural sciences, or a similar field
Several years of experience in data engineering and strong know-how in building data-native, robust, scalable, and maintainable data platforms
Significant hands-on experience designing and operating data pipelines on cloud based data platforms (AWS, GCP) using data-native services (S3, Athena, BigQuery …)
Experience in data warehousing and containerization, e.g., Kubernetes, Docker…
Advanced knowledge about cloud networking & security (IAM, security groups…)
Proficient and experienced with Infrastructure as Code
Deep understanding of software engineering best practices: requirements specification, version control, CI/CD, testing, deployment, and monitoring of data pipelines and services
Excellent SQL skills and strong programming skills in Python, ideally including Airflow and PySpark
Strong knowledge in data streaming technologies like Kafka, Kinesis, Flink…
Excellent English communication skills, German is a plus
Interest in finance and fintech industry and a sense of humor.
Tulip Platform Developer supporting MES development and implementation for Qualysoft's IT solutions in various sectors. Motivated to enhance manufacturing processes and systems.
Technical Lead driving the development of generative AI SaaS platform at Qualified Health. Shaping the architecture and leading engineering efforts for impactful healthcare solutions.
Platform Engineer developing core services for healthcare AI SaaS platform. Collaborating with early engineering team and ensuring platform success for generative AI applications.
Nagios Platform Engineer responsible for Monitoring solutions across Schwarz group. Collaborating with international teams to enhance automation and troubleshoot technical issues.
Hands - on Data Platform Engineer managing NexusOne products using cloud and on - premise technologies. Collaborate with data engineers and architects to design scalable data solutions.
Copilot + Power Platform Engineer utilizing advanced digital solutions for clients. Collaborating with functional areas and developing automated workflows while working remotely.
AWS Platform Engineer designing and building secure cloud platforms on AWS for IT Services company. Leading cloud architecture strategy and mentoring engineering teams.
Director of AI Agents & Platform Engineering leading strategy for enterprise AI platforms at Signature Aviation. Building high - performing teams and scalable AI solutions for operational efficiency.