Big Data Engineer handling both internal and external stakeholders for data processing related to fraud and compliance at ING. Managing and transforming high volume data and working closely with project teams.
About the role
- Senior Data Engineer focusing on Databricks in a market-leading company. Designing data architectures and optimizing data workflows in a collaborative environment.
Responsibilities
- Design our Databricks architecture and optimize jobs and configurations
- Develop scalable data pipelines and orchestrate robust workflows
- Build and automate CI/CD pipelines for data workflows in Databricks
- Create versioned and reliable data pipelines for Agentic AI and GenAI use cases – including automated data preparation in collaboration with Data Scientists
- Develop containerized solutions and collaborate closely with DevOps (Docker, Kubernetes) – including monitoring, self-healing, and infrastructure-as-code
- Align with Data Science and business units to ensure a scalable and stable data supply for our Agentic-AI platform
- Evaluate new technologies, define best practices, and actively contribute to the evolution of our technical standards
Requirements
- Several years of experience in Data Engineering (ideally 3+ years)
- Strong hands-on Databricks experience, including workspace administration, Delta Lake, and performance tuning
- Solid knowledge of AWS services (e.g., S3, Lambda)
- Analytical thinking, strong initiative, and a passion for advancing technology
- Experience with infrastructure-as-code, especially Terraform
- Nice to have: Experience with streaming (Kafka/Kinesis) and an understanding of Agentic-AI architectures and their data requirements
- German language skills are a plus
Benefits
- Flexible working hours with ~80% remote work
- Fitness and wellness offers via Urban Sports Club
- Discounted Allianz products (insurance, pensions, investments)
- Bicycle leasing via JobRad
- Private leasing options for the latest tech devices
- Many employee events (sporting events, afterworks, parties, ...)
- Our in-house kitchen provides a delicious lunch at a fair price
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Big Data Engineer role developing state - of - the - art solutions for financial crime prevention at ING. Collaborating with teams to manage high volume data and deliver effective technical solutions.
Senior Data Architect Lead at Leidos developing enterprise data and analytics solutions for the Department of War. Collaborating with teams to implement data strategies and governance frameworks.
Senior Data Engineer Lead at Leidos, enhancing enterprise data solutions for DoD organizations. Collaborating with teams to deliver scalable data analytics and AI capabilities.
Data Engineer building advanced technology solutions for clients. Organizing and making disparate data meaningful to impact missions in fraud detection, cancer research, and national intelligence.
Staff Data Engineer on Real World Evidence team driving large - scale data initiatives. Collaborating with cross - functional teams to optimize data pipelines and improve healthcare outcomes.
Data Engineer Trainee developing expertise in Python, SQL, and modern cloud technologies. Innovating in a dynamic team environment with a focus on practical application.
AWS Data Engineer designing and maintaining scalable cloud - based data platforms within Banking and Financial Services at EXL. Collaborating across teams to enable data - driven decision - making through cloud technologies.
Senior Data Engineer designing and scaling advanced data platforms for 5G and future 6G innovations at Nokia. Building robust data pipelines while collaborating with Data Scientists and Engineers in a hybrid setting.
Senior Data Engineering Consultant at Gradion transforming data infrastructure for global clients. Modernizing legacy systems and operationalizing AI/ML solutions with cloud and AI consultants.