Lead Azure Databricks Data Engineer implementing data solutions for data engineering projects at Ryan Specialty. Collaborating with stakeholders and mentoring junior staff on data pipelines and ETL processes.
About the role
- Senior Data Engineer working with the Power team on a product for the European power market. Enhancing data pipelines and collaborating with cross-functional teams for informed decision-making.
Responsibilities
- Be instrumental in the enhancement of multiple pipelines in place to retrieve data from external providers.
- Collaborate with the Staff Engineer in designing robust architecture, to build a responsive product, able to retrieve and deliver real time data.
- Participate in expanding the coverage of the data retrieved to new markets or geographies.
- Enrich the product and participate in the development of new features.
- Build and improve monitoring and alerting tools and dashboards.
- Ensure good performance of our API which distributes the data to end users.
- Work together with Data Scientists and market experts with strong experience in this domain.
- Help build the Roadmap, in collaboration with the Product team.
- Provide support and technical guidance to less experienced Engineers within the team.
Requirements
- BSc/MSc in computer science, computer engineering or equivalent.
- Circa 6+ years' of experience as a data focused Software Engineer.
- Significant experience working with Python (FastAPI is a plus).
- Working experience with Postgresql or similar data stores.
- Proficiency in building and consuming RESTful APIs.
- Experienced working with Git, code reviews, and Agile methodologies.
- Deep understanding of performance optimization and caching strategies.
- Great communication, ability to work asynchronously with team members in other countries.
- Experience with AWS (or another cloud provider), using Terraform.
- Experience with containerization (Docker) and orchestration (Kubernetes).
- Strong command of written and spoken English.
Benefits
- We act decisively and with purpose, going the extra mile.
- We foster relationships and develop creative solutions to address market challenges.
- We are accessible and supportive to colleagues and clients with a friendly approach.
- Fair, inclusive and diverse work-environment.
- Different perspectives lead to better ideas and innovation.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Lead Azure Databricks Data Engineer at Ryan Specialty focused on implementing data solutions and collaborating with cross - functional teams to enhance data architecture.
Senior Data Engineer designing and implementing sustainable data solutions for diverse clients. Collaborating closely with stakeholders to enhance data services and platforms in a hybrid environment.
Risk Data Engineer and Architect at Lincoln Financial supporting risk analytics through AWS data solutions. Building scalable data pipelines and collaborating with cross - functional teams.
Staff Data Engineer at Qualifinds building AI - driven valuation tools and leading data ingestion development for art and collectibles management.
Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.
Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.
Senior Data Engineer at Yü Group responsible for leading data engineering team and optimizing data solutions within the energy sector.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.