Snowflake Data Engineer optimizing data pipelines using Snowflake for a global life science company. Collaborate with cross - functional teams for data solutions and performance improvements in Madrid.
About the role
- Sr. Lead Data Engineer implementing data platforms with expertise in Databricks/AWS EMR. Collaborating with cross-functional teams to enhance data-driven initiatives.
Responsibilities
- Lead the design and implementation of distributed data processing workloads using Python, including data access from relational databases and cloud storage technologies.
- Ensure performance, security, and reliability; coordinate with application teams to define database design.
- Collaborate with cross-functional teams to support data-driven initiatives.
- Mentor junior team members and promote best practices.
- Oversee maintenance and troubleshooting of distributed data processing systems.
- Drive innovation by evaluating and integrating new technologies.
- Produce system design documents and participate in technical walkthroughs.
- Perform application and system performance tuning and troubleshoot performance issues.
- Effectively interact with global customers, business users, and IT staff.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent work experience.
- 10+ years of IT experience in application support or development.
- Design & build ingestion pipelines using ETL/ELT and schema-on-read in data lake technologies.
- Experience in designing transactional systems, data warehouses, data lakes, and data integrations within a big data ecosystem, particularly leveraging cloud technologies.
- Provide technical expertise in the design and implementation of data ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and large-scale data analytics tools.
- Strong experience in managing distributed data processing workloads, including configurations.
- Experience in working with multi-threaded, high-performance, low-latency messaging systems.
- Experience in AWS cloud-based technologies.
- Experience using system tools, source control systems, utilities, and third-party products.
- Excellent communication skills, with strong verbal and writing proficiencies.
Benefits
- Health & Wellness: Health care coverage designed for the mind and body.
- Flexible Downtime: Generous time off helps keep you energized for your time on.
- Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
- Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
- Family Friendly Perks: It’s not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
- Beyond the Basics: From retail discounts to referral incentive awards—small perks can make a big difference.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer designing and implementing big data solutions at DATAIS. Collaborating with clients to deliver actionable business insights and innovative data products in a hybrid environment.
SAP Data Engineer supporting MERKUR GROUP in becoming a data - driven company. Responsible for data integration, ETL processes, and collaboration with various departments.
Big Data Engineer designing and managing data applications on Google Cloud. Join Vodafone’s global tech team to optimize data ingestion and processing for machine learning.
Data Engineer building and maintaining data pipelines for Farfetch’s data platform. Collaborating with the Data team to improve data reliability and architecture in Porto.
Senior Data Engineer at Razer leading initiatives in data engineering and AI infrastructure. Collaborating across teams to develop robust data solutions and enhancing AI/ML projects.
Data Engineering Intern working with data as Jua builds AI for climate and geospatial datasets. Contributing to the integration and validation of new datasets with experienced mentors.
Data Engineer supporting a fintech company in building and maintaining data pipelines. Collaborating with tech teams and enhancing data processing in a high - volume environment.
Staff Engineer developing innovative data solutions for dentsu's B2B marketing vision. Collaborating using cutting - edge cloud technologies and mentoring engineers in their careers.
Senior Data Engineer developing and optimizing data pipelines for Scene+’s cloud - native platform in Toronto. Collaborating across teams to enhance data governance and analytics capabilities.