IN
Data Engineer creating data pipelines for Santander's card transactions. Collaborating with an agile team in strategic projects involving Databricks and PySpark.
About the role
- Design, implement, and maintain the organization’s data infrastructure, ensuring it meets business requirements and technical standards.
- Deploy data pipelines to AWS infrastructure such as EKS, ECS, Lambdas and AWS Glue.
- Develop and deploy data pipelines to clean and transform data to support other engineering teams, analytics and AI applications.
- Extract and deploy reusable features to Feature stores such as Feast or equivalent.
- Evaluate and select appropriate database technologies, tools, and platforms, both on-premises and in the cloud.
- Monitor data systems and troubleshoot issues related to data quality, performance, and integrity.
- Work closely with Product, Engineering, and Analytics teams to understand and cater to their data needs.
- Define and document data workflows, pipelines, and transformation processes for clear understanding and knowledge sharing.
- Ensure student data privacy and security, and adhere to PII compliance best practices.
Requirements
- 3+ years of experience as a data engineer, and 8+ years of software engineering experience (including data engineering)
- Proven experience as a Data Engineer or in a similar role with strong data modeling, architecture, and design skills.
- Strong understanding of data engineering principles including infrastructure deployment, governance and security.
- Experience with MySQL, Snowflake, Cassandra and familiarity with Graph databases (Neptune or Neo4J)
- Proficiency in SQL, Python, (Golang)
- Proficient with AWS offerings such as AWS Glue, EKS, ECS and Lambda
- Excellent communication skills and ability to articulate complex technical concepts to non-technical stakeholders
- Strong understanding of PII compliance and best practices in data handling and storage
- Strong problem-solving skills, with a knack for optimizing performance and ensuring data integrity and accuracy.
Benefits
- Competitive salary
- Meaningful equity
- Health insurance benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance
- One Medical membership (in participating locations)
- Flexible vacation time policy (subject to internal approval). Average use 4 weeks off per year.
- 10 paid sick days per year (pro rated depending on start date)
- Paid holidays
- Paid bereavement leave
- Paid family leave after birth/adoption. Minimum of 16 paid weeks for birthing parents, 10 weeks for caretaker parents. Meant to supplement benefits offered by State.
- Commuter and FSA plans
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
SA
Sabiá AdministraçãoSenior Data Engineer
Data Engineer designing, implementing, and maintaining data pipelines at Sabiá Gaming. Focused on high - quality data access and integration for enhanced decision - making.
MA
MassMutualQuantitative Data Engineer
Quantitative Data Engineer developing data solutions and automations for MassMutual's investment management. Working with data orchestration tools within a collaborative team environment.
Senior Data Engineer designing and scaling data infrastructure for analytics, machine learning, and business intelligence in a software supply chain security company.
NI
NinjaTraderSenior Data Engineer
Data Engineer developing architecture and pipelines for data analytics at NinjaTrader. Empowering analysts and improving business workflows through data - driven solutions.
SP
SpecsaversData Engineer
Data Engineer designing and developing data solutions at Specsavers. Collaborating on data pipelines and migrations with analysts and stakeholders.
AL
AlterricData Engineer
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
KY
KyndrylELK Data Engineer
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
TC
The Clorox CompanySenior Data Engineer
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
FT
FCamara Consulting & TrainingData Engineer – AWS Stack
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.