Design, build, and fine-tune data pipelines to load data into data warehouse from sources like databases, cloud storage, or streaming platforms.
Analyze and refactor existing Python-based file ingestion processes.
Troubleshoot pipeline failure and implement quality checks, retries, and safeguards to prevent pipeline failures.
Reduce manual intervention through automation in data pipelines.
Create detailed runbooks documenting existing and new data platform processes.
Add unit tests to improve reliability and maintainability.
Design modular, reusable Python code via IaC that will be able to deploy AWS resources and build data platform components.
Assist with Data architecture, building and validating data architecture.
Contribute to the design, development, testing, deployment, and support of data pipelines and warehouses in a cloud environment.
Build and maintain data platform with goal of scalability and validation.
Advocate engineering best practices, including the use of design patterns, code review, and automated unit/functional testing.
Collaborate efficiently with product management, technical program management, operations, and other engineering teams.
Requirements
Minimum 3+ years of related experience in Cloud development crafting and implementing solutions using AWS services, with understanding of IAM, S3, ECS, Lambda, SNS
Strong programming skills in Python and other object-oriented languages, including libraries such as pandas, pydantic, and polars
Experience using source control systems (GitLab, GitHub) and CI/CD pipelines
Experience working with IAC, such as Terraform, CloudFormation, AWS CDK
Experience in SQL (Postgres, Snowflake, etc.) and understanding of trade-offs between different data storage systems and architectures
Experience with scripting using BASH, or SHELL
Experience creating orchestration patterns and infrastructure using Apache Airflow, or other orchestration tools (preferred)
Experience using Queuing tech, such as SQS, RabbitMQ, Kafka, Kinesis (preferred)
Experience with data pipeline creation (preferred)
Experience with security protocols or related data (preferred)
Experience with AGILE/Scrum practices (preferred)
Experience building, maintaining and using container technologies, such as Docker, Kubernetes, AWS Fargate (preferred)
Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience
Benefits
A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
Data Analyst joining Ford's team to focus on security technologies and data integration. Responsible for improving data operations across global infrastructure and complex requests.
Digital Product Manager at Ford creating connected vehicle experiences through integrated hardware and software solutions. Collaborating with teams to enhance customer experience through new digital products.
Cybersecurity Engineer implementing Zero Trust Reference Architecture solutions at Mythics. Deploying and maintaining Forescout platform within secure environments.
Security Governance Manager at WEBTOON responsible for IT and Security governance framework. Collaborating with Legal, Product, and Engineering teams in Los Angeles headquarters.
Manager of Cybersecurity leading the company's cybersecurity initiatives at Commonwealth Fusion Systems. Responsible for security policies and team management to protect information assets from cyber threats.
Principal Cloud Operations Developer at AVEVA enhancing Cloud security and leading deployment process improvements. Collaborating with development teams to ensure operational security, stability and scalability.
Responsable cybersécurité gérant la sécurité informatique de l'entreprise. Évaluant la conformité des systèmes d'information et pilotant la feuille de route cybersécurité.
Information Security Officer ensuring legal and cybersecurity compliance across IoT product development at Daikin. Supporting development teams and managing security awareness training.
Security employee monitoring site safety at Newell Brands, ensuring compliance with safety protocols. Supports services in emergency response and monitors site safety continually.
Cybersecurity Intern assisting the Cyber GRC team and Project Manager at HF Sinclair. Gaining hands - on experience in Security Operations and Cyber Risk Management during the summer of 2026.