Data Engineer designing and maintaining data pipelines at Agile Defense. Focused on integrating technologies for vital national security and civilian missions.
About the role
- Senior Data Engineer responsible for Cloud Data Lake design and development in financial services. Collaborate with management and technical teams to execute technology product roadmap.
Responsibilities
- End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution
- Build data integrations, hand-offs between on-prem/cloud-based systems
- Design and develop high volume data ingestion components and solutions to collect data from various sources
- Manage and use appropriate tools in the cloud data lake development and deployment
- Responsible for developing/implementing cloud infrastructure to support current and future business needs
- Participating in technical design, application build, configuration, unit testing, and production deployment
- Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability
Requirements
- 10+ years' experience in professional software design and development
- Bachelor's/Master's Degree in Computer Science, Engineering or Math or equivalent experience
- Development experience in designing, developing and deploying complex applications
- Strong tech skillset/experience in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting
- Hands on experience with Cloud platforms, preferably using Databricks
- Strong knowledge of Cloud Security in AWS/Azure, specifically IAM Roles & Polices, Security Groups and Encryption keys
- Experience in building systems using modern, scalable, resilient, cloud native architectures
- Proficiency with CICD and DevOps
Benefits
- Flexible work-life support
- Paid volunteer days
- Inclusive development opportunities
- Vibrant employee networks
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Architect for the Chief Data Office at State Street driving Global Data Architecture and Management. Collaborating with stakeholders to streamline data processes and enhance data quality.
Senior Data Engineer responsible for reliable data integration and transformation at Evertec. Collaborating with stakeholders and engineering teams using SQL and cloud platforms.
Data Engineer needed to build and maintain cloud data pipelines for a digital transformation consultancy. Collaborate on analytics initiatives and ensure data quality in São Paulo.
Senior Data Engineer at Verity designing and evolving data architectures. Building scalable pipelines and implementing data engineering best practices in cloud environments.
Data Engineer responsible for building and maintaining data solutions on AWS and GCP. Focus on Lakehouse architecture to support analytics, reporting, and AI/ML use cases.
Data Engineer Pleno at Verity focusing on building data pipelines and analytics frameworks. Engage with teams to ensure data quality and enhance cloud - based solutions.
Data Engineer for Verity, a digital transformation consultancy, designing data architectures and building scalable pipelines. Collaborates on data quality and analytical dataset structuring.
Data Engineer at GFT managing data systems and workflows, focusing on data engineering and data science collaboration. Leveraging technologies like Python, Airflow, and AWS.
Senior Data Engineer at Shopmonkey building and maintaining data infrastructure. Driving strategic decisions for tools and processes while ensuring data quality across platforms.