Data Engineer Intern for Cognira involved in deploying and managing data pipelines and architecting file-ingestion API. Opportunity to gain experience in data science and engineering processes.
Responsibilities
Design and implement a modular ETL pipeline on Databricks and enable parameterized, YAML-driven deployments using Databricks Bundles.
Implement Spark performance optimizations and CI/CD to promote pipelines across environments.
Build a programmatic deployment and management layer for Databricks using the Databricks REST API to create/configure clusters, jobs, and notebooks dynamically and securely.
Architect and implement a secure, scalable file-ingestion API that provides validation, auto-renaming, manifest generation, and reliable transfer to cloud storage (with full traceability).
Requirements
Excellent academics in Computer Science, Engineering, or related field.
Problem-solving is your jam, and you're all about critical thinking.
You're not afraid to roll up your sleeves and get stuff done, even if you're independently on your own with minimal supervision.
You can juggle multiple projects like a pro.
Challenges don't scare you; in fact, you love diving into them.
You can communicate like a champ, whether it's writing reports or presenting in a room full of people.
You're curious, and you love picking up new skills & technologies.
You're a team player, always up for sharing your ideas and best practices.
Benefits
Great company culture.
"Learn and Share" sessions.
You'll get support from your mentors.
Social events and after-work.
A flexible and fun work environment.
Casual dress code.
You'll work with a cool team!
We respect your ideas, and we're all about trying new things.
Program Manager leading enterprise - wide data migration efforts for Boeing's transition to modern data platforms. Overseeing complex processes to ensure secure and effective migrations across multiple systems.
Senior Data Engineer responsible for developing data products for Disney's immersive digital experiences. Collaborating with teams to ensure data quality and operational efficiency in a fast - paced environment.
Senior Data Engineer crafting and developing data products for analytical insights at Zendesk. Collaborating in an Agile environment with a focus on data warehousing and process optimization.
Senior Data Engineer designing and building data warehouse solutions with Snowflake for a fintech company. Collaborating with cross - functional teams to facilitate data insights and analytics.
Data Engineer developing and maintaining data pipelines and applications at EvidenceCare. Collaborating across teams to generate actionable insights from healthcare data for better decision - making.
Data Engineer managing and expanding enterprise business intelligence and data platform. Focusing on Tableau development and administration with a strong engineering background.
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.