Data Engineer developing scalable data solutions using Databricks, Spark, and Azure at a transformation technology company. Integrating and collaborating for intelligent solutions with large volumes of data.
Responsibilities
Design, develop, and maintain scalable, robust data pipelines.
Build data ingestion, transformation, and modeling solutions using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory (ADF).
Ensure data quality, integrity, and usability across the entire pipeline.
Design and maintain Data Lake and Data Warehouse solutions, applying data governance best practices.
Work with concepts and frameworks such as Bronze, Silver, and Gold layers, Star Schema, Delta Tables, Delta Sharing, and analytical tables.
Collaborate with technical and business teams to orchestrate solutions aligned with company objectives.
Requirements
Strong experience as a Data Engineer or in a similar role.
Consulting Engineering Sales Lead driving consulting engineering sales and team leadership for DXC in Mexico. Positioning solutions effectively across industries with strategic sales leadership.
CRM Developer for USO designing and maintaining Salesforce solutions for fundraising and program delivery. Collaborating cross - functionally to enhance digital engagement.
Guidewire Developer working with PolicyCenter and BillingCenter for enhancement and issue prevention. Involves development, testing support, and presentations to the team and stakeholders.
Director of Embedded Software Development & Delivery at Cochlear driving next - generation software platforms. Leading engineering teams across Europe while ensuring regulatory compliance in medical devices.
Senior Architect overseeing DevSecOps Platform Transformation at Travelers. Building relationships across engineering teams and advocating for technical direction with a focus on AI - powered solutions.
Senior Engineer providing technical support for Carolinas Dispatchable Generation Stations within Duke Energy. Responsibilities include project implementation, controls support, and technical resource management in engineering specialization.
Senior Associate Developer responsible for designing and developing integration solutions for State Street's high - volume middleware platform. Collaborating within a diverse team to enhance enterprise integration capabilities.
Software Development Analyst at Northrop Grumman supporting Product Lifecycle Management systems. Collaborating across functional teams while providing user support in a technology - driven environment.
Engineering Technician IV providing professional technical support to engineers in research and development. Involves hands - on tasks with electrical, electronic, and mechanical components.
Deep Learning Algorithm Developer developing perception technologies for autonomous driving in real - world environments. Tackling challenges from object detection to 3D perception using state - of - the - art deep learning models.