Senior Google Data Architect designing and delivering scalable data solutions on Google Cloud Platform. Collaborating across teams to shape target - state data architectures and influence enterprise data strategy.
About the role
- Lead Azure Databricks Data Engineer implementing data solutions for data engineering projects at Ryan Specialty. Collaborating with stakeholders and mentoring junior staff on data pipelines and ETL processes.
Responsibilities
- Provide technical leadership in data architecture and engineering, collaborating with solution stakeholders to align data solutions with business objectives
- Mentor less experienced data engineers and team members, fostering a collaborative and innovative work environment
- Explore and implement new technologies and practices in data engineering to continually improve our data processes and infrastructure
- Manage and enhance complex SSIS packages for data integration and ETL processes, along with SSRS reports for business intelligence
- Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory, implementing both batch and real-time data integration processes
- Develop and optimize Databricks notebooks for big data processing and analytics in Azure Databricks environments
- Implement and manage data storage solutions using Delta Parquet files in Azure Data Lake Storage, optimizing for query performance and cost-efficiency
- Integrate and configure Profisee Master Data Management tools within Azure, focusing on data governance and quality
- Set up and manage Change Data Capture processes for real-time data synchronization in Azure data platforms
- Implement data cataloging, classification, and lineage using Azure Purview, developing data governance policies, and ensuring compliance
- Enhance and support Tableau reporting solutions, developing complex dashboards, and integrating with Azure data services
- Drive automation and process optimization using Azure services and scripting and implement CI/CD pipelines using Azure DevOps
- Lead SQL Server database optimization and performance tuning efforts
- Lead, Coach and Mentor junior staff on projects
Requirements
- Bachelor’s degree required, Master’s degree preferred; Computer science, Information Technology or Engineering is preferred
- 10+ years of experience in Data Engineering with a Bachelor’s degree, or 8 years of experience with a Master’s degree is preferred
- 6+ years of experience with Databricks
- Subject Matter Expert in SQL Server Management, Azure Data Factory Development, Databricks Engineering, Delta Parquet File Management, and SQL Server Integration Services
- Proficiency in Profisee MDM Integration, Change Data Capture implementation, and data quality and governance with Azure Purview
- Proven experience in Tableau and BI Reporting, and strong skills in Automation and Process
Benefits
- Paid time off for company holidays, vacation, sick and personal days
- Paid parental leave
- Mental health services
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Sr. ETL/Data Warehouse Lead at Huntington designing, developing, and supporting ETL and Data Warehousing framework. Analyzing systems based on specifications and providing technical assistance.
Data Engineer developing scalable data lake solutions and optimizing data pipelines at U.S. Bank. Collaborating with teams to manage data governance and cloud migration activities.
Lead AI, MLOps & Data Engineer at WedR, guiding complex data projects and AI innovation. Collaborate with diverse experts in a Product Studio for digital transformations.
Lead Azure Databricks Data Engineer at Ryan Specialty focused on implementing data solutions and collaborating with cross - functional teams to enhance data architecture.
Senior Data Engineer designing and implementing sustainable data solutions for diverse clients. Collaborating closely with stakeholders to enhance data services and platforms in a hybrid environment.
Risk Data Engineer and Architect at Lincoln Financial supporting risk analytics through AWS data solutions. Building scalable data pipelines and collaborating with cross - functional teams.
Staff Data Engineer at Qualifinds building AI - driven valuation tools and leading data ingestion development for art and collectibles management.
Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.
Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.