Lead Azure Databricks Data Engineer implementing data solutions for data engineering projects at Ryan Specialty. Collaborating with stakeholders and mentoring junior staff on data pipelines and ETL processes.
About the role
- Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next-generation data tools.
Responsibilities
- Develop and maintain Allegiant data marts and data warehouses.
- Migrate Allegiant’s existing on-premise infrastructure to the AWS environment.
- Design, implement, and maintain scalable ETL processes to ensure efficient data flow and accessibility.
- Implement data quality checks to ensure accuracy and reliability of data.
- Troubleshoot and resolve issues related to data processing and ETL pipelines.
- Design, build, and implement data transformation, conversion, and validation of data required for BI applications.
- Maintain SQL Server and Redshift data marts, databases, and data warehouses.
- Provide services to replicate data from various data sources to reporting database servers for enterprise reporting applications.
- Work closely with the business to understand and translate user requirements into practical data models.
- Develop and maintain repeatable, systemic processes while finding ways to make internal team processes more efficient.
- Other duties as assigned.
Requirements
- Bachelor’s Degree In Computer Science, Engineering, or a related technical field.
- Minimum three (3) years of experience as a Data Engineer including work experience in data mart development and data warehousing, including experience working with ETL processes, OLAP structures, and dimensional modeling.
- Strong SQL Server and Amazon Redshift skills.
- In depth understanding of database architecture.
- Demonstrated basic proficiency in AWS services, including but not limited to S3, Glue, Lambda, and Redshift.
- Basic understanding of Infrastructure as Code (IAC) principles to define and manage infrastructure using code (e.g., AWS CloudFormation, Terraform).
Benefits
- Profit Sharing
- Medical/Dental/Vision/Life/ Disability Insurance
- Medical Travel Reimbursement
- Legal, Identity and Pet Insurance
- 401K with an employer match
- Employee Stock Purchase Plan
- Employee Assistance Program
- Tuition Reimbursement
- Flight Benefits
- Paid vacation, holidays, and sick time
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Lead Azure Databricks Data Engineer at Ryan Specialty focused on implementing data solutions and collaborating with cross - functional teams to enhance data architecture.
Senior Data Engineer designing and implementing sustainable data solutions for diverse clients. Collaborating closely with stakeholders to enhance data services and platforms in a hybrid environment.
Risk Data Engineer and Architect at Lincoln Financial supporting risk analytics through AWS data solutions. Building scalable data pipelines and collaborating with cross - functional teams.
Staff Data Engineer at Qualifinds building AI - driven valuation tools and leading data ingestion development for art and collectibles management.
Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.
Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.
Senior Data Engineer at Yü Group responsible for leading data engineering team and optimizing data solutions within the energy sector.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.