Hybrid Manager – AI Analysis and Evaluation

at Red Hat

• Job title: Manager – AI Analysis and Evaluation
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: $148,540 - $245,050 per year
• Degree requirement: Bachelor's Degree
• Tech skills: Tableau
• Location requirements: Hybrid, Raleigh, United States

About the role

• Manager of Analysis and Evaluation leading a team of data scientists and AI engineers at Red Hat. Optimizing performance across the portfolio and guiding technical strategy with executive leadership.

Responsibilities

• Lead and grow a technical sub-group focused on data science, data analysis, and AI evaluation functions
• Mature and accelerate the AI evaluations function, expanding its reach across the full portfolio of experiences we deliver
• Establish and report on key metrics that demonstrate the tangible impact and accuracy of our AI initiatives to executive leadership
• Advise stakeholders on impact measurements and provide clear visibility through data products like Tableau dashboards
• Advise development teams on AI evaluation responsibilities, best practices, and provide assistance
• Collaborate with platform managers to ensure our foundational infrastructure supports advanced analytics and innovative AI performance goals
• Remove roadblocks for your team by managing high-level strategy and fostering a culture of innovation and optimization

Requirements

• 5+ years of experience managing agile technical teams creating measurable impact against outcomes
• Experience managing data science and analytics functions
• Proficiency in the concepts and vocabulary of data science, AI engineering, and data analysis
• Professional experience establishing and maturing new technical functions or teams
• Excellent communication skills, with the ability to translate complex data insights for both technical teams and executive audiences
• Solid understanding of data visualization tools like Tableau
• Background in reviewing code or data models is a plus, though not required for daily tasks
• Experience with AI/ML frameworks or AI evaluations is a plus.

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!