Researcher at nonprofit METR focusing on understanding AI capabilities and risks. Engaging in various projects related to AI assessment amid a collaborative research culture.
Responsibilities
We're seeking a researcher to help us better understand AI capabilities.
Previous work in this vein includes agent time horizons, a commonly-used metric for measuring AI progress, and RCTs on open-source developer productivity.
Lead a project investigating transcripts as a source of evidence about agent capabilities.
Improve METR's time-horizon metric to make it more externally valid, more interpretable, and more predictive on threat-model relevant capabilities.
Design and build experiments testing agent capabilities in the wild.
Lead large-scale human-subjects experiments measuring the impacts of AI agents on economically-valuable R&D.
Requirements
You can write code. At the very least, you should be able to quickly write a write a data analysis script in Python to answer an important question. Bonus points if you can write a clean PR too.
You're excited to get your hands dirty. METR researchers often interact with LLMs in a wide variety of scenarios, read lots of agent transcripts, and closely review human outputs (e.g. video recordings of developers in our productivity RCT).
You are undaunted by open-ended mandates. You can take a confusing or ill-posed question and produce insightful and helpful frameworks/proposals/results.
You should be able to read, understand, and critique a research proposal. You're able to understand how particular projects fit into METR's overall mission.
You're a good written communicator. Bonus points if you can write a great paper.
Wissenschaftlicher Mitarbeiter in Mikrobiologie bei MVZ diagnosticum GmbH. Verantwortlich für Projektleitung und fachliche Anleitung im medizinischen Labor.
Associate Director for Data Strategy contributing to real - world evidence with advanced analytics and partnerships. Driving innovative projects in healthcare decision - making and data science in a collaborative environment.
Principal Scientist leading CDx/IVD development projects in Translational Oncology within a leading health care company. Collaborating with teams on diagnostics and biomarker strategies.
Research Assistant in Electrolysis at Fraunhofer Institute specializing in hydrogen technology development. Engaging in cutting - edge research and innovative projects in electrochemical processes.
Principal Scientist responsible for drug discovery activities within Small Molecule Research at Novo Nordisk. Leading assay development, managing CROs, and collaborating across teams globally.
Lead Applied Research Scientist at ILLUIN Technology transforming state - of - the - art AI into functional solutions. Combining academic excellence and startup agility in a hybrid role.
Wissenschaftlicher Mitarbeiter responsible for microbiology projects at MVZ diagnosticum GmbH. Leading teams and organizing workflows within medical laboratory environment in Neukirchen.
Associate Principal Scientist implementing Chemistry, Manufacturing, and Controls regulatory strategies for biologics products. Preparing CMC sections for submissions and mentoring scientific staff.
Principal Scientist/Director responsible for regulatory strategies for biologics products. Overseeing CMC regulatory submissions and leading cross - functional teams in compliance and submission accuracy.
Research Scientist specializing in quantum error correction at Quantinuum, developing software tools and conducting computational research with a strong emphasis on collaboration.