TixelJobs
A
Anthropicvia muse

Research Engineer, AI Monitoring

London, UKPosted 1d ago
ResearchMid LevelFull-time#greenhouse#anthropic

About the Role

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

Our team builds, tests, deploys, and monitors the classifiers that block internal agents from taking dangerous actions. These classifiers run across RL, evals, and internal deployments, and are designed to catch things like sandbox escape attempts or exfiltration of sensitive data.

When a classifier flags an action, it can block the action before the tool call runs, end the task, and alert a human. This is one layer of a defence-in-depth with several layers that reinforce each other: what our classifiers flag feeds into offline monitoring, and the findings from that go back into better classifiers and safer environment design.

The work combines research and production engineering:

  • The research problem is building high recall and high precision classifiers to catch rare, novel, and sometimes adversarial behaviour. There are also several narrow research questions to answer - for example, how to deploy safety classifiers inside training environments without incentivising models to evade them. Some research also builds on the multi-stage designs described in our work on Claude Code auto mode and Constitutional Classifiers.

  • The engineering problem is shipping these classifiers into the critical path of research and product work. These classifiers need to cover a huge volume of traffic while operating within cost, latency and availability constraints.

Day to day, much of our work is done with Claude: you'll direct agents to run experiments and ship code, and review what they produce. That moves the hard part of the job towards deciding what to do and in what order. Additionally, organisation, communication, and prioritisation skills matter a great deal as our classifiers sit in the path of many other teams' work.

Key responsibilities

  • Design, train, and evaluate classifiers that detect unsafe agent actions in real time, owning pieces such as prompted models, trained classifiers, or probes on model internals

  • Deploy, tune and operate these classifiers in the critical path of internal agents, RL training, and evaluations, and own their accuracy, reliability, latency, cost, and failure behaviour

  • Build the datasets, labelling pipelines, and evaluations that allow us to measure and improve our classifiers and harm taxonomies

  • Partner with red teaming colleagues to stress-test our classifiers, and harden them against what they find

  • Work with the teams whose agents, environments, and evaluations we run on, so that false positives get fixed quickly without weakening protection

  • Contribute to the team's direction, including what to build, what to partner on, and where to invest

Minimum qualifications

  • Ability to organise and prioritise several parallel streams of work, and to communicate clearly with the teams that work affects

  • Ability to critically review code and experiment results, including work produced by AI agents

  • Sincere interest in developing safe and beneficial AI systems

Preferred qualifications

  • Experience leading ambiguous technical projects and setting direction for other engineers or researchers

  • Experience evaluating large language models, developing classifiers, or operating high-scale production systems where requirements change quickly

  • Experience building detection systems where true positives are rare and false positives are costly, such as abuse, fraud, spam, or intrusion detection

  • Experience running low-latency, high-availability services that other systems depend on, including being on call for them

  • Experience fine-tuning language models, or working with probes and other methods that read model internals

  • Experience with LLM inference or serving infrastructure, or with integrating new components into training infrastructure

  • Background in security, such as sandboxing or detection and response

  • Familiarity with research on AI control, scalable oversight, agent safety, or reinforcement learning

The annual compensation range for this role is listed below. 

For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:
£375,000—£640,000 GBP

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience

Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience

Minimum years of experience: Years of experience required will c

Share