Description
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations, and intelligence collection enable engineering, safety, and security teams to stay ahead of evolving threats and deploy AI systems safely.
Our client’s team is responsible for identifying and investigating misuses of their products – especially new types of abuse–and creating systems of defence to address them. Part of this team specialises in the latter, and they need additional support to help them monitor abuse on product launches and design and build scaled detection, review, enforcement, and measurement for uncovered risks. This position is a Full-Time (40 hours per week), contract position.
About The Role:
Protection Science Engineering is an interdisciplinary role mixing data science, machine learning, investigation, and policy/protocol development. As a Protection Scientist Engineer within the client team, you will assist in designing and building systems to proactively identify and enforce on abuse on their AI products. This includes ensuring they have robust abuse monitoring in place for new products, sustaining monitoring for existing products, and prototyping and incubating systems of defense against the highest risk harms. You will also respond to and investigate critical escalations, especially those that are not caught by existing safety systems. This will require developing understanding of the products and data, and working cross-functionally with product, policy, and engineering teams.
You will need a strong ability to use SQL and python to query, transform, and understand data, and to build and improve prototype detection. An investigative mindset is key, with experience in identifying and enforcing on bad actors (in any industry). A background including data science, machine learning and classification basics, AI, and/or threat investigation is a plus.
This is a remote position, based in London, UK. The position includes participation in an on-call rotation that will involve resolving urgent escalations outside of normal work hours, for at least 7 consecutive days per quarter. Some detection and investigations may involve exposure to sensitive and distressing content, including sexual, violent, or otherwise-disturbing material.
In This Role, You Will:
- Scope and implement abuse monitoring requirements for new product launches.
- Improve processes to sustain monitoring operations for existing products, including developing approaches to automate monitoring subtasks.
- Prototype and mature into production systems of detection, review, and enforcement of abuse for major harms.
- Work with Product, Policy, Ops, and Investigative teams to understand key risks and how to identify and address them, and with Engineering teams to ensure we have sufficient data and scaled tooling.
Requirements:
- Ability to work remotely on GMT and must be geographically located in the UK.
- Quantitative and coding background , including statistics/metrics and proficiency in python and SQL.
- Experience in identifying (and ideally enforcing on) bad actors with scaled tooling.
- Ability to be on-call approximately once a quarter that will involve resolving urgent escalations outside of normal work hours, including occasional evenings and weekends
- Ability to rapidly context switch across domains, modalities, and abuse areas, to include high severity areas like violent activities and child safety
- Excited to work in a fast paced, ambiguous, and purposeful space with high impact across users and beyond, and to learn quickly.
Desired Qualities (but not required):
- Background in machine learning and classification, especially on novel or poorly understood behaviours.
- Experience scaling and automating processes, especially with language models.
- Experience working with scaled labellers or reviewers, particularly at scale.
- Familiarity with one of the following topics/areas: AI safety, child safety, abuse by nation state and other malicious actors, digital mental health, fraud abuse, radicalization/persuasion/grooming; hateful activities and groups.
Similar jobs
Est. 60,000 GBP
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 120,000 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 127,000 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 95,000 GBP
Synack’s Penetration Testing as a Service platform manages customers’ attack surfaces by discovering new assets, pentesting for critical vulnerabilities and gaining visibility into the root causes of security risks. We a…
Est. 92,500 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 147,500 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 110,000 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 256,450 USD
About the Role Abnormal AI is seeking a Staff Software Engineer to join the Multi-Product Platform division, owning Security & Privacy as a platform capability. We're looking for a distributed systems expert who has…
About AlphaSense: The world’s most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making. With market intelligence and search built on proven AI, AlphaSense delivers insights that matter f…
About AlphaSense: The world’s most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making. With market intelligence and search built on proven AI, AlphaSense delivers insights that matter f…
Est. 80,000 GBP
The Role We have an opportunity for a Senior Engineer in our AI & Algorithms team, working with a particular focus on our defence and security clients. You’ll join a team of talented engineers and scientists designin…
Est. 120,000 GBP
Isomorphic Labs is applying frontier AI to help unlock deeper scientific insights, faster breakthroughs, and life-changing medicines with an ambition to solve all disease. The future is coming. A future enabled and enric…
Arkose Labs is on a mission to create an online environment where all consumers are protected from spam and abuse. As a Fast Company 2025 Best Workplace for Innovators, we provide a proactive fraud deterrence platform, A…
Est. 158,550 USD
About the Role Abnormal AI is looking for an Application Security Engineer II to secure the AI-powered systems at the core of our AWS-based platform (LLM-integrated features, agentic workflows, MCP connectors, and the mo…
Est. 135,000 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 60,000 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 120,000 GBP
Scale AI sits at the intersection of frontier AI, enterprise software, and national security. We safeguard high-value assets: proprietary AI data and infrastructure, a global contributor ecosystem, and sensitive enterpri…
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…
Est. 181,850 USD
About the Role At Abnormal AI, our mission is to protect the world’s largest enterprises from advanced email and collaboration attacks. The Threat Narrative team transforms complex signals from our detection systems into…
Est. 120,000 GBP
The Role We have an opportunity for a Principal Engineer in our AI & Algorithms department, working with a particular focus on our defence and security clients. You’ll join a team of talented engineers and scientists…
Est. 115,000 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Arkose Labs is on a mission to create an online environment where all consumers are protected from spam and abuse. As a Fast Company 2025 Best Workplace for Innovators, we provide a proactive fraud deterrence platform, A…
Est. 124,000 USD
About the Company At Future Secure AI, we're building something genuinely new — and we're looking for people bold enough to build it with us. We work at the frontier of AI, tackling big, real-world problems for global en…
About the Role Abnormal AI is seeking a Machine Learning Engineer - I (MLE) to join the Misdirected Email Detection (MED) team. The MED team plays a critical role in preventing accidental data loss by detecting and block…
Est. 65,000 GBP
C3 AI (NYSE: AI), is the Enterprise AI application software company. C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing, deploying, and operat…
About Abnormal AI Abnormal AI is the leading AI-native security platform, protecting enterprise organizations from the full spectrum of cyber attacks. Powered by behavioral AI that understands human and machine identity,…
Est. 52,000 USD
About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations…
Est. 120,000 GBP
About the role Scale's Global Public Sector team is focused on using AI to address critical challenges facing the public sector around the world. As a Staff Applied AI Engineer, you'll raise the bar for how AI gets built…
Est. 90,000 GBP
About us PhysicsX is a deep-tech company with roots in numerical physics and Formula One, dedicated to accelerating hardware innovation at the speed of software. We are building an AI-driven simulation software stack for…