Description
Incidents get resolved, but the fixes that would stop them recurring slip down the backlog — and a few weeks later, a version of the same failure comes back. Most teams live with that. On a platform as critical as Buildkite's, we've decided not to, which is why we're creating a role whose whole remit is to own how we respond to incidents and design them out for good.
🔧 The problem worth solving
Buildkite runs production builds for teams like OpenAI, Anthropic, Uber, Shopify, Airbnb, Canva and Pinterest — software delivery in the critical path for over a billion daily users. When something breaks here, it breaks loudly, for people who can't afford it to.
Until now, Incident response has been carried by whoever was closest, in the gaps between everything else they own. It's held up. But "held up" is no longer the bar for a platform this critical. We'll be asking you to set the standard for how the whole engineering org detects, responds to, learns from, and designs out the incidents that matter — end to end.
🚀 What you'll own
You'd own incident management across engineering — the definition, process, tooling, and adherence — and make it stick.
In the moment, you're in the room on the high-impact incidents, driving clarity, coordination and a clean resolution. Between incidents — where the real work lives — you're running postmortems that go somewhere, making sure the followups get done every time, and turning what each one taught us into the changes that make the next incident smaller.
You'd work across every product team plus Security and Support, holding one consistent resilience bar and bringing engineering managers with you. And you'd coach engineers on how to run an incident, communicate through it, and own the outcome.
🎨 The person we're picturing
You've built or materially lifted incident management capability somewhere before, and you've got a clear, earned point of view on what good looks like.
You can read the code, dig into the telemetry, and lead a real investigation — not just chair the call. You're calm when it's sustained and messy: you make incidents smaller, not louder. And you can hold a firm bar across teams that don't report to you without softening the standard or bruising the relationship — the diplomacy to find common ground and the spine to keep the line.
You'll be at home with observability tooling (Datadog, Honeycomb), AWS, Terraform, and the failure modes distributed systems throw up at scale. Our stack is Ruby on Rails, PostgreSQL, Kafka and Redis on AWS — you won't need all of it on day one.
The one thing we won't move on: you've owned incident response for production systems at real scale for a number of years, meaning you've experienced a breadth of different challenges and scenarios. It's this knowledge and real world experience we're hoping to benefit from.
🤔 Is this you?
A strong fit if you:
- Would rather draw the map on a blank page than inherit someone else's
- Get more out of the incident that never happened than the heroic save
- Can hold a standard across teams you don't manage, and keep the relationship
- Read "flat, high-autonomy, little scaffolding" as room to move, not risk
Probably not the right role if you:
- Want a mature incident function to run, not one to build from the ground up
- Would rather chair the call than open the code and dashboards yourself
- Need top-down authority before people will move for you
- Find cross-team persuasion draining rather than part of the fun
💚 Why Buildkite
- First of its kind here. No one has owned this before you. You define what incident management at Buildkite means — the mandate is real and yours to shape.
- Scale that's genuinely rare. Billions of builds, in the critical path for some of the strongest engineering teams on the planet — systems that run continuously and can't be casually restarted.
- Ownership, not tickets. Flat structure, high autonomy. You're trusted to make the calls that matter and own the result.
- Remote, properly. We've worked this way since 2013 — async and built for deep focus, with genuine overlap across our ANZ and US-Pacific teams.
- Small enough that it counts. ~150 people. What you change is visible across the org.
📍 Where you can work
Our engineering teams are based across ANZ and US-Pacific time zones — a conscious decision that lets us move quickly with real overlap and minimise fully async work. So while Buildkite is fully remote, we don't hire everywhere: if you're applying from outside these regions, we're not currently in a position to hire you, and can't offer sponsorship.
What happens next
Every application gets a response. We're wired for velocity, so you won't be left waiting on us. If this is the problem you've been wanting to get your hands on, apply — or reach out with questions first.
🌈 Equal Opportunity Employer
At Buildkite, we value diversity and celebrate all types of skills, backgrounds, and experiences. We’re dedicated to fostering an inclusive environment and providing reasonable accommodations throughout our recruitment process.
If you need any accommodations or support during the application or interview process, please reach out to us at accommodations@buildkite.com.
Similar jobs
Buildkite’s CI platform is trusted by the world’s leading engineering teams, shipping software to over 1,000,000,000 daily users. Job Overview We're looking for a Staff Engineer to join our Releases team. In this role, y…
We're looking for a Staff Software Engineer to lead Developer Experience at Buildkite, building the compounding, AI-led development loops that lifts the productivity of all our engineers. We have a plan to double R&D…
About Buildkite Buildkite's CI platform is trusted by the world's leading engineering teams, helping ship software used by more than 1 billion people every day. Companies including Canva, Meta, Mistral AI, and NVIDIA rel…
Est. 124,000 USD
About Buildkite Buildkite's CI platform is trusted by the world's leading engineering teams, helping ship software used by more than 1 billion people every day. Companies including Canva, Meta, Mistral AI, and NVIDIA rel…
Est. 230,000 USD
About Buildkite Buildkite's CI platform is trusted by the world's leading engineering teams, helping ship software used by more than 1 billion people every day. Companies including Canva, Meta, Mistral AI, and NVIDIA rel…
Est. 162,500 USD
About Buildkite Buildkite's CI platform is trusted by the world's leading engineering teams, helping ship software used by more than 1 billion people every day. Companies including Canva, Meta, Mistral AI, and NVIDIA rel…
Est. 180,000 USD
About Buildkite Buildkite's CI platform is trusted by the world's leading engineering teams, helping ship software used by more than 1 billion people every day. Companies including Canva, Meta, Mistral AI, and NVIDIA rel…
Est. 144,000 USD
Emergent builds autonomous coding agents that replace traditional software development by generating, testing, and deploying production applications directly from plain-language intent. Our systems run in production at g…
Est. 329,500 USD
Kikoff: The Fintech Powering Financial Security at ScaleKikoff is a profitable, pre-IPO fintech company on a mission to empower everyone to achieve financial security. With record revenue growth in 2025 and a unicorn val…
Est. 329,500 USD
Kikoff: The Fintech Powering Financial Security at ScaleKikoff is a profitable, pre-IPO fintech company on a mission to empower everyone to achieve financial security. With record revenue growth in 2025 and a unicorn val…
Emergent builds autonomous coding agents that replace traditional software development by generating, testing, and deploying production applications directly from plain-language intent. Our systems run in production at g…
Est. 141,000 USD
This is a U.S. based position. All of the programs we support require U.S. citizenship to be eligible for employment. All work must be conducted within the continental U.S.Who we are: Raft (https://TeamRaft.com) is a cus…
Est. 90,000 GBP
Who We Are At Partnerize, we're on a mission to transform the way businesses grow. We've built the leading partnership automation platform that empowers brands to discover, engage, and convert their audiences at scale. F…
Est. 80,000 EUR
Why Cast AI? Cast AI is an automation platform that operates cloud-native and AI infrastructure at scale. By embedding autonomous decision-making directly into Kubernetes and cloud environments, Cast AI continuously opti…
Est. 80,000 GBP
Who We Are At Partnerize, we're on a mission to transform the way businesses grow. We've built the leading partnership automation platform that empowers brands to discover, engage, and convert their audiences at scale. F…
Est. 80,000 EUR
What you’ll be doing Work with a team of DevOps and DBA professionals Improve existing infrastructure and processes across the countries we’re deployed in, as well as streamlining processes to deploy to new countries in…
Est. 125,000 USD
About Customer.io Over 8,000 companies — from scrappy startups to global brands — use our platform to send billions of emails, push notifications, in-app messages, and SMS every day. Customer.io powers automated communic…
Est. 124,000 USD
About Netcraft Netcraft is the global leader in cybercrime detection and disruption. We’re a trusted partner for three of the four largest companies in the world and many large governments. We've blocked over 225 million…
Est. 144,000 USD
Identity has become a critical to an organizations security posture. This is true across their entire digital landscape include cloud, traditional on prem and emerging technologies like agentic ai. Britive is at the fore…
Est. 175,000 USD
Hi, I'm Brian, Senior Director of Engineering at Customer.io. We're looking for experienced engineers who want to own a channel end to end — from the infrastructure that delivers billions of messages reliably, to the pro…
About impact.com impact.com is the world’s leading commerce partnership marketing platform, transforming the way businesses grow by enabling them to discover, manage, and scale partnerships across the entire customer jou…
Est. 115,000 USD
Who We Are Launchpad Technologies Inc. is a global technology partner connecting top talent with high-impact projects across North America and beyond. We specialize in Staff Augmentation and product development, helping…
Est. 80,000 EUR
This role is part of our ScraperAPI team, one of our growing brands at saas.group. ScraperAPI is an enterprise-scale web scraping solution, trusted by businesses across a wide range of industries to extract crucial data…
Why project44? At project44, we believe in better. We challenge the status quo because we know a better supply chain isn’t just possible—it’s essential. Better for our customers. Better for their business. Better for the…
Est. 120,000 GBP
GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital…
Who We Are Building the Backbone of Distributed Applications. At Orkes, we are reimagining how developers build reliable, scalable, event-driven applications without wrangling complex infrastructure. Born from Netflix's…
Est. 190,500 PLN
Why project44? At project44, we believe in better. We challenge the status quo because we know a better supply chain isn’t just possible—it’s essential. Better for our customers. Better for their business. Better for the…
What you’ll be doing Work with a team of DevOps and DBA professionals; covering Saturday, Sunday and Monday (5 days in total with flexibility in your days off) as a Weekend SRE Improve existing infrastructure and process…
Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning. The world’s most innovative brands rely on Movable Ink to maximize revenue, simplify workflow and boo…
Est. 120,000 GBP
GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital…