Senior Software Engineer, AI Agent & LLM
Otter.aiMountain View, California, United States · Posted 1 month agoDescription
The Opportunity
We are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on AI quality. You will help build and improve the AI systems behind Otter’s conversational knowledge engine and AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate them reliably at scale.
This is a hands-on role for someone who can move from an ambiguous product problem to a working production solution, define how quality should be measured, and drive improvements across services, models, and user experience.
Your Impact
- Build AI-agent experiences for Otter AI Chat that help users reason over conversations, retrieve knowledge, and complete complex tasks.
- Advance Otter’s conversational knowledge engine through better knowledge extraction, annotation, and indexing.
- Develop robust evaluation datasets, automated graders, regression tests, and release gates for AI quality.
- Diagnose failures across models, prompts, retrieval, tools, data pipelines, backend services, and product workflows.
- Build shared agent infrastructure for orchestration, tracing, debugging, retries, sandboxed execution, and observability.
- Improve task completion, correctness, groundedness, reliability, latency, and cost.
- Turn production traces, customer feedback, and usage signals into measurable product and model improvements.
- Collaborate across AI, product, infrastructure, data, security, and application teams to deliver end-to-end capabilities.
We're looking for someone who
- Has 5+ years of AI Agent engineering, machine learning engineering, or related experience.
- Brings strong backend or distributed-systems engineering skills.
- Has hands-on experience building and shipping AI-agent or LLM-powered products.
- Has a strong focus on AI quality and experience evaluating nondeterministic systems.
- Can use data, traces, logs, and qualitative examples to identify and resolve complex failures.
- Works effectively across services, technical domains, and organizational boundaries.
- Combines strong product judgment with rigorous engineering and evaluation practices.
- Operates with high agency, strong ownership, and a bias toward action.
- Can take ambiguous problems from initial exploration through production launch and continuous improvement.
- Demonstrated ability to use coding agents effectively while rigorously reviewing and controlling the quality of their output is a plus.
About Otter.ai
We are in the business of shaping the future of work. Our mission is to make conversations more valuable.
With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.
Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace. We provide reasonable accommodations for qualified applicants throughout the hiring process.
Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process. If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.
*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.
Salary range
Salary Range: $185,000 to $230,000 USD per year
This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.
#LI-Hybrid
Similar jobs
Est. 170,000 USD
The Opportunity We are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on AI quality. You will help build and improve the AI systems behind Otter’s…
Est. 207,500 USD
The Opportunity We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will hold a deep comprehension of search and recommendations algorithms and…
Est. 247,500 USD
The OpportunityDo you want to lead projects to build and deploy cutting-edge AI technology to help people get unparalleled value from meetings and conversations? Join our core AI team responsible for ML and work alongsid…
Est. 208,500 USD
The OpportunityDo you want to lead projects to build and deploy cutting-edge AI technology to help people get unparalleled value from meetings and conversations? Join our core AI team responsible for ML and work alongsid…
Est. 304,000 USD
The OpportunityDo you want to lead projects to build and deploy cutting-edge AI technology to help people get unparalleled value from meetings and conversations? Join our core AI team responsible for ML and work alongsid…
Est. 207,500 USD
The OpportunityAre you an experienced Senior Software Engineer, Backend (Infrastructure) looking to make a significant impact at the intersection of scalable web services and cutting-edge AI technologies? We're seeking a…
Est. 207,500 USD
The Opportunity We are looking for a Senior Software Engineer to lead feature development and serve as a technical expert, collaborating closely with key stakeholders across the organization. In this role, you will drive…
Est. 247,500 USD
The OpportunityDo you want to lead projects to build and deploy cutting-edge AI technology to help people get unparalleled value from meetings and conversations? Join our core AI team responsible for ML and work alongsid…
Est. 150,250 USD
The Opportunity We are looking for a Software Engineer to lead feature development and serve as a technical expert, collaborating closely with key stakeholders across the organization. In this role, you will drive the pe…
Est. 207,500 USD
The OpportunityAre you an experienced Senior Software Engineer, Backend (Infrastructure) looking to make a significant impact at the intersection of scalable web services and cutting-edge AI technologies? We're seeking a…
Est. 242,500 USD
The OpportunityAre you an experienced Staff Software Engineer, Backend (Infrastructure) looking to make a significant impact at the intersection of scalable web services and cutting-edge AI technologies? We're seeking a…
Est. 242,500 USD
The OpportunityAre you an experienced Staff Software Engineer, Backend (Infrastructure) looking to make a significant impact at the intersection of scalable web services and cutting-edge AI technologies? We're seeking a…
Est. 207,500 USD
The Opportunity We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will hold a deep comprehension of search and recommendations algorithms and…
Est. 197,500 USD
The opportunity We are seeking a hands-on Senior Manager, Sales Enablement to support Otter’s revenue organization as we scale our Enterprise platform. This is a player-coach role, balancing strategy with execution - bui…
Est. 170,000 USD
The Opportunity We are looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our Data Platform team. In this role, you'll design and develop the foundati…
Est. 190,000 USD
Location: Bay Area (Hybrid – 3 days/week in San Francisco office or Mountain View HQ) The opportunity Are you ready to be part of our exciting journey of exponential growth? We are seeking a talented Mid-Market Account E…
Est. 207,500 USD
The Opportunity We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will hold a deep comprehension of search and recommendations algorithms and…
Est. 145,000 USD
The Opportunity We're looking for a Senior Demand Generation Manager to manage strategic marketing campaigns and channels at Otter. You'll run multi-channel campaigns from brief to results, manage various website optimiz…
Est. 147,500 USD
The Opportunity We're looking for a Senior Field Marketing Manager to manage events strategy - putting Otter in front of enterprise buyers, and executing necessary follow through that turns presence into pipeline. You'll…
Est. 213,000 USD
The Opportunity Otter.ai just crossed 1 billion meetings transcribed. The enterprise motion is accelerating, and we're building the CS organization that will take us to the next level. This is your chance to help shape w…
Est. 207,500 USD
The Opportunity We are looking for a Senior Data Engineer to join our Data Platform team and build the core data foundations that power analytics, experimentation, and decision-making across the company. In this role, yo…
Est. 170,000 USD
The Opportunity We are seeking a talented Engineer with extensive system knowledge who wants to be part of a team to build and operate large-scale systems that enables reliable and rapid deployment with effective monitor…
Est. 190,000 USD
Location: Bay Area (Hybrid – 3 days/week in San Francisco office or Mountain View HQ) The opportunity Are you ready to be part of our exciting journey of exponential growth? We are seeking a talented Mid-Market Account E…
Est. 230,000 USD
The Opportunity We're seeking a talented Staff Engineer to join our Frontend Team. In this role, the person will shape and drive feature development while collaborating with key stakeholders across our organization. We'r…
Est. 157,500 USD
The Opportunity We are a B2B AI SaaS company in active transition from a product-led growth model to a combined PLG + sales-led motion. Our CRM, data, and workflow infrastructure was built for self-serve — it was not bui…
Est. 245,000 USD
The Opportunity This role is focused on expansion within Otter’s top accounts. You will own growth across a defined set of strategic customers, expanding into new teams, business units, and subsidiaries while introducing…
Est. 170,000 USD
The Opportunity We are seeking a hands-on Senior Analyst of GTM Systems to own and optimize our go-to-market technology stack. This role is central to enabling our revenue teams to operate at peak efficiency — managing t…
Est. 218,500 USD
The Opportunity We are seeking a talented Senior Solution Architect with deep enterprise pre-sales experience who wants to own the technical sale for complex, multi-stakeholder deals and help define how our AI meeting in…
Est. 160,000 USD
The Opportunity As a Growth Marketing Manager, you will be a key driver of Otter’s user acquisition engine—owning and scaling paid social channels while building a modern, AI-powered growth system. You’ll report to the H…
Est. 139,000 USD
About Us Observe.AI is the AI Agents platform for customer experience, designed to help organizations deliver faster, smarter, and more efficient customer service at scale. The platform enables businesses to deploy speci…