inhousefyi
← Back to listings

Experienced AI Software Engineer

AuguryHaifa, Israel · Posted 3 months ago
Full-time
Apply now

Description

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to drive new levels of efficiency. Combining predictive and prescriptive AI technology with industry expertise, production teams can proactively address alerts, minimize downtime, reduce asset costs, and maximize yield and capacity. Our customers achieve payback in six months or less, enabling global scale. We're looking for team members excited to partner with the world's manufacturers and build the future of production together.

You are a Senior AI Software Engineer looking to join a GenAI Infrastructure team and build production-grade GenAI capabilities and the infrastructure behind them. You will be a hands-on engineer focused on AI agents, RAG pipelines, tool-calling workflows, backend services, data access layers, evaluation, observability, and reusable GenAI infrastructure used across product teams. You will not be focused solely on model research or prompt design. Instead, you will be a strong software engineer who can design, build, ship, and operate reliable AI-powered systems in production.

A Day In Your Life

  • Build reusable infrastructure, SDKs, and internal frameworks for AI-powered product capabilities.
  • Design and implement AI agents, RAG flows, tool-calling workflows, and LLM orchestration pipelines.
  • Build production-grade GenAI services, APIs, and backend infrastructure.
  • Integrate LLM workflows with internal microservices, data platforms, vector search, and event-driven systems.
  • Design secure data-access patterns that enforce authorization, tenant separation, and user-level scope.
  • Implement evaluation, tracing, monitoring, and quality-control mechanisms for GenAI systems.
  • Improve latency, reliability, fallback behavior, cost efficiency, and production readiness.
  • Work on customer-facing AI experiences, including conversational and proactive agentic product flows.
  • Collaborate with backend engineers, product managers, data engineers, AI/ML engineers, and domain experts.

You Will Bring

  • 6+ years of professional software engineering experience.
  • Strong Python development skills.
  • Strong backend engineering background, including APIs, services, integrations, or microservices.
  • Proven experience designing, shipping, or operating LLM-powered applications or GenAI systems.
  • Experience with RAG, AI agents, tool/function calling, prompt orchestration, evaluation, and observability.
  • Experience with microservices, distributed systems, and production backend architecture.
  • Strong understanding of system design, reliability, security, scalability, latency, and maintainability.
  • Ability to work with complex data models and expose them safely through AI systems.
  • Ability to operate in ambiguous technical areas and turn prototypes into production-ready systems.
  • Strong communication skills and ability to explain technical decisions clearly.

Preferred Qualifications

  • Experience with LangChain, LangGraph, or LangSmith.
  • Experience with Go, MongoDB, Databricks, Kubernetes, Docker, REST APIs, vector search, or event-driven systems.
  • Experience with Azure OpenAI, Gemini, or similar LLM platforms.
  • Experience building or using knowledge graphs, GraphRAG, or graph databases such as Neo4j.
  • Experience building multi-agent systems or orchestrating multiple specialized agents/tools in production.
  • Experience building internal platforms, SDKs, developer tools, or shared engineering infrastructure.
  • Experience with authorization, data segregation, multi-tenant systems, or user-level data scoping.
  • Experience in industrial, IoT, predictive maintenance, manufacturing, or operational-data domains.

What Success Looks Like

  • You build reusable infrastructure that accelerates GenAI development across teams.
  • You ship reliable GenAI capabilities that run in production.
  • You improve how AI agents retrieve data, call tools, enforce permissions, and generate grounded responses.
  • You contribute to practical standards around GenAI architecture, evaluation, monitoring, security, and deployment.

Perks

  • Stock options
  • Paid parental leave
  • Flex PTO

Augury is a people-first organization. We believe in fostering an inclusive environment in which employees feel encouraged to share their unique perspectives, leverage their strengths, and act authentically. We know that diverse teams are strong teams, and we welcome those from all backgrounds and varying experiences. We are committed to providing employees with a work environment free of discrimination and harassment. We believe that diversity is more than just good intentions, and we are committed to creating an inclusive environment for all employees.

Augury is a proud equal opportunity employer, we strive to create a work environment in which everyone, all applicants, employees, customers, guests, and vendors feel safe and comfortable. We commit to maintain a workplace that is free of any type of harassment and does not tolerate anyone intimidating, humiliating, or hurting others. We prohibit willful discrimination based on age, gender, ethnicity, race, color, religion, political opinions, sexual orientation, sexual identity or expression, military or veteran status, disability or any other characteristic protected by law.

Similar jobs

AuguryHaifa, Israel

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
AuguryBengaluru, India

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
AuguryBengaluru, India

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
AuguryHaifa, Israel

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
AuguryRemote

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-timeRemote
AuguryUnited Kingdom

Est. 80,000 GBP

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
AuguryUnited States

Est. 320,000 USD

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
AuguryRemote

Est. 115,000 USD

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-timeRemote
N-iXRemote

We're looking for an engineer with hands-on experience building and evaluating GenAI services - from RAG and agentic reasoning systems to production-grade LLM deployments. You'll work closely with Frontend and Backend te…

Full-timeRemote
N-iXRemote

Est. 120,000 EUR

N-iX is a global software development company founded in 2002, connecting over 2,400+ tech professionals across 40+ countries. We deliver innovative technology solutions in cloud computing, data analytics, AI, embedded s…

Full-timeRemote

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and…

Full-time
Robots and PencilsLviv, Ukraine

Company Overview Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurab…

Full-time
AuguryRemote

Est. 195,000 USD

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-timeRemote
Lightning AISan Francisco, California, United States

Est. 215,000 USD

Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with…

Full-time
WorkatoSan Francisco, California, United States

Est. 144,000 USD

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time

Location: Lviv, Ukraine Company Overview Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operati…

Full-timeRemote
N-iXRemote

Est. 80,000 EUR

Our client is a fast-growing European fintech company in the business spend management space. We're looking for a Senior Applied AI Engineer to design, build and ship customer-facing AI features end-to-end. Responsibilit…

Full-timeRemote
LTSRemote

Est. 144,000 USD

Location: United States – RemoteClearance: Ability to obtain and maintain a Public Trust LTS is seeking a Senior Agentic AI Software Engineer to build the intelligence behind the platform—the autonomous agents, orchestra…

Full-timeRemote
RVP, Enterprise24 days ago
AuguryUnited States

Est. 315,000 USD

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
NebiusIsrael

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to…

Full-time
Staff AI Engineer2 months ago
WorkatoRemote

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-timeRemote
SentinelOneTel Aviv-Yafo, Tel Aviv District, Israel

Our Purpose At SentinelOne, we are driven by a clear purpose: to give the advantage to those who secure our future. As AI reshapes how organizations build, operate, and innovate, the responsibility to protect them become…

Full-time
AuguryUnited States

Est. 200,000 USD

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
AuguryUnited States

Est. 162,500 USD

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…

Full-time
AI Engineer1 month ago
GuidepointToronto, Ontario, Canada

Overview: Guidepoint seeks an experienced AI Engineer as an integral member of the Toronto-based AI team. The Toronto Technology Hub serves as the base of our Data/AI/ML team, dedicated to building a modern data infrastr…

Full-time
Gen AI Lead5 months ago
Orion InnovationChennai, Tamil Nadu, India

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and…

Full-time
OktaToronto, Ontario, Canada

Secure Every Identity, from AI to HumanIdentity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This…

Full-time
LTSRemote

Est. 140,000 USD

Location: United States – RemoteClearance: Ability to obtain and maintain a Public Trust LTS is seeking a highly skilled Senior Applied AI Engineer to focus on continuously improving the intelligence behind the platform.…

Full-timeRemote
LTSRemote

Est. 140,000 USD

LTS is seeking an AI Platform and Harness Engineer to develop and maintain the infrastructure, tooling, and evaluation frameworks that power enterprise AI solutions. This role is responsible for building the AI platform…

Full-timeRemote
Cato NetworksTel Aviv, Tel Aviv District, Israel

Welcome to the future of cloud networking and security! Cato Networks is the first company to converge enterprise networking and security into one centralized and global service that is delivered by cloud. It is led by n…

Full-time