AI/ML Engineer (Mid-level to Principal)
ProphecySan Francisco, California, United States · Posted 3 months agoDescription
About Prophecy
The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. To learn more, visit us on LinkedIn.
The Role
You'll own the intelligence layer at Prophecy: the AI systems that let our agents understand data schemas, generate correct transformations, and reason over enterprise knowledge. This isn't a role where you implement someone else's spec — you make the calls on agent architecture, model selection, quality evaluation, and build vs. buy. The scope scales with you; strong engineers have enormous leverage here regardless of title.
What You'll Own
Agent design and quality. Architect multi-step AI agents end-to-end — problem decomposition, context retrieval, error recovery, output quality. Set the bar, build the evals, own the improvement loop.
Retrieval and knowledge systems. Own the RAG pipelines, vector and graph-based retrieval, and knowledge representations that let agents reason accurately over customer schemas, lineage, and semantics.
Code generation and data transformation. Own the AI layer behind Prophecy's core capability — natural language to production-grade transformations: prompt design, model selection, fine-tuning, output validation.
Production AI. Make AI that works in the lab work at scale — latency, throughput, observability, knowing when to optimize a model vs. restructure a system.
Who You Are
You've built coding agents or AI systems in production and owned them when things break. You think in failure modes and evaluation strategy, not capability demos. You make architectural decisions under uncertainty and know when to move fast versus when to do it right.
You're a builder who loves picking up new technologies — in a field where last year's best practice may already be obsolete, that instinct matters. You have a strong perspective on how coding agents should work and bring it to design discussions, not just implementation.
Experience level is flexible; what matters is the track record. We'd expect 4–6+ years in software engineering with meaningful AI/ML depth.
Stack and Background We Value
Python is the primary language. Retrieval infrastructure spans vector databases and knowledge graphs (Neo4j), backed by AWS and Kubernetes. Scala and Go are meaningful plusses — our language compiler and orchestrator are built on them. Our platform integrates with Databricks, Snowflake, BigQuery, DuckDB, and Spark; experience with any of these, or with data processing and analytics broadly, is genuinely valuable.
Location: San Mateo office, 2–3 days/week
Compensation: $250,000–$350,000 base + equity, calibrated to level.
Benefits and Perks
- Prophecy covers 99% of employee health insurance premiums and 75% for dependents
- We offer $200 per month towards remote work, wellness, gyms, massages, facials, and more!
- Flexible PTO
- Professional development allowance
- Company sponsored Long Term Disability and Life Insurance, FSA/HSA, dental, vision, and more
- Ability to have your fingerprint on an innovative platform
- End-to-end ownership of your projects.
*Benefits and perks may vary per country
Prophecy is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, age, disability, or veteran status.
Similar jobs
About Prophecy The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world's top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generat…
Est. 85,000 USD
About Prophecy Prophecy is building the next generation AI-powered data prep and analysis platform. Our platform enables business analysts and data teams to transform raw data into reliable, production-ready datasets and…
Est. 140,000 USD
About Prophecy Prophecy is building the next generation AI-powered data prep and analysis platform. Our platform enables business analysts and data teams to transform raw data into reliable, production-ready datasets and…
Est. 140,000 USD
About Prophecy Prophecy is building the next generation of AI-powered Data Prep and Analytics. Our platform enables business analysts and data teams to transform raw data into reliable, production-ready datasets and insi…
Est. 80,000 USD
About Prophecy Prophecy is building the next generation AI-powered data prep and analysis platform. Our platform enables business analysts and data teams to transform raw data into reliable, production-ready datasets and…
At Prodigal, we are building AI Agents for loan servicing and collections. Founded in 2018 by IITB alumni, our journey began when our founders Shantanu and Sangram faced the antiquated the $13B+ lending/collections indus…
Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to…
Est. 140,000 USD
Location: Remote (U.S. or Canada) Type: US Applicants – Full-Time; Canadian Applicants – Independent Contractor About Human Agency We're scaling rapidly and have a growing pipeline of opportunities that demand exceptiona…
Est. 215,000 USD
Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with…
At Prodigal, we are building AI Agents for loan servicing and collections. Founded in 2018 by IITB alumni, our journey began when our founders Shantanu and Sangram faced the antiquated the $13B+ lending/collections indus…
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…
Est. 175,000 USD
Gradial is the marketing operations system of work that helps marketers and creatives move from idea to execution faster. Our platform orchestrates across martech stacks, workflows, and people to automate marketing execu…
Est. 445,000 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 327,500 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 362,500 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
At Prodigal, we are building AI Agents for loan servicing and collections. Founded in 2018 by IITB alumni, our journey began when our founders Shantanu and Sangram faced the antiquated the $13B+ lending/collections indus…
Est. 347,500 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 205,000 USD
Gradial is the marketing operations system of work that helps marketers and creatives move from idea to execution faster. Our platform orchestrates across martech stacks, workflows, and people to automate marketing execu…
Est. 362,500 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 260,000 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 600,000 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Company Overview Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurab…
Est. 445,000 GBP
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 197,500 GBP
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 347,500 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
We're hiring a AI Architect to design and deliver agentic, LLM-powered systems for our clients. This is a hands-on, client-facing role focused primarily on generative AI and agentic workflows, with traditional machine le…
Est. 347,500 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 445,000 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 347,500 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 675,000 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…