Senior Software Developer – Machine Learning Platform
CoveoMontreal, Quebec, Canada · Posted 1 month agoDescription
Build the backbone of AI at scale
Want to see your work power millions of machine learning predictions every day? Join our Machine Learning Platform team and help bring models, including Large Language Models (LLMs), into production in a reliable and scalable way.
You’ll contribute to a platform that trains thousands of models and serves hundreds of millions of queries daily, while growing your expertise in distributed systems, machine learning infrastructure and agentic workflows.
As a Backend Developer, you will:
- Contribute to the development lifecycle, including coding, testing, and deployment
- Analyze and help improve the ease of use, observability and reliability of our AI platform
- Participate in maintaining services handling millions of requests and LLM calls per day
- Collaborate with applied scientists, data engineers, and developers to integrate agentic applications into production
- Contribute to evolving our AI platform to support the growth and scale of agentic workflows for Coveo users
- Suggest improvements to existing processes and use AI coding tools to support your development workflow
Here is what will qualify you for the role:
- 5+ years of experience in backend development in a cloud environment (Python or Java/Spring preferred, AWS an asset)
- Good understanding of distributed systems and scalable application design
- Ability to solve problems and debug systems with guidance when needed
- Comfortable learning new tools, technologies, and best practices
What will make you stand out:
- Familiarity with Terraform, AWS Bedrock, OpenSearch serverless or other vector databases, LiteLLM or other LLM inference gateways
- Exposure to machine learning workflows or agentic workflows
- Interest in scalable backend services, large-scale realtime systems, agentic workflows and applications or realtime inference at scale
You don’t need to check every single box; passion goes a long way and we appreciate that skillsets are transferable.
Send us your application, we want to hear from you!
Join the Coveolife!
We encourage all qualified candidates to apply regardless of, for example, age, gender, disability, gaps in CV, national or ethnic background.
This job description was written by humans, assisted by AI. We may leverage technology in our hiring process to help us see the person behind the resume.
Coveo is committed to providing accessible employment practices. If you require accommodation due to a disability at any point during the recruitment process, please contact HR@Coveo.com to discuss your needs.
Similar jobs
Build the foundation that makes AI agents reliable at scale. Have you ever wondered what it takes to turn an AI agent from an impressive demo into a trusted product used every day? As part of our Agentic Operation team,…
Build the future of intelligent search Why build just another backend service when you can shape the search technology powering an entire product ecosystem? As a Senior Software Developer on our Search team, you'll help…
Lead the teams shaping the future of AI-powered relevance. What if your next leadership challenge was about enabling teams to build the technologies that redefine how people find information? As a Development Manager, yo…
Have an impact on the services at the core of the Coveo Platform™ Want to shape the foundations that development teams rely on every day? As a Senior II Developer on R&D’s Backend Foundation team, you’ll work at the…
Have an impact on the services at the core of the Coveo Platform™ Want to shape the foundations that development teams rely on every day? As a Senior II Developer on R&D’s Backend Foundation team, you’ll work at the…
Build the backbone of scalable data platforms at Coveo As a Senior Software Developer within the Data Platform’s Infrastructure team, you will lead efforts to improve the reliability, cost efficiency and platform enablem…
Build the backbone of scalable data platforms at Coveo As a Senior Software Developer within the Data Platform’s Infrastructure team, you will lead efforts to improve the reliability, cost efficiency and platform enablem…
The expert behind our proprietary C++ indexing technology Could your next optimization improve how millions of pieces of content become searchable? As a Senior C++ Developer on our indexing team, you'll help evolve the c…
Drive the future of AI-powered operator experiences. As our Director of Engineering, Command, you'll define and execute Coveo's Command technology vision, making it the trusted operating layer for customers by driving in…
The technical backbone behind every successful implementation First time hearing about Professional Services at Coveo? We are THE technical team that brings the Coveo AI-powered search products to life for our clients. A…
Build the partnerships that power AI innovation We're looking for a Senior Partner Manager to expand our strategic alliances across North America and help accelerate our market impact. You will own a portfolio of leading…
Drive AI transformation within the world’s most strategic enterprises. Ready to own and expand relationships with global enterprise customers while delivering real AI-driven business impact? As a Senior Enterprise Accoun…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 120,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Design intelligent experiences that actually make sense. How do you translate complex business needs into elegant technical solutions that deliver real impact? As a Solution Architect on our Professional Services team, y…
Est. 105,000 EUR
Build the backbone of scalable data platforms at Coveo As a Senior Software Developer within the Data Platform’s Infrastructure team, you will lead efforts to improve the reliability, cost efficiency and platform enablem…
Est. 120,000 GBP
As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and production systems, supportin…
Open doors. Create opportunities. Fuel our next stage of growth. Do you thrive on opening doors others can't? As an Enterprise Sales Development Representative, you'll connect with enterprise decision-makers, uncover new…
Expand relationships. Unlock opportunities. Drive enterprise growth. What if your next sales role let you shape expansion opportunities within some of the world’s most complex enterprise organizations? At Coveo, you’ll h…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 120,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 148,750 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
The best-kept secret in enterprise AI. Your job is to make sure it doesn't stay that way. Every agentic workflow in the enterprise depends on surfacing the right information at the right moment. That's what Coveo does. W…
Shape the systems behind a world-class employee experience. How do you scale people operations thoughtfully when your company is growing, but still values agility? At Coveo, we’re looking for someone who can bridge Peopl…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Build the experiences that bring technology to life. How do you help customers, analysts, and prospects understand the power of a platform before they ever use it? By building technical experiences that make complex capa…