Customer Success Engineer (CSE), GPU Cluster
Together AISan Francisco, California, United States · Posted 4 months agoDescription
About the role
As a Customer Success Engineer at Together AI, you will serve as the named technical owner for one of our most strategic customer relationships. You will be the primary technical point of contact across all infrastructure domains — compute, networking, storage, and facilities — ensuring flawless delivery and operational health of large-scale GPU deployments. This role sits at the intersection of deep infrastructure expertise and high-stakes customer partnership, making you a critical driver of both customer success and company growth.
Responsibilities
- Serve as the named technical point of contact for a dedicated strategic customer, owning the end-to-end technical relationship across compute, networking, storage, and facilities
- Drive structured engagement through regular cadences — status reporting, technical steering meetings, quarterly business reviews (QBRs), and executive business reviews (EBRs) — spanning both operational and strategic levels
- Translate customer operational feedback into actionable input for Engineering, Product, and Infrastructure roadmaps
- Lead issue lifecycle management, escalation, and RCA authorship across all infrastructure domains in partnership with Support, SRE, DC Ops, and Engineering teams
- Own end-to-end RMA coordination and hardware lifecycle management, including acceptance testing, spare inventory management, and hardware health reporting for large-scale GPU deployments
- Maintain deep technical expertise across the customer's infrastructure stack — GPU compute, high-speed fabric, and large-scale storage systems — advising on configuration, operational best practices, and incident resolution
- Own the observability strategy for the customer estate, including alert policy definition, dashboard development, and proactive health management across all infrastructure layers
- Coordinate DC operations and facilities events in partnership with internal teams and hosting providers, ensuring SLA compliance and cluster availability
- Act as project manager for all capacity expansions, owning the full node deployment lifecycle from freight receipt through production acceptance
Qualifications
- 5+ years in a customer-facing technical role, with 2+ years in dedicated technical account management or solutions architecture for large-scale AI or HPC infrastructure
- Deep expertise in GPU infrastructure — GPU health diagnostics, RMA workflows, and hardware acceptance testing
- Hands-on experience with large-scale Ethernet and InfiniBand fabric architecture
- Working knowledge of enterprise storage systems, including high-density NVMe, parallel file systems, and metadata infrastructure
- Experience with DC operations, facilities coordination, and hosting provider SLA management
- Strong ownership mindset for incident management, RCA authorship, and executive-level customer communication
- Proficiency in infrastructure monitoring and observability tooling (Prometheus, Grafana, or equivalent)
- Proven ability to manage multiple concurrent workstreams with hyperscaler-level rigor and communication standards
- Proficiency in Python, Bash, or infrastructure automation tools preferred
About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancements such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers on our journey in building the next generation of AI infrastructure.
Compensation
We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $260-290K OTE + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Location
San Francisco, CA (Hybrid) or New York, NY (Hybrid)
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our Privacy Policy at https://www.together.ai/privacy
Similar jobs
Est. 255,000 USD
About the Role Together AI is building the AI Native Cloud, an end-to-end platform for the fullgenerative AI lifecycle, combining the fastest LLM inference engine with state-of-the-artAI cloud infrastructure. The Togethe…
Est. 195,000 USD
About the role As a Technical Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'l…
Est. 225,000 USD
About The Role Together AI is growing its compute footprint, and making sure new capacity meets our technical standards is an important priority for the company. Every new cluster has to clear a technical bar before it c…
Est. 155,000 USD
About The Role Together AI is rapidly scaling its compute infrastructure across multiple sites and deployment types. The Associate, Infrastructure Strategy & Operations will be the analytical backbone of the Infrastr…
Est. 260,000 USD
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f…
About the Role As a Customer Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'll…
Est. 230,000 USD
Build the infrastructure powering the next generation of AI. At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inference. This isn’t a traditional infrast…
Est. 156,500 USD
About the Role As a Strategic Finance Senior Associate at Together, you will own the cost side of our data center build-outs. Reporting to the Director of Strategic Finance, Infrastructure, you will be the financial coun…
Est. 275,000 USD
About the Role In this role, you will operate, scale, and optimize multi-petabyte storage systems purpose-built for the world’s largest AI training and inference workloads. You’ll manage and scale high-performance parall…
Est. 230,000 USD
About The Role Together AI is building its infrastructure footprint at scale, and this role is central to making that happen. As an Infrastructure Design Engineer, you will own the design, planning, and technical executi…
Est. 197,500 USD
About the Role Our product surface is expanding fast - GPU clusters, managed storage, networking, and observability - and we're adding a Product Manager to the Together Cloud team to own the day-to-day product work that…
Est. 275,000 USD
About the Role Together AI is scaling its physical AI infrastructure rapidly — and we're looking for a Director of Data Center Operations to help us build it right. This is a ground-floor opportunity to own the operation…
Est. 195,000 USD
About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As…
Est. 205,000 USD
About the Role Together AI is looking for a Manager to own the commercial relationships with our international cloud compute suppliers and the market intelligence that drives our compute supply strategy. You will manage…
Est. 120,000 EUR
About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As…
Est. 120,000 GBP
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f…
Est. 195,000 USD
About the role As a Technical Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'l…
Est. 90,000 EUR
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f…
Est. 335,000 USD
About the Role We’re hiring a Strategic Account Executive to own a portfolio of high-priority AI-native and enterprise accounts. You’ll be responsible for generating pipeline, closing new business, and expanding customer…
Est. 215,000 USD
About The Role Together AI is scaling its own data center infrastructure to power the next generation of AI workloads. We are looking for a Program Manager, Data Center Delivery to serve as our representative across our…
Est. 220,000 USD
About the Role As a Solutions Architect at Together AI, you will work with customers and prospects to create business value through Generative AI applications. Solutions Architects at Together are trusted advisors to our…
Est. 235,000 USD
About the Role Together AI is looking for a Senior Network Engineer to design, deploy, and operate the global network infrastructure supporting our production services and high-performance AI compute environments. This i…
Est. 120,000 EUR
AI Infrastructure Systems Engineer Hybrid at our office in Amsterdam or Remote in the UK. Build the infrastructure powering the next generation of AI. At Together AI, you’ll build and operate one of the world’s largest G…
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its f…
AI Infrastructure Systems Engineer Build the infrastructure powering the next generation of AI. At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inferenc…
Est. 205,000 USD
About the Role Together AI is building the Inference Platform that brings the most advanced generative AI models to the world. Our platform powers multi-tenant serverless workloads and dedicated endpoints, enabling devel…
About the role As a Technical Support Engineer at a pioneering AI company, you'll be the first line of defense to support customers as they build out training, fine tuning, and inference solutions with Together AI. You'l…
Est. 195,000 USD
About the Role As a Systems Research Engineer specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. Working closely with…
Est. 175,000 USD
About the Role Together.ai is looking for a Software Engineer to join the Customer Insights team — a great role for a full-stack or backend engineer who wants to grow into event-driven systems, analytics, and the custome…
Est. 156,500 USD
About The Role As a Strategic Finance Senior Associate, you will own the company’s end-to-end revenue forecast as we scale. You will model a dynamic revenue base shaped by customer usage, new GPU deployments, product mix…