inhousefyi
← Back to listings

Member of Technical Staff — Product

RadixArkPalo Alto, California, United States · Posted 3 months ago
Full-timeEst. 300,000 USD
Apply now

Description

About the Role

RadixArk is seeking experienced product-focused engineers to join our team in building the developer-facing surfaces of our inference and training infrastructure. As a Member of Technical Staff — Product, you will partner closely with our Product Managers, research scientists, and systems engineers to turn cutting-edge AI infrastructure into delightful, performant, and reliable products that developers and enterprises love to use.
You will own end-to-end product experiences across APIs, SDKs, dashboards, playgrounds, and developer tooling that sit on top of SGLang, Miles, and our broader inference and training stack. You'll work at the intersection of frontier systems and great product craft, shaping how developers discover, evaluate, and integrate RadixArk's capabilities into their own AI workloads. If you are excited about translating cutting-edge infrastructure into products that meaningfully shape how the AI community builds, this role is for you.

Key Responsibilities

Product Engineering & Execution
  • Collaborate with cross-functional teams (Product, Design, Research, Infrastructure, Developer Relations) to design and ship developer-facing products on top of RadixArk's inference and training platforms.
  • Build and maintain customer-facing APIs, SDKs, CLIs, dashboards, and playgrounds that expose the power of SGLang, Miles, and our serving infrastructure in intuitive, well-documented interfaces.
  • Implement custom user interfaces and developer experiences using modern frontend and backend technologies, with a high bar for performance, accessibility, and craft.
  • Architect efficient and scalable systems that bridge low-level infrastructure (GPU scheduling, model serving, distributed training) with high-level product surfaces.
  • Analyze and optimize code for quality, efficiency, and performance, and provide thoughtful feedback to peers during code reviews.
Technical Leadership & Ownership
  • Establish end-to-end ownership of components, features, or systems, from initial design through rollout, monitoring, and iteration.
  • Set direction and goals for product engineering initiatives, lead major launches, and provide technical guidance and mentorship to peers and new team members.
  • Identify and resolve performance, reliability, and scalability issues across the product stack, and drive efforts to reduce technical debt.
  • Participate in design reviews and technical discussions, evaluating trade-offs between system complexity, developer experience, and time-to-ship.
Partnership with Product & Users
  • Work hand-in-hand with Product Managers to translate roadmap priorities into well-scoped technical deliverables, surfacing trade-offs and unblocking ambiguity early.
  • Engage directly with early adopters, design partners, and the open-source community to understand pain points and rapidly iterate on product experiences.
  • Contribute to technical content (documentation, code samples, blog posts, demos) that helps developers get the most out of RadixArk's products.
  • Use data, telemetry, and user feedback to validate hypotheses, measure the impact of launches, and inform what to build next.

Qualifications

Minimum Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience.
  • 5+ years of software engineering experience building production systems, OR 3+ years with a PhD in a relevant field.
  • Strong programming skills in at least one of: Python, TypeScript/JavaScript, Go, C++, or Rust.
  • Demonstrated experience shipping developer-facing or product-facing software end-to-end, including APIs, SDKs, web applications, or developer tools.
  • Experience using data and analysis to explain technical problems, prioritize work, and inform design decisions.
  • Excellent collaboration and communication skills, with a track record of driving complex technical projects across teams.

Preferred Qualifications

  • Experience building products on top of AI/ML infrastructure, model serving systems, or large-scale distributed systems.
  • Familiarity with LLM inference and training stacks (e.g., SGLang, vLLM, TensorRT-LLM, PyTorch, Megatron, DeepSpeed, Ray) and the trade-offs involved in serving and training large models.
  • Experience contributing to or maintaining open-source projects, especially in the AI/ML or infrastructure ecosystem.
  • Hands-on experience designing developer experiences such as public APIs, SDKs, CLIs, or dashboards, where developer ergonomics directly drive adoption.
  • Strong product sensibility, comfortable making thoughtful UX and API design decisions rather than just executing specs.
  • Experience improving quality through code reviews, testing, careful rollout, monitoring, and proactive iteration.
  • Demonstrated ability to integrate AI tools into engineering workflows to drive measurable impact (efficiency gains, quality improvements).
  • Experience working in B2B, developer-facing, or infrastructure product environments.

About RadixArk

RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang (30K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework). Founded by AI infrastructure veterans from xAI and NVIDIA, we're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.

Compensation

Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.

Equal Opportunity

RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Similar jobs

RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is seeking a Developer Advocate to build and engage our technical community around SGLang, Miles, and our open source infrastructure. SGLang already has 30K+ GitHub stars and serves billions of to…

Full-time
Product Manager7 months ago
RadixArkPalo Alto, California, United States

Est. 144,000 USD

Key Responsibilities Product Strategy & Roadmap Define, prioritize, and drive the product roadmap for inference and training infrastructure. Stay ahead of AI trends, including new model architectures, hardware optimi…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is looking for a Member of Technical Staff — Backend/API Platform Engineer to build the API layer, control plane, and platform services that power SGLang and Miles in production. You'll design and…

Full-time
RadixArkPalo Alto, California, United States

Est. 165,000 USD

About the Role As a Technical Program Manager at RadixArk, you'll drive the execution of complex, cross-functional programs across our inference and training infrastructure. You'll partner closely with Product Management…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is seeking a Member of Technical Staff, Developer Technology (DevTech) to make LLM inference and training dramatically faster, cheaper, and more accessible on modern GPU hardware. Our systems sit…

Full-time
RadixArkPalo Alto, California, United States

Est. 155,000 USD

About the Role RadixArk is seeking a Product Marketing Manager to own how SGLang, Miles, and our open source infrastructure are positioned and perceived across the market. SGLang already has 20K+ GitHub stars and serves…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is looking for a Member of Technical Staff Cluster Infrastructure to architect and scale the core compute platform that powers frontier-level AI training and inference. You will design and operate…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is seeking a Member of Technical Staff — Kernel / Compiler / Communication to push the limits of performance for frontier AI systems. You will work at the lowest layers of the stack — kernels, run…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is seeking a Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will work on the core systems that serve frontier models at scale, optimizing performance, la…

Full-time
RadixArkPalo Alto, California, United States

Est. 140,000 USD

About The Role RadixArk is launching a full-time, paid, 1-year residency program for aspiring AI infrastructure engineers. You'll rotate across inference, training, kernels, compilers, and cluster infrastructure, working…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is seeking a Member of Technical Staff — Inference-Multimodal & Diffusion to advance the frontier of generative modeling. You will work on cutting-edge diffusion and flow-based models for imag…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is seeking a Member of Technical Staff - Inference-Multi-Hardware to push the limits of performance for frontier AI systems. Most performance engineering assumes a single vendor's stack. This role…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is hiring a Member of Technical Staff — Performance in Palo Alto, CA — someone who can push LLM inference and training systems to the limit across real production workloads. You’ll work on the per…

Full-time
RadixArkPalo Alto, California, United States

Est. 150,000 USD

About the Role We're looking for a Head of Business Development to build the BD function at RadixArk from the ground up. The BD team is the institutional memory of this company — maintaining active relationships across e…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is hiring a Member of Technical Staff — CI / Infrastructure to own the infrastructure that keeps SGLang moving. Our CI system runs 300+ GPU tests across NVIDIA, AMD, Intel, and Ascend hardware poo…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role As a Member of Technical Staff, Training, you will design, build, and operate the distributed systems behind large-scale model post-training — spanning training, inference, and orchestration, with a focus…

Full-time
RadixArkPalo Alto, California, United States

Est. 300,000 USD

About the Role RadixArk is looking for a Member of Technical Staff — TPU Systems to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU har…

Full-time
RadixArkPalo Alto, California, United States

Est. 159,000 USD

About the Role We're looking for a hands-on Talent Operations Specialist to build and run the machinery behind talent and people ops as we scale. This isn't a traditional HR generalist role - it's for someone who treats…

Full-time
Visual Designer2 months ago
RadixArkPalo Alto, California, United States

Est. 115,000 USD

About the Role RadixArk builds the open-source AI infrastructure behind SGLang and Miles, used by developers and enterprises around the world. We're looking for a visual designer to join our design team and to give our b…

Full-time
River AI Inc.Palo Alto, California, United States

Est. 310,000 USD

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructu…

Full-time
AxleFrederick, Maryland, United States

Est. 140,000 USD

(ID: 2025-1135) Axle is a bioscience and information technology company that offers advancements in translational research, biomedical informatics, and data science applications to research centers and healthcare organiz…

Full-time
GradialSeattle, Washington, United States

Est. 205,000 USD

Gradial is the marketing operations system of work that helps marketers and creatives move from idea to execution faster. Our platform orchestrates across martech stacks, workflows, and people to automate marketing execu…

Full-time
XPENGSanta Clara, California, United States

Est. 328,650 USD

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…

Full-time

Est. 175,000 USD

We’re looking for a Staff AI Engineer to lead the design and delivery of AI/ML systems. This role is ideal for an experienced engineer who thrives on architectural decisions, can confidently own systems end-to-end, and c…

Full-timeRemote
Arkana LaboratoriesLittle Rock, Arkansas, United States

Est. 140,000 USD

Who we are: At Arkana Laboratories, everyone has an important role to fill. Come join us and be a part of a team dedicated to making life better for those who need it most. This place is packed with super-smart people wh…

Full-time
Lightning AINew York, New York, United States

Est. 217,500 USD

Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with…

Full-time
Lightning AINew York, New York, United States

Est. 127,500 USD

Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with…

Full-time
XPENGSanta Clara, California, United States

Est. 289,800 USD

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…

Full-time
Hex TechnologiesSan Francisco, California, United States

Est. 249,500 USD

About the role Hex is an AI-powered platform for modern Data Science and Data Analytics workflows. AI Research Engineers at Hex partner with product teams to build industry-leading AI experiences such as the Notebook Age…

Full-time
XPENGSanta Clara, California, United States

Est. 235,200 USD

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…

Full-time