Member of Technical Staff — Product
RadixArkPalo Alto, California, United States · Posted 3 months agoDescription
About the Role
Key Responsibilities
-
Collaborate with cross-functional teams (Product, Design, Research, Infrastructure, Developer Relations) to design and ship developer-facing products on top of RadixArk's inference and training platforms.
-
Build and maintain customer-facing APIs, SDKs, CLIs, dashboards, and playgrounds that expose the power of SGLang, Miles, and our serving infrastructure in intuitive, well-documented interfaces.
-
Implement custom user interfaces and developer experiences using modern frontend and backend technologies, with a high bar for performance, accessibility, and craft.
-
Architect efficient and scalable systems that bridge low-level infrastructure (GPU scheduling, model serving, distributed training) with high-level product surfaces.
-
Analyze and optimize code for quality, efficiency, and performance, and provide thoughtful feedback to peers during code reviews.
-
Establish end-to-end ownership of components, features, or systems, from initial design through rollout, monitoring, and iteration.
-
Set direction and goals for product engineering initiatives, lead major launches, and provide technical guidance and mentorship to peers and new team members.
-
Identify and resolve performance, reliability, and scalability issues across the product stack, and drive efforts to reduce technical debt.
-
Participate in design reviews and technical discussions, evaluating trade-offs between system complexity, developer experience, and time-to-ship.
-
Work hand-in-hand with Product Managers to translate roadmap priorities into well-scoped technical deliverables, surfacing trade-offs and unblocking ambiguity early.
-
Engage directly with early adopters, design partners, and the open-source community to understand pain points and rapidly iterate on product experiences.
-
Contribute to technical content (documentation, code samples, blog posts, demos) that helps developers get the most out of RadixArk's products.
-
Use data, telemetry, and user feedback to validate hypotheses, measure the impact of launches, and inform what to build next.
Qualifications
Minimum Requirements
-
Bachelor's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience.
-
5+ years of software engineering experience building production systems, OR 3+ years with a PhD in a relevant field.
-
Strong programming skills in at least one of: Python, TypeScript/JavaScript, Go, C++, or Rust.
-
Demonstrated experience shipping developer-facing or product-facing software end-to-end, including APIs, SDKs, web applications, or developer tools.
-
Experience using data and analysis to explain technical problems, prioritize work, and inform design decisions.
-
Excellent collaboration and communication skills, with a track record of driving complex technical projects across teams.
Preferred Qualifications
-
Experience building products on top of AI/ML infrastructure, model serving systems, or large-scale distributed systems.
-
Familiarity with LLM inference and training stacks (e.g., SGLang, vLLM, TensorRT-LLM, PyTorch, Megatron, DeepSpeed, Ray) and the trade-offs involved in serving and training large models.
-
Experience contributing to or maintaining open-source projects, especially in the AI/ML or infrastructure ecosystem.
-
Hands-on experience designing developer experiences such as public APIs, SDKs, CLIs, or dashboards, where developer ergonomics directly drive adoption.
-
Strong product sensibility, comfortable making thoughtful UX and API design decisions rather than just executing specs.
-
Experience improving quality through code reviews, testing, careful rollout, monitoring, and proactive iteration.
-
Demonstrated ability to integrate AI tools into engineering workflows to drive measurable impact (efficiency gains, quality improvements).
-
Experience working in B2B, developer-facing, or infrastructure product environments.
About RadixArk
RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang (30K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework). Founded by AI infrastructure veterans from xAI and NVIDIA, we're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.
Compensation
Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
Equal Opportunity
RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Similar jobs
Est. 300,000 USD
About the Role RadixArk is seeking a Developer Advocate to build and engage our technical community around SGLang, Miles, and our open source infrastructure. SGLang already has 30K+ GitHub stars and serves billions of to…
Est. 144,000 USD
Key Responsibilities Product Strategy & Roadmap Define, prioritize, and drive the product roadmap for inference and training infrastructure. Stay ahead of AI trends, including new model architectures, hardware optimi…
Est. 300,000 USD
About the Role RadixArk is looking for a Member of Technical Staff — Backend/API Platform Engineer to build the API layer, control plane, and platform services that power SGLang and Miles in production. You'll design and…
Est. 165,000 USD
About the Role As a Technical Program Manager at RadixArk, you'll drive the execution of complex, cross-functional programs across our inference and training infrastructure. You'll partner closely with Product Management…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff, Developer Technology (DevTech) to make LLM inference and training dramatically faster, cheaper, and more accessible on modern GPU hardware. Our systems sit…
Est. 155,000 USD
About the Role RadixArk is seeking a Product Marketing Manager to own how SGLang, Miles, and our open source infrastructure are positioned and perceived across the market. SGLang already has 20K+ GitHub stars and serves…
Est. 300,000 USD
About the Role RadixArk is looking for a Member of Technical Staff Cluster Infrastructure to architect and scale the core compute platform that powers frontier-level AI training and inference. You will design and operate…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff — Kernel / Compiler / Communication to push the limits of performance for frontier AI systems. You will work at the lowest layers of the stack — kernels, run…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will work on the core systems that serve frontier models at scale, optimizing performance, la…
Est. 140,000 USD
About The Role RadixArk is launching a full-time, paid, 1-year residency program for aspiring AI infrastructure engineers. You'll rotate across inference, training, kernels, compilers, and cluster infrastructure, working…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff — Inference-Multimodal & Diffusion to advance the frontier of generative modeling. You will work on cutting-edge diffusion and flow-based models for imag…
Est. 300,000 USD
About the Role RadixArk is seeking a Member of Technical Staff - Inference-Multi-Hardware to push the limits of performance for frontier AI systems. Most performance engineering assumes a single vendor's stack. This role…
Est. 300,000 USD
About the Role RadixArk is hiring a Member of Technical Staff — Performance in Palo Alto, CA — someone who can push LLM inference and training systems to the limit across real production workloads. You’ll work on the per…
Est. 150,000 USD
About the Role We're looking for a Head of Business Development to build the BD function at RadixArk from the ground up. The BD team is the institutional memory of this company — maintaining active relationships across e…
Est. 300,000 USD
About the Role RadixArk is hiring a Member of Technical Staff — CI / Infrastructure to own the infrastructure that keeps SGLang moving. Our CI system runs 300+ GPU tests across NVIDIA, AMD, Intel, and Ascend hardware poo…
Est. 300,000 USD
About the Role As a Member of Technical Staff, Training, you will design, build, and operate the distributed systems behind large-scale model post-training — spanning training, inference, and orchestration, with a focus…
Est. 300,000 USD
About the Role RadixArk is looking for a Member of Technical Staff — TPU Systems to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU har…
Est. 159,000 USD
About the Role We're looking for a hands-on Talent Operations Specialist to build and run the machinery behind talent and people ops as we scale. This isn't a traditional HR generalist role - it's for someone who treats…
Est. 115,000 USD
About the Role RadixArk builds the open-source AI infrastructure behind SGLang and Miles, used by developers and enterprises around the world. We're looking for a visual designer to join our design team and to give our b…
Est. 310,000 USD
At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructu…
Est. 140,000 USD
(ID: 2025-1135) Axle is a bioscience and information technology company that offers advancements in translational research, biomedical informatics, and data science applications to research centers and healthcare organiz…
Est. 205,000 USD
Gradial is the marketing operations system of work that helps marketers and creatives move from idea to execution faster. Our platform orchestrates across martech stacks, workflows, and people to automate marketing execu…
Est. 328,650 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 175,000 USD
We’re looking for a Staff AI Engineer to lead the design and delivery of AI/ML systems. This role is ideal for an experienced engineer who thrives on architectural decisions, can confidently own systems end-to-end, and c…
Est. 140,000 USD
Who we are: At Arkana Laboratories, everyone has an important role to fill. Come join us and be a part of a team dedicated to making life better for those who need it most. This place is packed with super-smart people wh…
Est. 217,500 USD
Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with…
Est. 127,500 USD
Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with…
Est. 289,800 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 249,500 USD
About the role Hex is an AI-powered platform for modern Data Science and Data Analytics workflows. AI Research Engineers at Hex partner with product teams to build industry-leading AI experiences such as the Notebook Age…
Est. 235,200 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…