inhousefyi
← Back to listings

AI Runtime Engineer

EnCharge AIRemote · Posted Jul 10, 2025
Full-timeRemoteEst. 140,000 USD
Apply now

Description

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.

About the Role

EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments.

Responsibilities

  • Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
  • Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
  • Optimize data movement between host and device using PCIe, DMA, shared memory.
  • Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM
  • Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.
  • Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.
  • Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
  • 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.
  • Strong proficiency in C/C++ and low-level systems programming.
  • Deep understanding of task scheduling, concurrency, and memory hierarchy.
  • Experience with hardware-aware optimizations and dataflow architectures.
  • Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO).
  • Experience with low-latency, high-throughput workload execution for AI models.
  • Strong debugging and profiling skills for optimizing AI execution performance.
  • Exposure to AI model deployment pipelines (Triton, TensorFlow Serving).

EnchargeAI is an equal employment opportunity employer in the United States.

Similar jobs

EnCharge AIRemote

Est. 210,000 USD

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote
EnCharge AIRemote

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote
EnCharge AIRemote

Est. 222,500 USD

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-time
EnCharge AIRemote

Est. 225,000 USD

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote
EnCharge AIRemote

Est. 124,000 USD

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote
EnCharge AIRemote

Est. 210,000 USD

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote
EnCharge AIRemote

Est. 225,000 USD

EnCharge AI is building a new generation of AI compute systems designed to deliver dramatically higher energy efficiency for AI inference. Our technology combines innovative compute architectures with a full-stack softwa…

Full-timeRemote
EnCharge AIRemote

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote
EnCharge AIBangalore, India

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-time
EnCharge AIRemote

Est. 137,500 USD

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote
EnCharge AIUnited States

Est. 175,000 USD

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-time
Staff AI Engineer5 months ago
ChargePointBangalore, India

About Us With electric vehicles expected to be nearly 30% of new vehicle sales by 2025 and more than 50% by 2040, electric mobility is becoming a reality. ChargePoint (NYSE: CHPT) is at the center of this revolution, pow…

Full-time
Staff AI Engineer3 months ago
ChargePointBangalore, India

About Us With electric vehicles expected to be nearly 30% of new vehicle sales by 2025 and more than 50% by 2040, electric mobility is becoming a reality. ChargePoint (NYSE: CHPT) is at the center of this revolution, pow…

Full-time
EnCharge AIRemote

Est. 225,000 USD

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute…

Full-timeRemote
TenstorrentRemote

Est. 300,000 USD

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify inn…

Full-timeRemote
DensityAIMountain View, California, United States

Est. 285,000 USD

About the role You will write, evaluate, and profile specialized compute kernels that run on a custom AI accelerator. This is the critical interface between high-level ML workloads and silicon — your code directly determ…

Full-time
TenstorrentRemote

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify inn…

Full-timeRemote
FigureSan Jose, California, United States

Est. 227,500 USD

Figure is an AI robotics company developing autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of…

Full-time
TenstorrentAustin, Texas, United States

Est. 300,000 USD

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify inn…

Full-time
TenstorrentRemote

Est. 300,000 USD

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify inn…

Full-timeRemote
TenstorrentRemote

Est. 120,000 EUR

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify inn…

Full-timeRemote
TenstorrentRemote

Est. 300,000 USD

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify inn…

Full-timeRemote
AI Engineer9 months ago
Particle41Remote

AI Engineer Role Overview: As an AI Engineer at Particle41 you will design, develop and deploy machine-learning and deep-learning models/solutions (including generative-AI) that address complex business problems. You wil…

Full-timeRemote
AI Engineer2 months ago
Particle41Remote

Est. 141,000 USD

AI Engineer Role Overview: As an AI Engineer at Particle41 you will design, develop and deploy machine-learning and deep-learning models/solutions (including generative-AI) that address complex business problems. You wil…

Full-timeRemote
TenstorrentRemote

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify inn…

Full-timeRemote
Together AIRemote

Est. 120,000 EUR

AI Infrastructure Systems Engineer Hybrid at our office in Amsterdam or Remote in the UK. Build the infrastructure powering the next generation of AI. At Together AI, you’ll build and operate one of the world’s largest G…

Full-timeRemote
Ambiq Micro, Inc.Austin, Texas, United States

Est. 175,000 USD

Company Overview Ambiq is on a mission to enable intelligence everywhere — powering the AI edge revolution with the world's lowest-power semiconductor solutions. Built on our proprietary sub- and near-threshold technolog…

Full-time
TenstorrentCyprus

Est. 60,000 EUR

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify inn…

Full-time
TuringNew York, New York, United States

Est. 205,000 USD

About Turing Turing’s mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality datasets, reinforcement learni…

Full-time