P
Positron AIvia muse
Performance & Debug Software Engineer – AI Inference
REMOTE$200K - $300K/yrPosted 1w ago
ML EngineerMid LevelFull-time#remote
About the Role
**About Positron AI**
=====================
Positron AI is building next\-generation AI inference accelerators designed from the ground up for low\-latency, high\-throughput large language model inference. Our first\-generation ASIC, Asimov, is a cutting\-edge accelerator targeting frontier AI workloads, with additional generations already underway.
**Role Overview**
=================
This engineer will improve end\-to\-end large language model (LLM) inference performance on Positron's custom AI accelerators, including our FPGA\-based Atlas systems and our Titan systems built on the Asimov ASIC. The work spans hardware\-accelerated attention, accelerator tuning, distributed KV cache, and scalable inference serving architectures. It covers profiling, algorithms, GPU\-side data preparation, host\-to\-device data movement, runtime behavior, and measurement on production\-relevant models.
You will join a small, performance\-focused team that is expected to optimize the whole stack, and not merely tune isolated kernel interfaces. The goal is to sustain a repeatable path from observing workload symptoms to identifying root causes and creating measured improvements.
**Key Responsibilities**
------------------------
### **Performance Profiling and Optimization**
* Profile and optimize latency, throughput, utilization, and efficiency across hardware\-accelerated attention, accelerator configuration, the device runtime, host software, and on\-device execution.
* Use performance counters, hardware and software traces, telemetry, and simulation to isolate regressions and validate fixes.
### **Distributed Inference and KV Cache**
* Develop and optimize distributed inference capabilities, including efficient KV cache management and data movement across heterogeneous hardware.
### **Benchmarking and Test Infrastructure**
* Build representative benchmarks and workload traces that expose bottlenecks in compute, memory, chip\-to\-chip interconnect, networking, scheduling, and model loading.
* Partner with test engineers embedded in the team to turn performance findings into durable regression tests and release gates.
### **Architecture Influence**
* Influence hardware and software architecture and interfaces where measured performance reveals a structural limitation.
**Required Qualifications**
---------------------------
* Strong C\+\+ and Python skills, with hands\-on experience profiling and optimizing complex systems that exercise Linux VFIO interfaces..
* Deep understanding of memory hierarchy, concurrency, data movement, batching, scheduling, and performance measurement.
* Hands\-on experience using profilers, counters, traces, and statistical methods to distinguish signal from noise.
* Demonstrated ability to debug across application, runtime, driver, firmware, and hardware boundaries.
* Experience bringing up software on new silicon, and debugging and analyzing performance optimizations in customer production deployments.
* Enthusiasm for AI\-accelerated software development, including using coding agents and orchestrating subagents to move faster without compromising engineering outcomes.
**Preferred Qualifications**
----------------------------
* Experience with CUDA, HIP, Triton, GPU kernel development, distributed inference, or KV cache systems.
* Familiarity with transformer inference, mixture\-of\-experts (MoE) models, model serving, FPGA or ASIC accelerators.
* Working knowledge of Perfetto, Linux perf, eBPF, simulation, or hardware performance counters.
### **Leveling \& Scope**
While this role is currently posted at a specific level, we are a growth\-oriented organization and are open to hiring at a more senior level for the right candidate. Please note that this job description serves as a focused but generalized overview of the role; specific responsibilities and impact expectations will be tailored to the experience and seniority of the final hire.
**What Success Looks Like**
----------------------
=====================
Positron AI is building next\-generation AI inference accelerators designed from the ground up for low\-latency, high\-throughput large language model inference. Our first\-generation ASIC, Asimov, is a cutting\-edge accelerator targeting frontier AI workloads, with additional generations already underway.
**Role Overview**
=================
This engineer will improve end\-to\-end large language model (LLM) inference performance on Positron's custom AI accelerators, including our FPGA\-based Atlas systems and our Titan systems built on the Asimov ASIC. The work spans hardware\-accelerated attention, accelerator tuning, distributed KV cache, and scalable inference serving architectures. It covers profiling, algorithms, GPU\-side data preparation, host\-to\-device data movement, runtime behavior, and measurement on production\-relevant models.
You will join a small, performance\-focused team that is expected to optimize the whole stack, and not merely tune isolated kernel interfaces. The goal is to sustain a repeatable path from observing workload symptoms to identifying root causes and creating measured improvements.
**Key Responsibilities**
------------------------
### **Performance Profiling and Optimization**
* Profile and optimize latency, throughput, utilization, and efficiency across hardware\-accelerated attention, accelerator configuration, the device runtime, host software, and on\-device execution.
* Use performance counters, hardware and software traces, telemetry, and simulation to isolate regressions and validate fixes.
### **Distributed Inference and KV Cache**
* Develop and optimize distributed inference capabilities, including efficient KV cache management and data movement across heterogeneous hardware.
### **Benchmarking and Test Infrastructure**
* Build representative benchmarks and workload traces that expose bottlenecks in compute, memory, chip\-to\-chip interconnect, networking, scheduling, and model loading.
* Partner with test engineers embedded in the team to turn performance findings into durable regression tests and release gates.
### **Architecture Influence**
* Influence hardware and software architecture and interfaces where measured performance reveals a structural limitation.
**Required Qualifications**
---------------------------
* Strong C\+\+ and Python skills, with hands\-on experience profiling and optimizing complex systems that exercise Linux VFIO interfaces..
* Deep understanding of memory hierarchy, concurrency, data movement, batching, scheduling, and performance measurement.
* Hands\-on experience using profilers, counters, traces, and statistical methods to distinguish signal from noise.
* Demonstrated ability to debug across application, runtime, driver, firmware, and hardware boundaries.
* Experience bringing up software on new silicon, and debugging and analyzing performance optimizations in customer production deployments.
* Enthusiasm for AI\-accelerated software development, including using coding agents and orchestrating subagents to move faster without compromising engineering outcomes.
**Preferred Qualifications**
----------------------------
* Experience with CUDA, HIP, Triton, GPU kernel development, distributed inference, or KV cache systems.
* Familiarity with transformer inference, mixture\-of\-experts (MoE) models, model serving, FPGA or ASIC accelerators.
* Working knowledge of Perfetto, Linux perf, eBPF, simulation, or hardware performance counters.
### **Leveling \& Scope**
While this role is currently posted at a specific level, we are a growth\-oriented organization and are open to hiring at a more senior level for the right candidate. Please note that this job description serves as a focused but generalized overview of the role; specific responsibilities and impact expectations will be tailored to the experience and seniority of the final hire.
**What Success Looks Like**
----------------------
Similar Jobs
C
Capital One• 1mo ago
Machine Learning Engineer 4 (IC)
McLean, VAFull-time
W
Waystone• 6mo ago
AI Engineer
Leeds, West YorkshireFull-time
A
Aderant• 1mo ago
AI Engineer – Center of Excellence
Atlanta, GAFull-time
S
Signifyd• 1mo ago
Senior Machine Learning Engineer I // II
Chicago, ILFull-time