C
Concentrixvia muse
Senior AI/ML Engineer – SLM Optimization & Inference
REMOTE$145K - $171K/yrPosted 2w ago
ML EngineerSeniorFull-time#remote
About the Role
**Position Summary**
**Senior AI/ML Engineer – SLM Optimization \& Inference**
We are looking for a hands\-on Senior AI/ML Engineer to fine\-tune, optimize, and deploy Small Language Models, with a focus on Alibaba Qwen models and production\-ready inference performance. In this role, you will help improve model quality, latency, throughput, and GPU efficiency while contributing to real\-time audio intelligence pipelines for high\-performance, low\-latency applications.
This is an opportunity for a senior\-level AI/ML engineer who enjoys working close to the model, the infrastructure, and the performance benchmarks—building scalable ML systems that are ready for production.
**Responsibilities**
* Fine\-tune and optimize Small Language Models, particularly Alibaba Qwen models, for domain\-specific use cases.
* Improve model performance across key metrics, including accuracy, precision, recall, latency, and inference throughput.
* Optimize model serving using vLLM, SGLang, or similar high\-performance inference engines.
* Implement advanced inference optimization techniques, including GPU memory optimization, KV\-cache management, quantization, and efficient batching.
* Develop, enhance, and optimize real\-time audio intelligence pipelines for low\-latency processing.
* Benchmark, profile, and tune models for production\-scale deployment.
* Collaborate with engineering and data teams to evaluate model behavior, identify bottlenecks, and improve end\-to\-end ML system performance.
* Build reliable, scalable ML workflows that support high\-throughput, low\-latency AI applications.
* Apply senior\-level technical judgment to balance model quality, infrastructure efficiency, and production performance requirements.
**Qualifications**
* Strong hands\-on experience with PyTorch, Hugging Face Transformers, and LLM/SLM fine\-tuning techniques such as LoRA, QLoRA, and PEFT.
* Practical experience using vLLM or SGLang for high\-performance model inference.
* Deep understanding of GPU utilization, CUDA fundamentals, KV caching, and memory optimization.
* Experience evaluating and improving model precision, recall, latency, throughput, and inference performance.
* Strong Python programming and ML engineering skills.
* Proven ability to benchmark, debug, and optimize models for production environments.
* Experience fine\-tuning and deploying Alibaba Qwen models is preferred.
* Experience with real\-time audio AI, speech recognition, ASR, or audio classification is preferred.
* Experience optimizing AI models for high\-throughput, low\-latency production environments is preferred.
* Ability to work hands\-on across both SLM model training/fine\-tuning and GPU inference optimization.
* Strong collaboration skills with the ability to partner effectively across engineering and data teams.
The base salary for this position is $ 144,964\-$ 171,321 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies. Benefits available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.
The deadline to apply for this position is: 11/04/2026\. This position is for an existing, immediate vacancy. We are currently seeking to fill this role with an individual who can start as soon as possible.
As part of the hiring process, candidates may be required to undergo background screening and identity verification, where permitted by applicable law and consistent with the requirements of the role. Certain verification processes used by the Company or its service providers may involve technologies that rely on biometric identifiers or biometric information, where permitted by law. If biometric identifiers or biometric information are collected, used, or stored, the Comp
**Senior AI/ML Engineer – SLM Optimization \& Inference**
We are looking for a hands\-on Senior AI/ML Engineer to fine\-tune, optimize, and deploy Small Language Models, with a focus on Alibaba Qwen models and production\-ready inference performance. In this role, you will help improve model quality, latency, throughput, and GPU efficiency while contributing to real\-time audio intelligence pipelines for high\-performance, low\-latency applications.
This is an opportunity for a senior\-level AI/ML engineer who enjoys working close to the model, the infrastructure, and the performance benchmarks—building scalable ML systems that are ready for production.
**Responsibilities**
* Fine\-tune and optimize Small Language Models, particularly Alibaba Qwen models, for domain\-specific use cases.
* Improve model performance across key metrics, including accuracy, precision, recall, latency, and inference throughput.
* Optimize model serving using vLLM, SGLang, or similar high\-performance inference engines.
* Implement advanced inference optimization techniques, including GPU memory optimization, KV\-cache management, quantization, and efficient batching.
* Develop, enhance, and optimize real\-time audio intelligence pipelines for low\-latency processing.
* Benchmark, profile, and tune models for production\-scale deployment.
* Collaborate with engineering and data teams to evaluate model behavior, identify bottlenecks, and improve end\-to\-end ML system performance.
* Build reliable, scalable ML workflows that support high\-throughput, low\-latency AI applications.
* Apply senior\-level technical judgment to balance model quality, infrastructure efficiency, and production performance requirements.
**Qualifications**
* Strong hands\-on experience with PyTorch, Hugging Face Transformers, and LLM/SLM fine\-tuning techniques such as LoRA, QLoRA, and PEFT.
* Practical experience using vLLM or SGLang for high\-performance model inference.
* Deep understanding of GPU utilization, CUDA fundamentals, KV caching, and memory optimization.
* Experience evaluating and improving model precision, recall, latency, throughput, and inference performance.
* Strong Python programming and ML engineering skills.
* Proven ability to benchmark, debug, and optimize models for production environments.
* Experience fine\-tuning and deploying Alibaba Qwen models is preferred.
* Experience with real\-time audio AI, speech recognition, ASR, or audio classification is preferred.
* Experience optimizing AI models for high\-throughput, low\-latency production environments is preferred.
* Ability to work hands\-on across both SLM model training/fine\-tuning and GPU inference optimization.
* Strong collaboration skills with the ability to partner effectively across engineering and data teams.
The base salary for this position is $ 144,964\-$ 171,321 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies. Benefits available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.
The deadline to apply for this position is: 11/04/2026\. This position is for an existing, immediate vacancy. We are currently seeking to fill this role with an individual who can start as soon as possible.
As part of the hiring process, candidates may be required to undergo background screening and identity verification, where permitted by applicable law and consistent with the requirements of the role. Certain verification processes used by the Company or its service providers may involve technologies that rely on biometric identifiers or biometric information, where permitted by law. If biometric identifiers or biometric information are collected, used, or stored, the Comp
Similar Jobs
C
Capital One• 1mo ago
Machine Learning Engineer 4 (IC)
McLean, VAFull-time
W
Waystone• 6mo ago
AI Engineer
Leeds, West YorkshireFull-time
A
Aderant• 1mo ago
AI Engineer – Center of Excellence
Atlanta, GAFull-time
S
Signifyd• 1mo ago
Senior Machine Learning Engineer I // II
Chicago, ILFull-time