M
Metas Solutionsvia muse
AI Engineer
REMOTEPosted 1w ago
ML EngineerMid LevelFull-time#remote
About the Role
**Job Title:** **AI Engineer (Mid\-Level)**
About Us:
**Metas Solutions** excels in providing strategic consulting, program management, and data\-driven analytics to federal public health agencies. Our expertise enhances health systems and delivers measurable outcomes, helping agencies achieve their mission. We collaborate with federal partners to implement agile solutions for national public health initiatives, driving impactful changes through cutting\-edge programs that strengthen communities and promote well\-being. See www.metassolutions.com for further details about us and careers with Metas.
Job Description:
**Metas Solutions** has an ***"immediate opening"*** for a talented **AI Engineer Facilitator.** In this role, you will build, enhance, and support generative AI web applications, including retrieval\-based knowledge assistants, chatbots, and agent workflows. You will implement features, integrate enterprise data and services, troubleshoot issues, and improve application quality. You will work with senior AI engineers, architects, product owners, data engineers, and DevSecOps teams to deliver secure, maintainable production applications. assess and suggest areas of improvement and potential solutions.
Responsibilities:
* Build, enhance, and support production generative AI applications and web\-based AI solutions.
* Develop Python backend services and AI integrations using Azure OpenAI, Azure AI Foundry, and related Azure services.
* Implement RAG pipelines, including document processing, chunking, embeddings, search, context preparation, and source citations.
* Implement agent workflows using tool/function calling, structured outputs, conversation context, error handling, execution limits, and human review where needed.
* Integrate AI applications with APIs, enterprise data sources, databases, cloud services, and MCP\-based tools.
* Test and evaluate retrieval relevance, answer correctness and grounding, reliability, latency, and cost.
* Add logging, tracing, and metrics to monitor model calls, retrieval steps, tool execution, errors, and token usage.
* Troubleshoot application issues, fix defects, and support deployments and production monitoring.
* Participate in code reviews, document implementation decisions, and collaborate with engineering and DevSecOps teams.
Qualifications:
* 3\+ years of technical experience, including developing and supporting production software applications
* 1\+ year of hands\-on generative AI development, including RAG\-based assistants or chatbots
* Experience with Python backend development, including asynchronous APIs, using FastAPI, Pydantic, or comparable tools
* Experience with Git, code reviews, automated testing, CI/CD, and Agile team delivery
* Experience with Azure, including Azure OpenAI, Azure AI Search, and integration with databases and external services
* Ability to demonstrate agent workflow experience with tool calling, structured outputs, and context management using PydanticAI, Microsoft Agent Framework, LangGraph, Foundry Agent Service, or similar tools
* Ability to conduct LLM evaluation and troubleshooting using test datasets, logs, and traces to assess quality, latency, and cost
* Possession of hands\-on RAG experience with document processing, chunking, embeddings, vector or hybrid search, and citations
* Bachelor's degree in computer science, engineering, or a related field
Additional Qualifications:
* Experience with Langfuse, Pydantic Logfire, or similar AI observability tools, and OpenTelemetry
* Experience with advanced RAG, multi\-agent workflows, or MCP integrations
* Experience with Docker, Azure deployment services, or frontend development using React, Angular, or TypeScript
* Knowledge of open\-source LLM hosting using vLLM, SGLang, or similar frameworks
* Knowledge of LLM fine\-tuning and optimization, including PEFT, LoRA/QLoRA, and quantization
Security Requirements:
* Must be US Citizen and with the ability to obtain a US Government
About Us:
**Metas Solutions** excels in providing strategic consulting, program management, and data\-driven analytics to federal public health agencies. Our expertise enhances health systems and delivers measurable outcomes, helping agencies achieve their mission. We collaborate with federal partners to implement agile solutions for national public health initiatives, driving impactful changes through cutting\-edge programs that strengthen communities and promote well\-being. See www.metassolutions.com for further details about us and careers with Metas.
Job Description:
**Metas Solutions** has an ***"immediate opening"*** for a talented **AI Engineer Facilitator.** In this role, you will build, enhance, and support generative AI web applications, including retrieval\-based knowledge assistants, chatbots, and agent workflows. You will implement features, integrate enterprise data and services, troubleshoot issues, and improve application quality. You will work with senior AI engineers, architects, product owners, data engineers, and DevSecOps teams to deliver secure, maintainable production applications. assess and suggest areas of improvement and potential solutions.
Responsibilities:
* Build, enhance, and support production generative AI applications and web\-based AI solutions.
* Develop Python backend services and AI integrations using Azure OpenAI, Azure AI Foundry, and related Azure services.
* Implement RAG pipelines, including document processing, chunking, embeddings, search, context preparation, and source citations.
* Implement agent workflows using tool/function calling, structured outputs, conversation context, error handling, execution limits, and human review where needed.
* Integrate AI applications with APIs, enterprise data sources, databases, cloud services, and MCP\-based tools.
* Test and evaluate retrieval relevance, answer correctness and grounding, reliability, latency, and cost.
* Add logging, tracing, and metrics to monitor model calls, retrieval steps, tool execution, errors, and token usage.
* Troubleshoot application issues, fix defects, and support deployments and production monitoring.
* Participate in code reviews, document implementation decisions, and collaborate with engineering and DevSecOps teams.
Qualifications:
* 3\+ years of technical experience, including developing and supporting production software applications
* 1\+ year of hands\-on generative AI development, including RAG\-based assistants or chatbots
* Experience with Python backend development, including asynchronous APIs, using FastAPI, Pydantic, or comparable tools
* Experience with Git, code reviews, automated testing, CI/CD, and Agile team delivery
* Experience with Azure, including Azure OpenAI, Azure AI Search, and integration with databases and external services
* Ability to demonstrate agent workflow experience with tool calling, structured outputs, and context management using PydanticAI, Microsoft Agent Framework, LangGraph, Foundry Agent Service, or similar tools
* Ability to conduct LLM evaluation and troubleshooting using test datasets, logs, and traces to assess quality, latency, and cost
* Possession of hands\-on RAG experience with document processing, chunking, embeddings, vector or hybrid search, and citations
* Bachelor's degree in computer science, engineering, or a related field
Additional Qualifications:
* Experience with Langfuse, Pydantic Logfire, or similar AI observability tools, and OpenTelemetry
* Experience with advanced RAG, multi\-agent workflows, or MCP integrations
* Experience with Docker, Azure deployment services, or frontend development using React, Angular, or TypeScript
* Knowledge of open\-source LLM hosting using vLLM, SGLang, or similar frameworks
* Knowledge of LLM fine\-tuning and optimization, including PEFT, LoRA/QLoRA, and quantization
Security Requirements:
* Must be US Citizen and with the ability to obtain a US Government
Similar Jobs
C
Capital One• 1mo ago
Machine Learning Engineer 4 (IC)
McLean, VAFull-time
W
Waystone• 6mo ago
AI Engineer
Leeds, West YorkshireFull-time
A
Aderant• 1mo ago
AI Engineer – Center of Excellence
Atlanta, GAFull-time
S
Signifyd• 1mo ago
Senior Machine Learning Engineer I // II
Chicago, ILFull-time