A
AT&Tvia muse
Sr Specialist Software Engineering (AI Forward Deployed Engineer)
TS, INPosted 6d ago
ML EngineerSeniorFull-time
About the Role
**Experience**
8\+ years of relevant software engineering, cloud engineering, AI/ML engineering, platform engineering, or solution engineering experience, including hands\-on delivery of production\-grade Generative AI, RAG, or Agentic AI systems
**Key Responsibilities**
* Work directly with business and technical stakeholders to identify high\-value AI use cases and convert ambiguous requirements into production\-ready solutions.
* Design and build Generative AI, Retrieval\-Augmented Generation (RAG), Advanced RAG, and Agentic AI applications.
* Engineer retrieval pipelines covering document ingestion, parsing, chunking, metadata enrichment, embeddings, indexing, hybrid retrieval, reranking, grounding, and response generation.
* Build single\-agent and multi\-agent systems with planning, reasoning, tool calling, workflow orchestration, state management, memory, retries, exception handling, and human\-in\-the\-loop approvals.
* Develop and integrate Model Context Protocol (MCP) servers and clients to securely connect AI agents with enterprise tools, APIs, data sources, and workflows.
* Build reusable tools, functions, plugins, APIs, and connectors for structured and controlled agent execution.
* Develop AI\-enabled backend services and microservices using Python, FastAPI, Flask, REST APIs, asynchronous processing, and event\-driven patterns.
* Integrate AI solutions with enterprise applications, databases, SaaS platforms, cloud services, security platforms, and knowledge repositories.
* Apply prompt engineering and context engineering, including system prompts, few\-shot prompting, structured outputs, context compression, and conversation\-memory strategies.
* Build automated evaluation pipelines to measure retrieval quality, groundedness, faithfulness, answer relevance, hallucination, task completion, latency, security, token consumption, and cost.
* Implement LLMOps and GenAIOps practices covering model and prompt versioning, testing, deployment, tracing, observability, rollback, and production monitoring.
* Implement AI security guardrails against prompt injection, indirect prompt injection, jailbreaks, sensitive\-data disclosure, insecure tool execution, privilege escalation, and excessive agency.
* Rapidly develop proofs of concept and convert validated prototypes into secure, scalable, resilient, maintainable, and supportable enterprise applications.
* Troubleshoot complex AI, retrieval, application, data, API, cloud, and integration issues and drive them through root\-cause analysis and closure.
* Create technical designs, architecture diagrams, evaluation reports, runbooks, deployment documentation, and operational support procedures.
* Collaborate with Product Owners, Architects, Software Engineers, DevOps, Cybersecurity, Data Engineering, and business teams while maintaining clear delivery visibility.
**Required Technical Skills**
**Must Have**
* Strong programming experience in Python, including production\-grade backend and AI application development.
* Hands\-on experience building Generative AI and Large Language Model (LLM) applications using Azure OpenAI, OpenAI APIs, or equivalent enterprise model platforms.
* Strong experience with RAG and Advanced RAG patterns, including query rewriting, multi\-query retrieval, metadata filtering, hybrid search, reranking, contextual retrieval, citations, and grounded generation.
* Hands\-on experience with Agentic AI, AI agents, tool/function calling, structured outputs, agent orchestration, and multi\-agent workflows.
* Understanding of Model Context Protocol (MCP), including MCP hosts, clients, servers, tools, resources, prompts, authentication, authorization, and secure enterprise integration.
* Experience with prompt engineering and context engineering, including system instructions, few\-shot examples, context\-window management, memory, and output s
8\+ years of relevant software engineering, cloud engineering, AI/ML engineering, platform engineering, or solution engineering experience, including hands\-on delivery of production\-grade Generative AI, RAG, or Agentic AI systems
**Key Responsibilities**
* Work directly with business and technical stakeholders to identify high\-value AI use cases and convert ambiguous requirements into production\-ready solutions.
* Design and build Generative AI, Retrieval\-Augmented Generation (RAG), Advanced RAG, and Agentic AI applications.
* Engineer retrieval pipelines covering document ingestion, parsing, chunking, metadata enrichment, embeddings, indexing, hybrid retrieval, reranking, grounding, and response generation.
* Build single\-agent and multi\-agent systems with planning, reasoning, tool calling, workflow orchestration, state management, memory, retries, exception handling, and human\-in\-the\-loop approvals.
* Develop and integrate Model Context Protocol (MCP) servers and clients to securely connect AI agents with enterprise tools, APIs, data sources, and workflows.
* Build reusable tools, functions, plugins, APIs, and connectors for structured and controlled agent execution.
* Develop AI\-enabled backend services and microservices using Python, FastAPI, Flask, REST APIs, asynchronous processing, and event\-driven patterns.
* Integrate AI solutions with enterprise applications, databases, SaaS platforms, cloud services, security platforms, and knowledge repositories.
* Apply prompt engineering and context engineering, including system prompts, few\-shot prompting, structured outputs, context compression, and conversation\-memory strategies.
* Build automated evaluation pipelines to measure retrieval quality, groundedness, faithfulness, answer relevance, hallucination, task completion, latency, security, token consumption, and cost.
* Implement LLMOps and GenAIOps practices covering model and prompt versioning, testing, deployment, tracing, observability, rollback, and production monitoring.
* Implement AI security guardrails against prompt injection, indirect prompt injection, jailbreaks, sensitive\-data disclosure, insecure tool execution, privilege escalation, and excessive agency.
* Rapidly develop proofs of concept and convert validated prototypes into secure, scalable, resilient, maintainable, and supportable enterprise applications.
* Troubleshoot complex AI, retrieval, application, data, API, cloud, and integration issues and drive them through root\-cause analysis and closure.
* Create technical designs, architecture diagrams, evaluation reports, runbooks, deployment documentation, and operational support procedures.
* Collaborate with Product Owners, Architects, Software Engineers, DevOps, Cybersecurity, Data Engineering, and business teams while maintaining clear delivery visibility.
**Required Technical Skills**
**Must Have**
* Strong programming experience in Python, including production\-grade backend and AI application development.
* Hands\-on experience building Generative AI and Large Language Model (LLM) applications using Azure OpenAI, OpenAI APIs, or equivalent enterprise model platforms.
* Strong experience with RAG and Advanced RAG patterns, including query rewriting, multi\-query retrieval, metadata filtering, hybrid search, reranking, contextual retrieval, citations, and grounded generation.
* Hands\-on experience with Agentic AI, AI agents, tool/function calling, structured outputs, agent orchestration, and multi\-agent workflows.
* Understanding of Model Context Protocol (MCP), including MCP hosts, clients, servers, tools, resources, prompts, authentication, authorization, and secure enterprise integration.
* Experience with prompt engineering and context engineering, including system instructions, few\-shot examples, context\-window management, memory, and output s
Similar Jobs
C
Capital One• 1mo ago
Machine Learning Engineer 4 (IC)
McLean, VAFull-time
W
Waystone• 6mo ago
AI Engineer
Leeds, West YorkshireFull-time
A
Aderant• 1mo ago
AI Engineer – Center of Excellence
Atlanta, GAFull-time
S
Signifyd• 1mo ago
Senior Machine Learning Engineer I // II
Chicago, ILFull-time