J
J2B GLOBAL LLCvia muse
Senior Java AI Engineer – Generative AI & RAG
Lake Mary, FL, USPosted 5d ago
ML EngineerSeniorFull-time
About the Role
### **Senior Java AI Engineer – Generative AI \& RAG**
ContractC2CW2
Lake Mary, FL
Visa: US CitizenGreen CardGC\-EAD
We are seeking experienced Senior / Lead Java AI Engineers to design, develop, and deploy enterprise Generative AI solutions. The ideal candidate will have strong hands\-on experience in Java, Spring Boot, LLMs, prompt engineering, OpenAI, Azure AI, and Retrieval\-Augmented Generation (RAG). The role requires a combination of hands\-on engineering, solution design, AI security, and technical leadership. Key Responsibilities \- Design and develop enterprise\-grade AI applications using Java, Spring Boot, REST APIs, and microservices. \- Integrate LLM and Generative AI capabilities into enterprise applications and business workflows. \- Develop and optimize system prompts, few\-shot prompts, reusable prompt templates, structured outputs, and context\-management strategies. \- Integrate applications with OpenAI APIs, Azure OpenAI, Azure AI services, Azure AI Foundry, and other frontier AI models. \- Design and implement RAG solutions using embeddings, vector search, document retrieval, grounding, and citation patterns. \- Evaluate and optimize models and prompts for accuracy, groundedness, latency, scalability, security, and cost. \- Implement AI security controls to mitigate prompt injection, hallucinations, sensitive\-data exposure, and unauthorized access. \- Build production\-ready logging, tracing, monitoring, observability, fallback, and error\-handling mechanisms. \- Lead architecture discussions, code reviews, technical troubleshooting, and production issue resolution. \- Collaborate with business, product, architecture, and engineering stakeholders to move AI solutions from proof of concept to production. \- Mentor engineers and establish reusable standards for secure AI integration and application development. Required Technical Skills \- Overall Experience: 10\+ years of enterprise software or application development experience. \- Java \& Spring Boot: Strong hands\-on experience with Java, Spring Boot, REST APIs, and microservices. \- Generative AI / LLM: Hands\-on experience developing and delivering LLM\-based applications and production GenAI solutions. \- Prompt Engineering: Strong knowledge of system prompts, few\-shot prompting, prompt optimization, structured outputs, and context management. \- OpenAI / Azure AI: Experience integrating OpenAI APIs, Azure OpenAI, Azure AI services, or Azure AI Foundry. \- RAG: Experience with embeddings, vector search, vector databases, retrieval, grounding, and document processing. \- Frontier Models: Ability to integrate and evaluate modern frontier AI models and model APIs. \- Oracle \& SQL: Working experience with Oracle, SQL, data\-access layers, and enterprise persistence patterns. \- AI Security: Understanding of AI security, data privacy, access control, prompt\-injection mitigation, and responsible AI practices. \- DevOps \& Cloud: Working knowledge of Git, CI/CD, Docker, Kubernetes, and cloud deployment. \- Technical Leadership: Strong stakeholder communication, architecture, mentoring, and technical decision\-making skills. Preferred Skills \- Experience with AI agents, tool/function calling, orchestration frameworks, and structured model outputs. \- Experience developing LLM evaluation frameworks and monitoring model quality, groundedness, latency, token usage, and cost. \- Experience deploying AI\-enabled microservices in regulated or large\-scale enterprise environments. \- Familiarity with Azure DevOps, GitHub, Maven or Gradle, and automated deployment pipelines. Expected Candidate Profile \- Should be approximately 60–70% hands\-on in engineering, with the ability to independently own solution design and delivery. \- Must be able to explain end\-to\-end LLM or RAG architecture, including associated security controls. \- Should have delivered at least one Generative AI use case from proof of concept toward production deployment. \- Comfortable wor
ContractC2CW2
Lake Mary, FL
Visa: US CitizenGreen CardGC\-EAD
We are seeking experienced Senior / Lead Java AI Engineers to design, develop, and deploy enterprise Generative AI solutions. The ideal candidate will have strong hands\-on experience in Java, Spring Boot, LLMs, prompt engineering, OpenAI, Azure AI, and Retrieval\-Augmented Generation (RAG). The role requires a combination of hands\-on engineering, solution design, AI security, and technical leadership. Key Responsibilities \- Design and develop enterprise\-grade AI applications using Java, Spring Boot, REST APIs, and microservices. \- Integrate LLM and Generative AI capabilities into enterprise applications and business workflows. \- Develop and optimize system prompts, few\-shot prompts, reusable prompt templates, structured outputs, and context\-management strategies. \- Integrate applications with OpenAI APIs, Azure OpenAI, Azure AI services, Azure AI Foundry, and other frontier AI models. \- Design and implement RAG solutions using embeddings, vector search, document retrieval, grounding, and citation patterns. \- Evaluate and optimize models and prompts for accuracy, groundedness, latency, scalability, security, and cost. \- Implement AI security controls to mitigate prompt injection, hallucinations, sensitive\-data exposure, and unauthorized access. \- Build production\-ready logging, tracing, monitoring, observability, fallback, and error\-handling mechanisms. \- Lead architecture discussions, code reviews, technical troubleshooting, and production issue resolution. \- Collaborate with business, product, architecture, and engineering stakeholders to move AI solutions from proof of concept to production. \- Mentor engineers and establish reusable standards for secure AI integration and application development. Required Technical Skills \- Overall Experience: 10\+ years of enterprise software or application development experience. \- Java \& Spring Boot: Strong hands\-on experience with Java, Spring Boot, REST APIs, and microservices. \- Generative AI / LLM: Hands\-on experience developing and delivering LLM\-based applications and production GenAI solutions. \- Prompt Engineering: Strong knowledge of system prompts, few\-shot prompting, prompt optimization, structured outputs, and context management. \- OpenAI / Azure AI: Experience integrating OpenAI APIs, Azure OpenAI, Azure AI services, or Azure AI Foundry. \- RAG: Experience with embeddings, vector search, vector databases, retrieval, grounding, and document processing. \- Frontier Models: Ability to integrate and evaluate modern frontier AI models and model APIs. \- Oracle \& SQL: Working experience with Oracle, SQL, data\-access layers, and enterprise persistence patterns. \- AI Security: Understanding of AI security, data privacy, access control, prompt\-injection mitigation, and responsible AI practices. \- DevOps \& Cloud: Working knowledge of Git, CI/CD, Docker, Kubernetes, and cloud deployment. \- Technical Leadership: Strong stakeholder communication, architecture, mentoring, and technical decision\-making skills. Preferred Skills \- Experience with AI agents, tool/function calling, orchestration frameworks, and structured model outputs. \- Experience developing LLM evaluation frameworks and monitoring model quality, groundedness, latency, token usage, and cost. \- Experience deploying AI\-enabled microservices in regulated or large\-scale enterprise environments. \- Familiarity with Azure DevOps, GitHub, Maven or Gradle, and automated deployment pipelines. Expected Candidate Profile \- Should be approximately 60–70% hands\-on in engineering, with the ability to independently own solution design and delivery. \- Must be able to explain end\-to\-end LLM or RAG architecture, including associated security controls. \- Should have delivered at least one Generative AI use case from proof of concept toward production deployment. \- Comfortable wor
Similar Jobs
C
Capital One• 1mo ago
Machine Learning Engineer 4 (IC)
McLean, VAFull-time
W
Waystone• 6mo ago
AI Engineer
Leeds, West YorkshireFull-time
A
Aderant• 1mo ago
AI Engineer – Center of Excellence
Atlanta, GAFull-time
S
Signifyd• 1mo ago
Senior Machine Learning Engineer I // II
Chicago, ILFull-time