S
Sign In Solutionvia muse
Enterprise AI Architect/Senior AI Solution Architect
REMOTE$160K - $175K/yrPosted 5d ago
ML EngineerSeniorFull-time#remote
About the Role
**Overview**
We are looking for a senior, hands\-on AI Architect to design, build and govern production\-grade Generative AI solutions for enterprise clients. You will combine deep data and application architecture expertise with practical LLM engineering: RAG, vector search, agentic patterns and multi\-model strategy across Anthropic, OpenAI and Gemini. You will own solutions end to end, from target\-state architecture and ARB approval through secure, governed delivery on cloud.
**Key Responsibilities**
* Define target\-state AI, data and application architectures, reference patterns and reusable accelerators for enterprise GenAI programs.
* Design and build RAG and agentic systems: ingestion, chunking, embeddings, hybrid retrieval, re\-ranking, grounding, evaluation and observability.
* Select and integrate LLMs (Anthropic Claude, OpenAI, Google Gemini) with sound model\-routing, cost, latency, safety and fallback strategies.
* Stay hands\-on: write and review code, build proofs of concept, set engineering standards and unblock delivery teams.
* Take architectures through Architecture Review Boards: prepare artifacts (ADRs, NFRs, logical and data architecture, integration flows), defend trade\-offs and secure approvals on time.
* Design security and access: RBAC/ABAC, identity integration, API management (APIM), secrets, network isolation, data classification, PII/PHI handling and audit trails
* Establish AI governance: prompt and model versioning, evaluation harnesses, guardrails, human\-in\-the\-loop controls, lineage and responsible\-AI practices.
* Partner with data engineering on pipelines, semantic layers, metadata and data quality that make enterprise data AI\-ready.
* Advise client executives and engineering leaders, mentor architects and engineers, and contribute to pre\-sales and solution shaping.
**Required Qualifications**
* **Experience: 11 to** 16 years in software, data and solution architecture, including at least 3 years designing and delivering production GenAI/LLM solutions.
* **Hands\-on engineering:** Strong Python (plus Java, TypeScript or similar), REST/GraphQL APIs and event\-driven integration. Current in code, not only diagrams.
* **RAG and vector search:** Demonstrated delivery of RAG systems with vector databases (e.g., Pinecone, pgvector, Azure AI Search, Vertex AI Vector Search, OpenSearch, Weaviate or Milvus). Retrieval quality tuning and evaluation.
* **LLM platforms:** Hands\-on with Anthropic, OpenAI and Gemini APIs, including tool/function calling, structured outputs, prompt engineering, context management and cost control.
* **Cloud:** Production experience on GCP (strongly preferred), Azure or AWS: compute and containers (Kubernetes), managed AI services (Vertex AI, Azure OpenAI/AI Foundry, Bedrock), storage, serverless and CI/CD.
* **Data architecture:** Data modelling, lakehouse/warehouse patterns, ingestion pipelines, metadata, lineage and data quality. Snowflake, BigQuery or Databricks experience.
* **Application architecture:** Microservices, API design, integration patterns, resilience and non\-functional requirements.
* **Security and governance:** RBAC, identity (OAuth2/OIDC, Entra ID, IAM), APIM gateways, encryption and compliance (e.g., HIPAA, GDPR, SOC 2\)
* **Architecture governance:** Proven track record presenting to and securing approval from ARBs, with clear ADRs and trade\-off analysis.
Pay: $160,000\.00 \- $175,000\.00 per year
Work Location: Remote
We are looking for a senior, hands\-on AI Architect to design, build and govern production\-grade Generative AI solutions for enterprise clients. You will combine deep data and application architecture expertise with practical LLM engineering: RAG, vector search, agentic patterns and multi\-model strategy across Anthropic, OpenAI and Gemini. You will own solutions end to end, from target\-state architecture and ARB approval through secure, governed delivery on cloud.
**Key Responsibilities**
* Define target\-state AI, data and application architectures, reference patterns and reusable accelerators for enterprise GenAI programs.
* Design and build RAG and agentic systems: ingestion, chunking, embeddings, hybrid retrieval, re\-ranking, grounding, evaluation and observability.
* Select and integrate LLMs (Anthropic Claude, OpenAI, Google Gemini) with sound model\-routing, cost, latency, safety and fallback strategies.
* Stay hands\-on: write and review code, build proofs of concept, set engineering standards and unblock delivery teams.
* Take architectures through Architecture Review Boards: prepare artifacts (ADRs, NFRs, logical and data architecture, integration flows), defend trade\-offs and secure approvals on time.
* Design security and access: RBAC/ABAC, identity integration, API management (APIM), secrets, network isolation, data classification, PII/PHI handling and audit trails
* Establish AI governance: prompt and model versioning, evaluation harnesses, guardrails, human\-in\-the\-loop controls, lineage and responsible\-AI practices.
* Partner with data engineering on pipelines, semantic layers, metadata and data quality that make enterprise data AI\-ready.
* Advise client executives and engineering leaders, mentor architects and engineers, and contribute to pre\-sales and solution shaping.
**Required Qualifications**
* **Experience: 11 to** 16 years in software, data and solution architecture, including at least 3 years designing and delivering production GenAI/LLM solutions.
* **Hands\-on engineering:** Strong Python (plus Java, TypeScript or similar), REST/GraphQL APIs and event\-driven integration. Current in code, not only diagrams.
* **RAG and vector search:** Demonstrated delivery of RAG systems with vector databases (e.g., Pinecone, pgvector, Azure AI Search, Vertex AI Vector Search, OpenSearch, Weaviate or Milvus). Retrieval quality tuning and evaluation.
* **LLM platforms:** Hands\-on with Anthropic, OpenAI and Gemini APIs, including tool/function calling, structured outputs, prompt engineering, context management and cost control.
* **Cloud:** Production experience on GCP (strongly preferred), Azure or AWS: compute and containers (Kubernetes), managed AI services (Vertex AI, Azure OpenAI/AI Foundry, Bedrock), storage, serverless and CI/CD.
* **Data architecture:** Data modelling, lakehouse/warehouse patterns, ingestion pipelines, metadata, lineage and data quality. Snowflake, BigQuery or Databricks experience.
* **Application architecture:** Microservices, API design, integration patterns, resilience and non\-functional requirements.
* **Security and governance:** RBAC, identity (OAuth2/OIDC, Entra ID, IAM), APIM gateways, encryption and compliance (e.g., HIPAA, GDPR, SOC 2\)
* **Architecture governance:** Proven track record presenting to and securing approval from ARBs, with clear ADRs and trade\-off analysis.
Pay: $160,000\.00 \- $175,000\.00 per year
Work Location: Remote
Similar Jobs
C
Capital One• 1mo ago
Machine Learning Engineer 4 (IC)
McLean, VAFull-time
W
Waystone• 6mo ago
AI Engineer
Leeds, West YorkshireFull-time
A
Aderant• 1mo ago
AI Engineer – Center of Excellence
Atlanta, GAFull-time
S
Signifyd• 1mo ago
Senior Machine Learning Engineer I // II
Chicago, ILFull-time