Principal AI Architect

Position : AI Principal Architect Location: Santa Clara, CA or New Jersey – Hybrid Employment: Full-Time Permanent (Direct Hire) Experience: 15+ Years Mandatory Skills Agentic AI | Generative AI | Large Language Models (LLMs) | Multi-Agent Architecture | RAG | Azure OpenAI | Vertex AI | AWS Bedrock | Azure | AWS | GCP | AI Architecture | Kubernetes | LangChain | LlamaIndex | Semantic Kernel Job Description We are seeking an experienced AI Principal Architect to define enterprise AI strategy and lead the design of scalable, secure, and production-ready Generative AI and Agentic AI solutions. This role combines deep technical expertise with executive-level advisory, driving AI architecture, governance, and enterprise adoption across hybrid cloud environments. Key Responsibilities Define architecture and best practices for Agentic AI , Multi-Agent Systems , and enterprise AI platforms. Design scalable RAG (Retrieval-Augmented Generation) and Cache-Augmented Generation (CAG) architectures, including vector search, embeddings, retrieval strategies, and evaluation frameworks. Architect AI memory systems using vector databases, knowledge graphs, and session memory. Design secure AI solutions across Azure, AWS, and GCP , leveraging platforms such as Azure OpenAI, Vertex AI, and AWS Bedrock . Establish standards for GenAIOps , CI/CD, Infrastructure as Code (IaC), observability, monitoring, and AI performance metrics. Define enterprise AI governance, including NIST AI RMF, ISO 42001 , prompt security, PII protection, hallucination mitigation, and Human-in-the-Loop (HITL) controls. Architect integrations with enterprise platforms including Microsoft Entra ID, Teams, Dynamics 365, Salesforce, ERP systems, and Kubernetes . Lead executive workshops, advise senior stakeholders on AI strategy, and translate business objectives into scalable AI solutions. Mentor architects and engineering teams while contributing to AI standards, best practices, and technology roadmaps. Represent the organization through industry events, technical publications, and AI thought leadership. Required Skills 12+ years of technical leadership in software engineering, enterprise architecture, or cloud architecture. Strong expertise in Azure, AWS, or GCP , with hands-on experience across multiple cloud platforms. Experience designing enterprise GenAI and LLM solutions using Azure OpenAI, Vertex AI, or AWS Bedrock . Hands-on expertise in RAG architectures, LLM orchestration, and AI solution design . Experience with instruction tuning or fine-tuning of Large Language Models. Strong executive communication and stakeholder management skills. Preferred Skills Multi-Agent AI architecture and orchestration. LangChain, LlamaIndex, Semantic Kernel , or similar AI frameworks. GenAIOps, AI FinOps, model routing, and AI governance. AI security, compliance, and responsible AI frameworks. Professional cloud certifications (Azure, AWS, or GCP). Conference speaking, technical publications, patents, or open-source contributions. Show more Show less