Generative AI Engineer

Staff Generative AI Engineer |||| New York City, NY | Remote (US) Base Salary: $250,000 – $300,000 + Equity + Comprehensive Benefits We're exclusively partnering with one of the most technically ambitious AI companies in the US. This isn't another organization experimenting with generative AI. Our client is building production systems where AI sits at the core of the product, not as a feature, but as the foundation. As they continue to invest in their engineering organization, we're conducting a search for an exceptional Staff AI Engineer to help design, build and scale the next generation of intelligent software. This opportunity will suit engineers who enjoy solving complex technical problems across large language models, distributed systems, backend engineering and applied machine learning. If you've built production AI systems that customers rely on, not simply internal prototypes, we'd like to speak with you. What You'll Be Working On You'll operate across the full AI engineering lifecycle, helping architect, build and optimise production systems powered by frontier language models. Projects are likely to include: Designing production grade LLM applications Building autonomous and multi agent AI systems Developing Retrieval Augmented Generation (RAG) pipelines Architecting scalable AI infrastructure Implementing model evaluation and benchmarking frameworks Building high performance inference pipelines Optimising latency, reliability and throughput Designing APIs and backend services supporting AI workloads Integrating foundation models into customer facing products Collaborating with engineering and product leadership on long term technical strategy Technical Environment The engineering team works with a modern AI stack that includes technologies such as: Python • PyTorch • FastAPI • Transformers • OpenAI • Anthropic Claude • Gemini • Llama • LangGraph • LangChain • DSPy • Model Context Protocol (MCP) • RAG • Vector Databases • Pinecone • Weaviate • Qdrant • Milvus • Redis • PostgreSQL • Docker • Kubernetes • AWS • Google Cloud Platform (GCP) • GitHub Actions • CI/CD • vLLM • SGLang We're Interested In Engineers Who Have Built production AI or machine learning systems Designed scalable backend services Worked extensively with large language models Delivered commercial AI products from concept through deployment Strong Python software engineering experience Experience working within cloud-native environments A solid understanding of distributed systems Experience improving model quality through evaluation rather than intuition A pragmatic approach to balancing experimentation with reliability Additional experience with fine tuning, reinforcement learning, model optimisation, GPU inference, LoRA, RLHF or open source AI frameworks would be advantageous. What Makes Someone Successful Here The strongest engineers we've placed into similar environments tend to have several of the following characteristics: They build before they're asked. They care about engineering quality as much as model performance. They understand that shipping reliable software matters just as much as training great models. They stay close to the latest developments across the AI ecosystem without chasing every new framework. They enjoy solving problems that don't yet have well-documented solutions. Compensation & Benefits Base salary of $250,000–$300,000 Meaningful equity participation Comprehensive medical, dental and vision coverage Remote working within the United States New York City office for those who prefer a hybrid environment Premium hardware and engineering tooling High levels of autonomy Direct influence over architecture and technical direction About the Search This appointment is being managed exclusively by Fudo Partners. Show more Show less