Design, build, deploy, and operate production-grade AI agents and RAG solutions. Lead end-to-end ALM: design, testing, CI/CD, security, and customer enablement. Deliver training, workshops, and on-site support while ensuring governance, performance, and adoption.
Role Summary
The AI Engineer designs, builds, deploys, and operates production-grade AI agents and AI-powered solutions for customers — and extends that engineering work into the enablement and training that drives real-world adoption. This is a senior, hands-on technical role spanning the full Application Lifecycle Management (ALM) lifecycle, with strong customer-facing capability across both delivery and enablement.
Key Responsibilities
- Design, build, test, deploy, and operate AI agents for customers using a combination of low-code and pro-code approaches
- Develop customer-facing AI solutions across the full ALM lifecycle, including design, development, testing, deployment, and ongoing iteration
- Build and integrate multi-model AI agents, selecting and orchestrating models based on use case, performance, and cost considerations
- Design and implement Retrieval-Augmented Generation (RAG) solutions, including document ingestion, vector databases, indexing strategies, and retrieval logic
- Configure and integrate MCP servers and related AI infrastructure components required for secure, scalable agent execution
- Implement secure authentication and authorization patterns for AI agents, including identity, permissions, and service-to-service access
- Collaborate with customers to understand business requirements and translate them into scalable AI agent designs
- Apply sound engineering practices including version control, environment management, testing strategies, and deployment automation
- Troubleshoot and optimize AI agents for performance, reliability, and accuracy
- Partner closely with security, data, and adoption teams to ensure AI solutions are safe, compliant, and aligned with governance requirements
- Translate the engineering work into customer enablement — designing and delivering technical training, workshops, labs, and demonstrations that help business users adopt the AI solutions you build
- Deliver enablement sessions both virtually and on-site, adapting depth and language for executive, technical, and frontline audiences
- Document architectures, designs, and operational considerations as part of customer deliverables and enablement assets
Required Experience & Qualifications
- 5+ years of experience in software engineering, application development, or AI/automation-focused engineering roles
- Hands-on experience building AI agents or AI-powered applications using low-code and pro-code frameworks
- Deep understanding of AI concepts and architectures, including model inference, orchestration, and agent design patterns
- Practical experience with MCP servers, agent runtimes, or equivalent AI execution frameworks
- Strong experience designing and implementing RAG architectures, including vector databases and retrieval pipelines
- Experience working with multi-model AI approaches, including selecting, integrating, and managing multiple models within a single solution
- Solid understanding of authentication, identity, and security controls in application and API design
- Experience applying ALM best practices including source control, CI/CD, environment promotion, and testing
- Ability to work directly with customers in solution design and delivery engagements
- Strong verbal communication and public speaking skills with the ability to confidently lead live workshops, demos, and training sessions
- Ability to translate complex or technical concepts into clear, practical learning experiences for non-technical audiences
- Comfort traveling for work and delivering on-site engagements as part of customer projects
- Strong problem-solving skills and comfort working in rapidly evolving technical domains
Preferred Qualifications
- Experience building AI solutions in Microsoft-centric environments, including Copilot or Azure-based AI services
- Familiarity with AI governance, data security, and responsible AI principles
- Experience integrating AI agents with enterprise data sources and business applications
- Background in platform engineering, cloud infrastructure, or distributed systems
- Consulting or professional services experience delivering customer-specific solutions
- Experience collaborating with security, data, and compliance teams during solution design
- Experience designing role-based or persona-driven enablement programs for technical and business audiences
- Background in change management, user adoption, or workforce enablement initiatives
- Experience supporting executive or leadership-level briefings and demonstrations
- Interest in evolving toward AI architecture, solution engineering, or principal-level technical roles
What Success Looks Like
- Production-grade AI agents and RAG solutions ship on time, perform reliably, and meet customer outcomes
- Customers see a single, credible technical lead from solution design through deployment and adoption
- Enablement materials and live sessions accelerate real-world usage of the AI solutions you deliver
- Engineering practices (ALM, security, governance) are applied consistently across engagements
- Customers and teams view you as a trusted technical authority on applied AI
Similar Jobs
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Take Deepgram's speech models and optimize, compile, and run them on resource-constrained embedded and edge hardware. Work across model compression, runtime performance (C/C++/Rust), RTOS/bare-metal and embedded Linux environments, vendor NPUs/DSPs and inference runtimes, benchmarking, deployment pipelines, OTA updates, and partner with silicon vendors to enable real-time, low-power on-device voice experiences.
Top Skills:
CC++Dsp ToolchainsEmbedded LinuxExecutorchFreertosKnowledge DistillationMicrocontroller/Soc DevelopmentModel CompilationNpu ToolchainsOnnx RuntimeOperator FusionPruningQuantizationRustTensorrtTfliteZephyr
Fintech • Machine Learning • Payments • Software • Financial Services
Lead design, development, deployment, and support of large-scale AI systems (foundation model training, LLM inference, similarity search, guardrails, evaluation, observability). Optimize LLM performance and scalability, partner with cross-functional teams, and contribute technical vision and roadmap for foundational AI systems.
Top Skills:
Aws UltraclustersC#C++GoHugging FaceJavaNemo GuardrailsPythonPyTorchScalaVectordbs
Insurance • Logistics • Software • Transportation • Business Intelligence
Build AI-augmented BI dashboards, semantic layers, and AI-ready metadata. Use AI-assisted tools to accelerate SQL and dashboard development, productionize ML outputs into BI, enforce data quality and governance, and present insights to business stakeholders including C-suite.
Top Skills:
AtlanChatgptClaude CodeEtl ToolsGithub CopilotLarge Language Models (Llms)Llm/Ai ApisLookerNosql DatabasesOpenmetadataPower BIPythonRag (Retrieval-Augmented Generation)RedashSemantic ViewsSnowflakeSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory



