Design, build, and optimize agentic AI solutions, including LLM prompts, agent workflows, MCP tools, tool-calling frameworks, RAG systems, and context orchestration. Develop evaluation methods, integrate enterprise systems and APIs, support deployment and monitoring, and ensure solutions meet security, governance, compliance, and responsible AI standards. The role is client-facing and involves collaboration across product, architecture, and engineering teams.
Job Description
AI Prompt Engineer / Agentic AI Engineer (3 ON, 3 Off)
Role Summary
- Role Type: Client-facing, hands-on engineering + solutioning (pre-sales through early delivery)
- Location: Major US hub (e.g., New York, Bay Area, Dallas, Chicago – flexible for the right candidate). Travel Expected.
- Level: Manager/Principal/Senior Principal
- Business Unit: (Enterprise AI Platforms & Agentic Solutions).
- Reporting to: Artificial Intelligence Leader, North America.
About Company:
Role summary
The resource will support the design, development, and delivery of Agentic AI solutions by creating, optimizing, and managing AI prompts, agent workflows, and MCP-integrated tools. The role will focus on enabling intelligent AI agents capable of autonomous reasoning, task orchestration, tool utilization, and workflow execution across enterprise applications.
Key Responsibilities
- Design, develop, and optimize prompts for Large Language Models (LLMs) to improve accuracy, reliability, and business outcomes.
- Build and configure Agentic AI solutions that leverage planning, reasoning, memory, and multi-step task execution capabilities.
- Develop and integrate MCP (Model Context Protocol) tools, enabling AIagents to securely discover and interact with enterprise systems, APIs, and data sources.
- Design agent architectures, tool-calling frameworks, retrieval mechanisms, and context management strategies.
- Collaborate with product managers, architects, and engineering teams to translate business requirements into AI-driven solutions.
- Implement Retrieval-Augmented Generation (RAG), knowledge grounding, and context orchestration patterns.
- Define evaluation frameworks and prompt testing methodologies to measure agent performance, quality, and reliability.
- Ensure AI solutions adhere to security, compliance, governance, and responsible AI standards.
- Support deployment, monitoring, troubleshooting, and continuous improvement of AI agents and MCP-enabled workflows.
- Contribute to architecture reviews, technical design documentation, and engineering best practices for AI platforms.
Required Skill
- Experience with Large Language Models (OpenAI, Azure OpenAI, Anthropic, Gemini, or equivalent).
- Strong understanding of prompt engineering, AI agent frameworks, and conversational AI systems.
- Experience building Agentic AI applications using Semantic Kernel, LangChain, LangGraph, AutoGen, CrewAI, or similar frameworks.
- Hands-on experience with MCP servers, tool integration, API orchestration, and enterprise system connectivity.
- Proficiency in Python, TypeScript, or similar programming languages.
- Familiarity with RAG architectures, vector databases, embeddings, and knowledge retrieval systems.
- Understanding of cloud platforms such as Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AI.
- Strong problem-solving, analytical, and collaboration skills.
Preferred Qualifications
- Experience building enterprise copilots, AI assistants, or autonomous agent ecosystems.
- Knowledge of AI governance, responsible AI, and security best practices.
- Experience integrating AI agents with healthcare, health records, or regulated industry systems
All your information will be kept confidential according to EEO guidelines.
Similar Jobs
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Leads enterprise strategy and operational execution across aerospace, defense, AI, hardware, software, and international growth. Responsibilities include strategic planning, portfolio tradeoff analysis, market sizing, competitive analysis, financial modeling, capital allocation, business case development, KPI tracking, performance reviews, root-cause analysis, and cross-functional execution. The role requires influencing senior stakeholders and translating strategic priorities into measurable outcomes.
Information Technology
Sell hybrid infrastructure services and products through the full enterprise sales lifecycle. Develop account strategies, identify and qualify opportunities, build client and partner relationships, coordinate internal technical resources, manage pipelines and forecasts, meet revenue and profit targets, and provide consultative sales support. The role also includes mentoring entry-level Solutions Executives, participating in industry events, and maintaining expertise across multiple infrastructure solution areas.
Top Skills:
Data ProtectionDatacenter NetworkingEnterprise NetworkingHyperconverged InfrastructureIbm PowerMainframeMainframe StorageSalesforceStorageWireless
Information Technology
Manages technology projects from scope validation through delivery, overseeing schedules, budgets, resources, risks, procurement, quality, documentation, and stakeholder communications. Acts as a consultant across engineering, sales, customers, and third-party teams while ensuring profitability and successful outcomes. Leads cross-functional teams, negotiates scope and changes, supports presales opportunities, mentors associate project managers, and applies Waterfall and Agile methodologies across cloud, security, infrastructure, and other technology projects.
Top Skills:
AgileCloudInfrastructureKanbanMS OfficeMicrosoft ProjectScrumSecurityWaterfall
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
