AgileEngine Logo

AgileEngine

AI Platform Context Lead ID84742

Posted Yesterday
Be an Early Applicant
In-Office
New York, NY, USA
Senior level
In-Office
New York, NY, USA
Senior level
Lead development of an enterprise AI context and knowledge platform spanning knowledge graphs, semantic retrieval, RAG, and AI agent integrations. Own retrieval quality, context governance, evaluation, security, access controls, connectors, and platform reliability. Partner with stakeholders to build production-ready agents, workflows, and self-service tooling across Slack, Google Workspace, Glean, and AI assistants. Provide technical leadership, troubleshooting, documentation, incident response, and continuous improvement across enterprise AI capabilities.
The summary above was generated by AI
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE
We are looking for an AI Platform Context Lead to build the context and knowledge layer behind an enterprise AI ecosystem. The role combines knowledge-graph design, semantic retrieval, RAG, and agent integrations across Slack, Google Workspace, Glean, and AI assistants. You will improve answer quality through evaluation, governance, and reusable self-service patterns.

The mandatory requirements are 6+ years of development experience with hands-on Tech Lead experience, end-to-end ownership of enterprise knowledge or retrieval architectures, proven experience building production AI agents using MCP and RAG, and an upper-intermediate English level.

WHAT YOU WILL DO
- Design, curate, and continuously improve the company context and knowledge graph that grounds search and agent responses, managing schema, coverage, freshness, and retrieval quality as an ongoing responsibility rather than a one-time build, with a stated accuracy and efficiency baseline that improves over time.
- Review agent and skill outputs to catch cases where a result missed user intent because the underlying context was missing or wrong, and turn those findings into a prioritized backlog of fixes so that intent-breaking context gaps are resolved rather than left to resurface.
- Maintain enough cross-team visibility that a systemic context gap gets fixed once, architecturally, instead of being patched repeatedly.
- Partner with subject-matter experts to design, build, test, and maintain AI agents, skills, prompts, and workflows using MCP, function calling, and comparable frameworks.
- Decide whether a need is best solved by a skill, workflow, connector, or knowledge-graph grounding, based on where the logic belongs rather than what is fastest to ship.
- Translate platform strategy into technical designs, integrations, and implementation plans, and turn pilots into reliable, production-ready capabilities by evaluating platform capabilities.
- Ensure implementations are scalable, secure, and aligned with organizational standards.
- Build and maintain connectors, APIs, and RAG/semantic-search patterns while preserving source-system permissions.
- Build and maintain the discovery tooling and question sets other teams use to scope new AI use cases on their own, reducing the hands-on involvement required from this role.
- Enable functional groups to curate and maintain their own context in the way that works best for them through tooling, patterns, and guidance, rather than one-size-fits-all mandates.
- Establish testing and evaluation practices for agent output quality, reliability, and safety.
- Configure, administer, and maintain Slack, Google Workspace/Gemini, Glean, and other AI assistants.
- Apply access-management, monitoring, and change-control best practices, and troubleshoot complex platform issues.
- Implement technical controls for access, data retention, and sensitive-data handling in partnership with security, privacy, and compliance teams.
- Flag connectors needing elevated or write access early, during design, and route them to security for review.
- Maintain technical documentation, runbooks, and vendor coordination.
- Maintain incident-response and service-continuity procedures.
- Drive continuous improvement in platform reliability, search quality, and cost efficiency over time.

MUST HAVES
- You must be authorized to work for ANY employer in the US (e.g., Green card holders, TN visa holders, GC EAD, H4 EAD, U4U with EAD), as we are unable to sponsor or take over employment visa sponsorship at this time;
- 6+ years of experience in development roles, with hands-on experience as a Tech Lead.
- Has designed and/or owned a knowledge graph or enterprise context/retrieval architecture end to end, not merely queried one that someone else built.
- Demonstrated experience building production-quality AI agents, skills, or integrations using MCP, function calling, RAG, and enterprise search.
- Can distinguish "wrong retrieval" from "right retrieval, missing context" in an eval trace, and prioritize fixes by business impact.
- Hands-on experience administering or engineering enterprise SaaS, search, or AI platforms (e.g., Slack, Google Workspace, Glean, Claude, ChatGPT).
- Strong systems-administration background, including identity/access management, configuration, monitoring, and incident response.
- Experience working across multiple business functions, with the ability to turn "what should we ask before we start" into a checklist others can use unsupervised.
- Strong troubleshooting, technical writing, and stakeholder-communication skills, with the ability to lead through influence without direct authority.
- Upper-intermediate English level.

PERKS AND BENEFITS
- Professional growth: Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: USD-based pay with education, fitness, and team activity budgets.
- Exciting projects: Modern solutions with Fortune 500 and top product companies.
- Flextime: Flexible schedule with remote and office options.

Similar Jobs

52 Minutes Ago
In-Office or Remote
10003, New York, NY, USA
114K-180K Annually
Entry level
114K-180K Annually
Entry level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Serve as a pre-sales technical expert for DX, partnering with Account Executives throughout the sales cycle. Lead technical discovery, evaluations, proof-of-concepts, pilots, product demonstrations, and solution design involving APIs and client engineering workflows. Advise prospects on deployment and analytics integrations, translate technical concepts into business value, and relay customer feedback to Product and Engineering teams. Manage technical follow-ups across multiple opportunities.
Top Skills: APIsCi/CdGitGithub CliRestRubyRuby On RailsSQL
52 Minutes Ago
In-Office or Remote
10003, New York, NY, USA
123K-193K Annually
Mid level
123K-193K Annually
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Drive enterprise adoption of Atlassian’s Rovo AI platform through discovery workshops, custom agent design, connector configuration, production deployment, and customer enablement. Partner with enterprise teams to identify valuable AI use cases, translate business needs into technical solutions, measure outcomes, and support independent scaling. Collaborate with account teams, CSMs, product, engineering, and AI teams to improve adoption and customer value. Travel up to 15% domestically and internationally.
Top Skills: Ai AgentsAtlassianConfluenceGitGoogle DriveJIRAPrompt EngineeringRovoRovo StudioSharepointSlackThird-Party Connectors
52 Minutes Ago
In-Office or Remote
10003, New York, NY, USA
Entry level
Entry level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Responsible for acquiring new enterprise customers for Atlassian. The role is a remote, full-time sales position available in select U.S. locations within Atlassian’s distributed-first work model.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account