LTS Logo

LTS

Senior Applied AI Engineer

Reposted One Month Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Design, prototype, and productionize applied AI capabilities (LLMs, RAG, agents) to improve reasoning, explainability, and developer productivity. Optimize retrieval, embeddings, multi-agent workflows, and evaluation frameworks; build benchmarks and diagnostics. Collaborate with architects and engineers to ingest enterprise knowledge, refine semantic search, and transition experiments into FedRAMP-aligned production for federal healthcare modernization.
The summary above was generated by AI

Location: United States – Remote
Clearance: Ability to obtain and maintain a Public Trust
Salary Range: 144K - 184K

LTS is seeking a highly skilled Senior Applied AI Engineer to focus on continuously improving the intelligence behind the platform. You'll experiment with models, optimize retrieval strategies, refine agent reasoning, evaluate AI performance, and transform emerging AI capabilities into production-ready solutions.

The Agentic AI platform is designed to help engineers understand, analyze, and modernize one of the most consequential legacy software systems still operating today.

Our platform enables engineers to ask questions in plain English and receive explainable, verifiable answers traced directly back to decades of production source code. Rather than replacing engineers, we're building AI that accelerates engineering through transparency, traceability, and intelligent reasoning.

We're building an AI-native engineering platform supporting the modernization of mission-critical healthcare systems serving millions of Veterans nationwide.

The platform is designed for deployment across federal enterprise environments and is being engineered to align with FedRAMP security controls, Zero Trust principles, and federal compliance requirements.

The platform has executive sponsorship, committed users, and a customer investing in long-term modernization. Our engineering team is intentionally small giving every engineer meaningful ownership, and direct influence over product direction.

We don't simply build AI-powered software—we build software with AI. This is not another chatbot.

Using LLMs, autonomous agents, AI-assisted development, parallel workflows, and model-driven engineering is simply how we work.

What You’ll Do:

Advance Applied AI Capabilities

  • Design, prototype, and implement production-ready AI capabilities that improve reasoning, accuracy, explainability, and developer productivity.
  • Evaluate emerging LLMs, multimodal models, agent frameworks, and AI techniques to identify opportunities for platform advancement.
  • Rapidly prototype new AI capabilities and transition successful experiments into production.

Optimize Agent Performance

  • Improve autonomous and multi-agent workflows through prompt engineering, reasoning optimization, memory strategies, tool selection, and context management.
  • Continuously refine Retrieval-Augmented Generation (RAG) pipelines, retrieval strategies, embeddings, reranking, and grounding techniques.
  • Improve AI response quality through experimentation, benchmarking, and iterative optimization.

Evaluate AI Systems

  • Develop evaluation frameworks that measure accuracy, groundedness, explainability, latency, and overall AI effectiveness.
  • Build benchmark datasets, automated evaluation pipelines, and performance metrics for production AI systems.
  • Analyze AI failures, hallucinations, retrieval gaps, and reasoning errors to drive continuous improvement.

Knowledge Engineer

  • Collaborate with software engineers to improve knowledge ingestion, document processing, semantic search, embeddings, and enterprise knowledge management.
  • Design approaches that maximize retrieval quality across large technical documentation and source code repositories.
  • Improve how AI agents discover, organize, and reason over enterprise knowledge.

Collaborate Across Engineer

  • Partner closely with AI architects, platform engineers, software engineers, and front-end engineers to improve the overall intelligence of the platform.
  • Share research findings, experimental results, and engineering recommendations with cross-functional teams.
  • Help establish best practices for experimentation, evaluation, and AI quality throughout the organization.

What We’re Looking For:

  • Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Software Engineering, Engineering, Data Science, or a related technical discipline (or equivalent professional experience).
  • 5+ years of applied AI, or AI systems development experience.
  • 7 to 10+ years of software engineering, and machine learning experience.
  • Demonstrated experience developing production AI applications powered by Large Language Models (LLMs).
  • Experience designing and optimizing Retrieval-Augmented Generation (RAG) systems.
  • Experience with prompt engineering, embeddings, semantic search, vector databases, and knowledge retrieval.
  • Experience evaluating AI model performance and implementing experimentation frameworks.
  • Strong programming skills in Python/TypeScript and experience with modern software engineering practices.
  • Experience with AI frameworks such as LangGraph, LangChain, LlamaIndex, Semantic Kernel, CrewAI, AutoGen, or similar.
  • Experience with using AI coding assistants as part of your daily workflow.
  • Familiarity with REST APIs, cloud-native applications, and distributed software systems.
  • Strong analytical, problem-solving, and communication skills.
  • Intellect and curiosity for AI systems and how they behave.
  • Deep passion for experimenting with new AI techniques.
  • Background in evaluation, explainability, and continuous improvement.
  • Proven success with ownership of difficult technical challenges and collaboration across disciplines.

Nice to Have:

  • Experience optimizing autonomous or multi-agent AI systems.
  • Experience implementing automated AI evaluation frameworks.
  • Experience with OpenAI, Azure OpenAI, Anthropic Claude, Google Vertex AI, AWS Bedrock, or open-source LLMs.
  • Experience with vector databases including Pinecone, Weaviate, Qdrant, Milvus, or Azure AI Search.
  • Experience with Responsible AI, AI governance, safety, and explainability.
  • Familiarity with software engineering tools, code intelligence platforms, or developer productivity solutions.
  • Experience supporting healthcare, Federal Government, or other highly regulated environments.
  • Experience using AI coding assistants and autonomous agents as part of daily software development.

What’s In It for You?

  • The Opportunity to support high-visibility federal missions
  • A culture that values innovation, growth, and collaboration
  • Access to cutting-edge tools and technologies
  • Comprehensive benefits for you and your family
  • A career path that rewards ambition and performance

If you’re ready to push boundaries, sharpen your skills, and join a team that is passionate about building what’s next, we’d love to meet you. Apply today and let’s build a future together!

LTS shares salary ranges to promote transparency. Compensation ranges are provided for informational purposes, and final compensation may vary based on experience, skills, location, and role requirements.

LTS is committed to offering eligible employees comprehensive benefits that will provide them with options intended to meet their needs and the needs of their family.

Similar Jobs

21 Days Ago
Remote
United States
242K-288K Annually
Senior level
242K-288K Annually
Senior level
Healthtech • Social Impact • Software • Telehealth
Develop and operate production ML and AI systems powering patient experiences such as matching, ranking, recommendations, onboarding, and personalization. Build reusable ML infrastructure, pipelines, evaluation, observability, and model-serving capabilities. Provide technical leadership across the ML lifecycle, guide architecture, evaluate custom versus foundation-model approaches, and partner with ML and Patient Engineering teams to deliver reliable, scalable AI products.
Top Skills: Artificial IntelligenceExperimentationFeature EngineeringFoundation ModelsGenerative AiMachine LearningMatching SystemsMl InfrastructureMl PipelinesModel EvaluationModel ServingModel TrainingObservabilityPersonalization SystemsPythonRanking SystemsRecommendation SystemsSearch Systems
5 Days Ago
Remote
United States
165K-205K Annually
Senior level
165K-205K Annually
Senior level
Healthtech • Pharmaceutical
Build and ship production LLM capabilities on AWS Bedrock for clinical, client success, and member experience teams. Develop OCR, extraction, summarization, retrieval, decision-support, and workflow automation features; establish AI evaluations and reliability practices; and build Python/FastAPI applications with MySQL, AWS, and server-rendered front ends. Maintain healthcare data integrations, testing, CI, PHI protections, and clear technical documentation.
Top Skills: Alpine.JsAWSAws BedrockClaude CodeEmbeddingsFastapiGpusHipaaJinja2KiroKnowledge BasesLinuxLlamaLlmsMistralMySQLNcpdp D.0OcrOllamaPhiPostgresPrompt EngineeringPythonQuantizationQwenRetrievalScikit-LearnSftpSoc 2Structured OutputTailwindTgiVllmWindowsX12 270/271Xgboost
12 Days Ago
In-Office or Remote
Mid level
Mid level
Artificial Intelligence • Cloud • Information Technology • Machine Learning
Build and maintain AI-powered healthcare products for patient engagement, care coordination, and claims management. Develop full-stack software, APIs, backend services, automation pipelines, and LLM integrations using Claude Code. Apply software engineering, DevOps, and MLOps practices for testing, deployment, monitoring, security, and performance. Collaborate with product, design, engineering, and clinical stakeholders in a remote Agile environment.
Top Skills: Ai AgentsAi Orchestration FrameworksAnthropic ApisAPIsAWSAzureCi/CdClaude CodeCodexCursorDevOpsDockerEmbeddingsGenerative AiGCPJavaScriptKubernetesLlmsMlopsOpenai ApisPrompt EngineeringPythonRetrieval Augmented Generation (Rag)Semantic SearchTypescriptVector Databases

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account