Standard Template Labs Logo

Standard Template Labs

Principal Software Engineer

Reposted One Month Ago
In-Office
New York, NY, USA
Expert/Leader
In-Office
New York, NY, USA
Expert/Leader

STLabs is an AI service management platform that resolves employee requests end-to-end, grounded in a living model of the enterprise. This matters because we're able to resolve requests with full context - the people, systems, services, and policies that define how an organization actually runs. Requests that used to take days of back-and-forth resolve in minutes, right where employees already work.

About the Role

We’re looking for a Principal Software Engineer, Full-Stack AI to own the end-to-end technical vision for how intelligence is designed, built, and experienced across our platform - from data ingestion and model reasoning to APIs, user interfaces, and real-world operational impact.

This is a deeply hands-on role for a senior technical leader who thrives at the intersection of AI systems, distributed infrastructure, and product-grade software engineering. You will architect and ship production AI systems, build scalable backend and data platforms, and work across the stack to ensure AI capabilities are observable, trustworthy, and intuitive for enterprise users.

You’ll help us define what “applied, full-stack AI” means at Standard Template Labs: designing reasoning pipelines, operationalizing LLMs and agents, shaping human-in-the-loop experiences, and building the platform primitives that allow intelligence to be embedded - not bolted on - across every workflow. You’ll mentor senior engineers, influence product direction, and help establish an engineering culture where AI, systems design, and user experience are tightly integrated.

ResponsibilitiesAI-Native Architecture & Technical Strategy
  • Architect the core intelligence layer of the platform, spanning data ingestion, embeddings, retrieval, graph reasoning, agents, and real-time inference.

  • Define how LLMs and predictive models integrate across backend services, APIs, and user-facing experiences.

  • Identify high-impact opportunities where generative, predictive, or autonomous AI can eliminate operational toil, improve system understanding, or enhance decision-making.

  • Lead architectural decisions around model selection, evaluation, fine-tuning, and inference infrastructure (custom vs OSS vs managed APIs).

  • Establish best practices for AI-first engineering, including prompt and schema design, context assembly, evaluators, guardrails, observability, and continuous model monitoring.

  • Partner with product and leadership to align AI capabilities with customer outcomes, trust requirements, and long-term platform strategy.

Full-Stack Applied AI Development
  • Build end-to-end AI-powered features - from backend reasoning services to APIs and user-facing workflows.

  • Design and implement production-grade LLM and agent workflows, including automated enrichment, anomaly explanation, topology discovery, change impact analysis, and natural language querying.

  • Develop scalable backend systems for high-throughput inference, embedding generation, vector search, and graph traversal.

  • Collaborate on or directly contribute to frontend experiences that make AI outputs understandable, actionable, and debuggable for users (e.g., explanations, confidence signals, provenance, and feedback loops).

  • Implement retrieval-augmented generation (RAG) pipelines and hybrid search systems that combine structured data, graphs, and unstructured context.

  • Write clean, well-structured, production-quality code—and champion AI-assisted development tools (Claude, Cursor, Windsurf, etc.) to improve velocity and correctness.

  • Continuously evaluate emerging AI frameworks, agent runtimes, orchestration tools, and model APIs, integrating them where they drive real user value.

Data, Infrastructure & Platform Foundations
  • Design data models and pipelines that support learning, reasoning, and traceability across the platform.

  • Build and evolve distributed systems that are observable, fault-tolerant, and cost-efficient under AI workloads.

  • Partner with infrastructure and DevOps teams to shape deployment, scaling, monitoring, and rollback strategies for AI-driven services.

  • Ensure AI systems meet enterprise requirements for reliability, security, explainability, and compliance.

Mentorship, Influence & Technical Leadership
  • Mentor engineers on full-stack AI patterns, system design for AI workloads, and practical approaches to shipping intelligent features.

  • Lead architecture reviews and technical deep-dives focused on reliability, safety, performance, and user trust.

  • Influence engineering standards and culture, emphasizing craftsmanship, clarity, and ownership across the stack.

  • Help attract and develop top-tier engineering talent excited about AI-native, product-driven systems.

 
Qualifications
  • 10+ years of professional software engineering experience, including technical leadership in complex, high-scale systems.

  • Proven experience architecting and shipping distributed systems with meaningful AI, automation, or intelligent decisioning components.

  • Hands-on experience with LLMs, embeddings, vector databases, RAG pipelines, agent frameworks, or model integration patterns.

  • Strong system design skills across APIs, data modeling, event-driven architectures, caching, storage, and performance optimization.

  • Comfort working across the stack, including backend services and collaboration on user-facing or API-layer design.

  • Proficiency in at least one modern programming language (Go, Rust, Python, Java, or C++).

  • Experience mentoring senior engineers and driving engineering best practices.

  • Familiarity with AI-assisted development workflows and modern DevOps/tooling.

 
Nice to Have
  • Experience operationalizing ML or LLM workloads in production at scale.

  • Background in microservices, event-driven systems, or real-time data pipelines.

  • Exposure to frontend frameworks or strong product intuition around AI UX.

  • Experience with high-throughput, low-latency, or mission-critical systems.

  • Open-source contributions or demonstrated technical leadership in distributed systems or AI tooling.

 
Why This Role

This is a rare opportunity to define and build the foundations of a truly AI-native, full-stack enterprise platform—one where intelligence spans data, infrastructure, and user experience, and where reasoning systems are core to how customers understand and operate their technology.

You won’t just integrate models - you’ll shape how humans and intelligent systems collaborate at scale.

 
What We Offer
  • The opportunity to architect foundational systems for an AI-first enterprise platform.

  • Ownership over critical, high-impact systems that scale to millions of users.

  • A culture that values craftsmanship, autonomy, and technical excellence.

  • Competitive compensation, equity, and a comprehensive benefits package.

As an equal opportunity employer, we don’t tolerate discrimination or harassment of any kind. Whether that’s based on race, ethnicity, age, gender identity, citizenship, religion, sexual orientation, disability, pregnancy, veteran status or any other protected characteristic as outlined by federal, state or local laws. The reasonably estimated yearly salary for this role at is: $200,000—$250,000 USD.

HQ

Standard Template Labs New York, New York, USA Office

Flatiron District

Similar Jobs

Yesterday
Hybrid
2 Locations
Senior level
Senior level
Financial Services
Own LLM inference optimization across production workloads, including benchmarking, quantization, speculative decoding, GPU efficiency, inference engine evaluations, KV-cache optimization, and chaos engineering. Partner with platform teams on large-scale AWS GPU serving architectures, establish performance standards, and communicate technical trade-offs to senior leadership. Lead secure, governed adoption of agentic AI engineering workflows and automation across teams.
Top Skills: Amazon EksAwqAWSDcgmFp8GptqGpu InfrastructureGuidellmInt4Int8Kv CacheLlm-DNvmlSglangSpeculative DecodingTensorrt-LlmVllmXid Event Tracking
2 Days Ago
Remote or Hybrid
New York, NY, USA
221K-387K Annually
Expert/Leader
221K-387K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build and deploy production-grade AI agents, assistants, reusable skills, and agentic workflows. Develop rapid MVPs, partner with engineering on production hardening, integrate models and tools, and establish rigorous evaluation for quality, safety, and reliability. Apply secure-by-design controls, document solutions, select frameworks and cloud services, and advise teams through the AI Center of Excellence.
Top Skills: AWSAzureClaude SdkDockerGCPGoogle Ai SdkKubernetesOpenai SdkPython
4 Days Ago
Hybrid
New York, NY, USA
Expert/Leader
Expert/Leader
Financial Services
Develop and enhance production-quality derivatives pricing models, risk analytics, and quantitative tools on JPMorganChase’s Athena Python platform. Partner with portfolio managers, traders, quants, and technology stakeholders across rates, credit, and equities. Support trade lifecycle analytics, troubleshooting, hedging, and risk aggregation while creating reusable software frameworks. Lead agentic AI-enabled engineering workflows with appropriate security, resiliency, validation, and governance controls.
Top Skills: Agentic AiAi-Assisted Software DevelopmentAthenaC#C++Derivatives PricingJavaPythonQuantitative Analytics

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account