ServiceNow Logo

ServiceNow

Staff Software Engineer, Agentic Systems - Moveworks

Posted An Hour Ago
Be an Early Applicant
Hybrid
Mountain View, CA
Senior level
Hybrid
Mountain View, CA
Senior level
Build and own runtime infrastructure for agentic AI: orchestration engine, distributed session management, event-driven pipelines, structured concurrency, observability, and caching/state layers to support long-running agent sessions at scale.
The summary above was generated by AI
Company Description

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

 

Job Description

The Role

We're building the runtime infrastructure that powers Moveworks' AI agents — the systems that orchestrate, execute, and deliver agent responses to millions of enterprise users in real time. This is not an ML role. This is a distributed systems engineering role at the heart of the agentic AI wave.

Our AI agents can plan, execute multi-step workflows, call tools, wait on human input, and resume — all while maintaining correctness, observability, and low latency. The systems that make this possible are what you'll build and own.

What you get to do in this role:

  • Agent orchestration engine — A state machine that manages long-running agent sessions, coordinating planning, execution, and user interaction across multiple LLM calls and tool invocations
  • Distributed session management — Lease-based ownership using DynamoDB conditional writes, heartbeat protocols, and crash recovery via checkpointing
  • Event-driven message pipeline — SQS FIFO queues for ordered delivery, Kafka consumers for event processing, and real-time streaming via gRPC and Socket.IO
  • Structured concurrency — Python asyncio TaskGroups running multiple concurrent tasks per session (message polling, lease heartbeats, output publishing, orchestrator execution) with fail-fast semantics and graceful cancellation
  • Observability infrastructure — OpenTelemetry instrumentation, distributed trace context propagation across async boundaries, custom span lifecycle management for sessions that span minutes
  • Caching and state layers — Redis, DynamoDB KV stores with per-org/per-bot scoping, batch read optimization, and hot-reload configuration

Qualifications

To be successful in this role you have:

You should have deep experience in at least 3 of these areas:

  • Distributed systems: consistency models, idempotency, exactly-once delivery, distributed locking/leasing
  • Concurrent/async programming: Python asyncio, Go goroutines, structured concurrency, cancellation handling
  • Event-driven architectures: message queues (SQS, Kafka), pub/sub, backpressure, delivery guarantees
  • Database systems for infrastructure: DynamoDB (conditional writes, transactions), Redis (connection pooling, pub/sub)
  • Observability: OpenTelemetry, distributed tracing, span context propagation, Prometheus metrics
  • gRPC/protobuf: streaming RPCs, service interface design, error handling patterns

Required:

  • 7+ years building production backend/infrastructure systems
  • Strong in Python or Go (ideally both)
  • Experience designing and operating systems that handle real traffic at scale
  • Comfort with ambiguity — these are novel problems without textbook solutions

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity,  veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.  

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. 

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. 

From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

ServiceNow New York, New York, USA Office

50 Hudson Yards, New York, NY, United States, 10001

Similar Jobs at ServiceNow

6 Days Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build and own runtime infrastructure for agentic AI: orchestration engine, distributed session management, event-driven pipelines, structured concurrency, observability, and caching/state layers to support long-running, low-latency agent sessions at scale.
Top Skills: DynamoDBGoGrpcKafkaOpentelemetryPrometheusProtobufPythonPython AsyncioRedisSocket.IoSqs Fifo
An Hour Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design and productionize scalable AI agent systems using LLMs. Work on agent orchestration, sandboxed execution, latency optimization, agent memory, enterprise knowledge graphs, and multimodal I/O. Mentor engineers, collaborate with ML, security, product, and UX teams, and deliver production-grade, performant code to improve the Moveworks AI Assistant platform.
Top Skills: Ai AgentsGoJavaKnowledge GraphsLlmsmacOSMultimodal I/OOpenaiPython
An Hour Ago
Hybrid
167K-291K Annually
Expert/Leader
167K-291K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead go-to-market strategy and field enablement for ServiceNow Asset Management portfolio. Create scalable positioning, demos, playbooks, and AI-powered workflows; partner with field, product, and customers to drive adoption, expansion, and measurable outcomes while synthesizing field feedback into product improvements.
Top Skills: Ai ToolsCloudFinopsServicenow

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account