ServiceNow Logo

ServiceNow

Staff Software Engineer

Posted 2 Hours Ago
Be an Early Applicant
Hybrid
Santa Clara, CA
Expert/Leader
Hybrid
Santa Clara, CA
Expert/Leader
Lead architecture, development, deployment, and production support for complex AI-native and cloud-native systems on the ServiceNow platform. Build LLM integrations, agentic workflows, retrieval pipelines, evaluation frameworks, data pipelines, and ServiceNow applications using Python, Java, and JavaScript. Mentor engineers, make platform-level technical decisions, troubleshoot distributed and probabilistic systems, collaborate with customers and product teams, and promote secure, reliable, responsible AI engineering practices.
The summary above was generated by AI
Company Description

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

 

Job Description

This role is for a staff engineer who independently leads the design, development, and delivery of complex, high-impact AI-native and cloud-native systems. The IC4 engineer takes ownership of critical components or features, sets technical direction within their domain, and serves as a technical resource to peers and junior engineers. They combine deep software engineering fundamentals with hands-on expertise in AI/ML integration, cloud architecture, and production systems. This role requires the ability to balance technical depth with organizational impact, working across teams to solve ambiguous problems and drive platform improvements.

Responsibility Area: Technical Leadership & Architecture
•    Lead the design and architecture of complex, production-critical AI-native systems, including LLM integrations, agentic workflows, retrieval pipelines, and inference services
•    Own end-to-end delivery of medium-to-large features or systems, including specification, design, implementation, testing, deployment, and production monitoring
•    Make informed architectural and technical trade-off decisions between latency, cost, scalability, reliability, and model quality
•    Establish evaluation frameworks, testing strategies, and production monitoring for AI-driven features; drive adoption of eval-driven development practices
•    Design and optimize high-performance data pipelines, embedding systems, and vector stores handling millions of rows and complex retrieval scenarios
•    Champion security best practices, including prompt-injection defense, data privacy, PII handling, responsible AI guardrails, and compliance with regulatory requirements
•    Participate in architectural reviews across teams and contribute to platform-level technical decisions
•    Stay current with emerging AI/ML frameworks, services, and techniques; evaluate and recommend adoption where applicable

Responsibility Area: Mentorship & Technical Influence
•    Mentor junior and mid-level engineers (IC2/IC3) through pair programming, design reviews, architecture discussions, and hands-on coaching
•    Conduct thorough code reviews, including evaluation of prompts, agent logic, retrieval strategies, and AI/model behavior validation
•    Identify technical debt and improvement opportunities; advocate for and lead initiatives to address them
•    Share knowledge through documentation, brown-bag sessions, and architectural guidance
•    Contribute to hiring and interview processes; provide technical assessment and feedback on engineering candidates
•    Model best practices in software craftsmanship, testing discipline, and debugging methodology
•    Support onboarding of new team members and ensure knowledge transfer across projects

Responsibility Area: Cross-Functional Collaboration & Communication
•    Work closely with product management, domain specialists, and other engineering teams to define requirements and technical specifications
•    Translate complex technical concepts and AI trade-offs for non-technical stakeholders (product, leadership, customers)
•    Lead root cause analysis for customer-reported issues, including those involving model behavior, hallucinations, retrieval quality, and distributed system complexity
•    Participate in design reviews, technical planning sessions, and retrospectives; contribute perspectives on technical feasibility and risk
•    Communicate clearly about design decisions, implementation challenges, AI limitations, and production incidents
•    Build and maintain relationships with adjacent teams and external partners where applicable
•    Proactively identify opportunities to improve development processes, tooling, and team efficiency

Responsibility Area: Software Development Excellence
•    Develop robust, maintainable, and well-tested AI-native software using Python, Java, and JavaScript as appropriate
•    Build comprehensive unit tests, integration tests, and AI evaluation harnesses (accuracy, regression, hallucination detection)
•    Troubleshoot complex issues in distributed systems, probabilistic models, and cloud infrastructure; isolate root causes efficiently
•    Implement secure coding practices and responsible AI guardrails throughout the development lifecycle
•    Manage deployment, monitoring, and iteration of features in production; respond to performance issues and model drift
•    Work with cloud services (AWS/GCP/Azure), managed AI services (Bedrock, Vertex AI, Azure OpenAI), Kubernetes, and CI/CD pipelines
•    Contribute to code and architecture standards; ensure adherence to established best practices

Responsibility Area: ServiceNow Platform Development
•    Design and develop custom applications, extensions, and integrations on the ServiceNow platform
•    Develop workflows, business rules, and automation using ServiceNow scripting (JavaScript, GlideScript, REST APIs)
•    Build data models, forms, and dashboards for ServiceNow applications; optimize database queries for performance
•    Integrate third-party AI/ML services and custom APIs with ServiceNow platform services
•    Contribute to and maintain ServiceNow plugin and app architecture; follow ServiceNow best practices and coding standards
•    Participate in ServiceNow upgrades and configuration management; ensure compatibility with platform updates
•    Mentor junior engineers on ServiceNow platform capabilities and development patterns

Responsibility Area: Customer Support & Product Excellence
•    Participate in customer issue triage and root cause analysis for production ServiceNow application issues
•    Work closely with customer success and support teams to understand and resolve complex technical issues
•    Provide technical guidance to customers on application usage, configuration, and troubleshooting
•    Identify patterns in customer issues and drive improvements to prevent recurrence
•    Contribute to customer documentation and internal knowledge bases
•    Support customer escalations; provide timely resolutions to critical issues affecting customer operations
•    Gather customer feedback and communicate product improvement opportunities back to product management

Qualifications

•    10-14 years of practical software development experience, with 5+ years working with modern cloud-native and AI-native systems
•    3+ years of hands-on experience with LLM prompt engineering, agent design, and retrieval systems (RAG, semantic search, knowledge bases)
•    3+ years of demonstrated experience integrating third-party AI/ML services and platform APIs (OpenAI, Anthropic, AWS Bedrock, Google Vertex AI, etc.)
•    2+ years of hands-on experience developing applications and extensions on the ServiceNow platform
•    Strong proficiency in JavaScript/GlideScript, Python, and Java; familiarity with ServiceNow scripting patterns and APIs
•    Solid understanding of ServiceNow data model, form/workflow design, and business process automation
•    Solid understanding of microservices architecture, REST/streaming APIs, and modern backend frameworks (Spring Boot, FastAPI, etc.)
•    Experience designing and optimizing high-performance data pipelines, embedding systems, and vector stores at scale
•    Demonstrated expertise in LLM orchestration frameworks (LangChain, LlamaIndex, Semantic Kernel) and vector databases (Pinecone, Weaviate, pgvector, etc.)
•    Experience with cloud computing platforms and managed AI services (AWS, GCP, Azure); hands-on experience with infrastructure-as-code
•    Proficiency with Kubernetes, containerization, CI/CD pipelines, and automated testing frameworks
•    Experience developing and debugging evaluation harnesses, benchmarks, and metrics for AI/ML features
•    Proven ability to troubleshoot and isolate root causes in complex, distributed, and probabilistic systems
•    Strong communication skills; ability to explain technical concepts to both technical and non-technical audiences; customer-facing experience a plus
•    Experience with Agile and Scrum development methodologies; comfort with iterative development and continuous improvement
•    Demonstrated ability to engage with customers, understand their needs, and support issue resolution
•    Bachelor's degree in computer science, engineering, or related field; advanced degree or significant ML/AI coursework is a plus
•    Track record of taking ownership of significant technical initiatives and delivering them successfully
•    Demonstrated mentorship of junior engineers or technical leadership in previous roles

 

Additional Information

Work Personas

We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity,  veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.  

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. 

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. 

From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

ServiceNow New York, New York, USA Office

50 Hudson Yards, New York, NY, United States, 10001

Similar Jobs at ServiceNow

4 Days Ago
Hybrid
150K-262K Annually
Senior level
150K-262K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Staff Software Engineer on the AI Experience Framework team, responsible for full-stack architecture and development of modular, reusable, Lit-based web components and conversational AI interfaces. Owns design through delivery, framework APIs, routing, server-rendered runtimes, platform integrations, performance, scalability, and production reliability. Partners across teams, drives technical direction, resolves complex issues, mentors engineers, and contributes to automated testing and product evolution.
Top Skills: AngularC#C++GoGrafanaJavaJavaScriptKubernetesLitPrometheusReactRelational DatabasesVueWeb Components
6 Days Ago
Remote or Hybrid
191K-334K Annually
Senior level
191K-334K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build and operate a security data platform connecting SIEM, identity, asset, threat intelligence, and knowledge graph systems. Design core APIs, distributed data pipelines, schemas, risk scoring, entity resolution, and coverage queries. Own architecture and platform workstreams from scoping through delivery, collaborate with detection and identity teams, review code, mentor engineers, and drive partner adoption. The role requires expert Python, deep Splunk expertise, cybersecurity experience, and senior-level project ownership.
Top Skills: Asset InventoryAsynchronous Data PipelinesIdentity GovernanceKnowledge GraphsLarge Language ModelsMachine LearningMessage BusMitre Att&CkPythonRetrieval-Augmented GenerationSchema RegistrySIEMSplSplunkSplunk Apis
6 Days Ago
Hybrid
167K-291K Annually
Senior level
167K-291K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Staff Software Engineer responsible for designing, developing, testing, deploying, and supporting scalable ServiceNow AI Search features. The role includes Java and front-end development, search UI administration, analytics dashboards, GraphQL and API enhancements, test automation, performance optimization, and production reliability. The engineer collaborates with Product Owners and cross-functional teams in Agile Scrum processes while supporting machine-learning-based search and customer-reported issues.
Top Skills: AngularCi/CdCSSGraphQLHTMLJavaJavaScriptJenkinsJunitPlaywrightPythonReactSeleniumServicenowTestngUnixVue

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account