Confluent Logo

Confluent

Staff Software Engineer

Reposted Yesterday
In-Office or Remote
Hiring Remotely in New York, NY, USA
236K-277K Annually
Expert/Leader
In-Office or Remote
Hiring Remotely in New York, NY, USA
236K-277K Annually
Expert/Leader
Design and build backend services that run AI/model inference on real-time streaming data. Own end-to-end features, make cross-team architectural decisions, ensure reliability and operability, participate in on-call, and mentor engineers while driving production-grade rollout and testing.
The summary above was generated by AI

We’re not just building better tech. We’re rewriting how data moves and what the world can do with it. With Confluent, data doesn’t sit still. Our platform puts information in motion, streaming in near real-time so companies can react faster, build smarter, and deliver experiences as dynamic as the world around them.

It takes a certain kind of person to join this team. Those who ask hard questions, give honest feedback, and show up for each other. No egos, no solo acts. Just smart, curious humans pushing toward something bigger, together.

One Confluent. One Team. One Data Streaming Platform.

About the Role:

You'll help build Confluent Cloud's AI capabilities — the layer that lets customers bring AI and AI agents capabilities directly to their real-time data. Instead of moving data out to a separate system to run inference or build an agent, our customers do it in place, on streaming data, as part of the same platform they already use to move and process events at scale.

As an engineer, you'll own delivery of significant pieces of this product — not just writing code, but deciding how a capability should work across the services that make it up. The interesting problems here rarely live in one place: shipping something like inference-on-streaming-data or an AI agent that reacts to live events touches several systems at once — the user-facing API, the services that manage model and agent lifecycle, the control plane that schedules and runs the work, and the serving layer that actually executes inference. You'll be expected to reason across those boundaries, make sound design calls, and get engineers inside and outside the team aligned on the approach.

What You Will Do:
  • Design and build the backend services (primarily Go, Java, and Python) that run AI and model inference on real-time data.

  • Own features end to end — drafting the design, aligning stakeholders inside and outside the team, and driving the decision to a conclusion.

  • Make the technical calls on systems that span teams: model lifecycle, inference routing, and agent execution.

  • Own the quality of what you ship — code, test coverage, documentation, operability, and rollout safety. This is production infrastructure serving live inference, so reliability isn't an afterthought.

  • Make the engineers around you better through code review, design feedback, and being someone the team trusts with ambiguous, cross-cutting work.

  • Participate in on-call for the services your team owns, and help keep the team's processes and rituals healthy.

What You Will Bring:
  • 10+ years of significant experience designing, building, and operating distributed systems or cloud-native backend infrastructure in production

  • .Strong working knowledge of Kubernetes and distributed-systems patterns (control loops, API servers, high-scale control planes), plus the fundamentals — containerization, networking, resource isolation.

  • Proficiency in at least one of Go, Java, or Python, and the willingness to work across all three.

  • A track record of leading cross-team technical work: turning ambiguous requirements into designs others can rally behind.

  • Excellent written and verbal communication — you can write a design doc that aligns people who don't report to you.

What Gives You an Edge:
  • Exposure to model serving, LLM/agent infrastructure, or streaming data systems.

    • You don't need a background in ML research or model training — this role is about building and operating the platform that serves AI reliably at scale, not inventing the models.

Ready to build what's next? Let’s get in motion.

Come As You Are

Belonging isn’t a perk here. It’s the baseline. We work across time zones and backgrounds, knowing the best ideas come from different perspectives. And we make space for everyone to lead, grow, and challenge what’s possible.

We’re proud to be an equal opportunity workplace. Employment decisions are based on job-related criteria, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other classification protected by law.

Privacy Statement

Confluent is an IBM subsidiary which has been acquired by IBM and will be integrated into the IBM organization. By proceeding with this application, you understand that Confluent will share your personal information with other IBM affiliates involved in your recruitment process, wherever these are located. More Information on how IBM protects your personal information, including the safeguards in case of cross-border data transfer, are available here.

Similar Jobs

Yesterday
Easy Apply
Remote
United States
Easy Apply
185K-225K Annually
Expert/Leader
185K-225K Annually
Expert/Leader
Healthtech • Software
Lead design and development of scalable, cloud-native AI healthcare payment integrity platforms. Provide technical leadership, own production code and releases, design data/retrieval architectures, ensure observability, security, and compliance, and collaborate with ML, product, and architecture teams to deliver performant SaaS solutions.
Top Skills: Auth/Authz FrameworksAutomated TestingCi/CdClinical OntologiesData ModelingData Systems/PipelinesEvaluation FrameworksEvent-Driven SystemsHealthcare Interoperability StandardsInfrastructure As Code (Iac)InstrumentationMulti-Agent Ai ArchitecturesObservabilityRag (Retrieval-Augmented Generation)Secure Api Design
Yesterday
Remote
US
193K-309K Annually
Senior level
193K-309K Annually
Senior level
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Design, build, deploy, and maintain resilient, scalable backend services and platform components for Toast's Voice AI platform. Lead cross-cutting architecture and projects, integrate AI platforms (LLMs), implement observability and evaluation for AI systems, set engineering standards, and mentor engineers.
Top Skills: AWSClaude CodeConversational AiCursorDropwizardDynamoDBEs6JavaKotlinLambdaLlmsPostgresRdsReactVoice Ai
3 Days Ago
Easy Apply
Remote
United States
Easy Apply
204K-290K Annually
Senior level
204K-290K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Lead technical strategy and delivery for mobile app infrastructure, owning shared components (design system, networking, CI/CD, observability, releases, tooling). Collaborate cross-functionally, set code/design standards, ensure operational readiness and on-call processes, mentor engineers, and drive large, business-impacting projects and migrations across the JS↔native boundary.
Top Skills: AppiumCi/CdClaude CodeCrashlyticsE2E TestingExpoJavaScriptLaunchdarklyMaestroReact NativeReact Native New ArchitectureReact Native SdkReduxRedux ToolkitSentryStatsigTypescript

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account