Thinking Machines Lab Logo

Thinking Machines Lab

Software Engineer, Systems Generalist

Posted One Month Ago
In-Office
New York, NY, USA
350K-475K Annually
Entry level
In-Office
New York, NY, USA
350K-475K Annually
Entry level
Build and scale infrastructure supporting frontier AI model training, research, and product development. Responsibilities may include operating Kubernetes clusters with GPU workloads, developing data pipelines with Spark, improving developer productivity tooling, debugging across application, operating system, and network layers, and delivering reliable distributed systems end to end.
The summary above was generated by AI
About Thinking Machines

The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.

About the Role

We’re looking for generalist infrastructure and systems engineers to help build the systems that power our foundation models and the internal teams on research and product development to be able to create the models and ship the products powered by our models.

You'll join a small, high-impact team responsible for architecting and scaling the core infrastructure behind everything we do. You’ll work across the full technical stack, solving complex distributed systems problems and building robust, scalable platforms.

Infrastructure is critical to us: it's the bedrock that enables every breakthrough. You'll work directly with researchers to accelerate experiments, improve infrastructure efficiency, and enable key insights across our models, products, and data assets.

What You’ll Do

We interview generally, but during project selection we’ll take into account your interests and experience alongside organizational needs. This flexible approach allows us to match talented engineers with the infrastructure teams where they'll have the greatest impact and growth potential.

Here are example areas you may contribute to depending on your area of expertise and interest:

  • Core Infrastructure: We support teams that train, research, and ultimately serve AI models and build the underlying infrastructure for the clusters to reliably and safely train frontier models. Examples might include building systems and running large Kubernetes clusters with GPU workloads, or building infrastructure to support Tinker.

  • Data Infrastructure: We build and maintain the data systems for our research and products. You'll design and optimize data pipelines using tools like Spark and other modern data infrastructure technologies.  You’ll build scalable, reliable, data infrastructure while embedding governance best practices.

  • Developer Productivity: We care deeply about research and engineering productivity and our ability to continue shipping quickly. We build tooling, systems, frameworks, and systems to make sure everyone gets well configured, optimized developer environments.

Skills and QualificationsMinimum qualifications
  • Bachelor’s degree or equivalent experience in computer science, engineering, or similar.

  • Proficiency in at least one backend language (we use Python or Rust).

  • Experience operating large‑scale clusters and container orchestration systems (e.g. Kubernetes or Slurm).

  • Comfort operating across the stack and owning projects end-to-end.

  • Thrive in a highly collaborative environment involving many, different cross-functional partners and subject matter experts.

  • A bias for action with a mindset to take initiative to work across different stacks and different teams where you spot the opportunity to make sure something ships.

Preferred qualifications
  • Strong debugging across application, OS, and network layers.

  • Proficiency in Python or Rust (or similar), containers, and modern CI.

  • Experience with Kubernetes, controllers/operators, or performance profiling.

  • Familiarity with GPU/ML workflows or large‑scale data/eval pipelines.

Logistics
  • Location: This role is based in San Francisco, California. 

  • Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $300,000 - $400,000 USD.

  • Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.

  • Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

Similar Jobs

24 Minutes Ago
In-Office or Remote
10003, New York, NY, USA
202K-318K Annually
Expert/Leader
202K-318K Annually
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead Atlassian’s Agent Platform engineering team, combining people management with hands-on technical leadership. Set direction for applied ML, agent workflows, retrieval, evaluation, observability, reliability, security, privacy, and scalable platform foundations. Hire, coach, and develop engineers; establish planning and execution practices; write production code; and align roadmaps across product, engineering, ML, data, and platform stakeholders to deliver reliable AI experiences.
Top Skills: Agentic SystemsAi/Ml SystemsApplied MlContext RetrievalEvaluation SystemsObservabilityPlatform EngineeringProduction Operations
An Hour Ago
Hybrid
New York, NY, USA
147K-259K Annually
Senior level
147K-259K Annually
Senior level
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Build and manage partnerships with independent media agencies to expand Snapchat’s digital advertising presence. Responsibilities include setting agency strategy, managing financial performance and revenue targets, serving as a senior point of contact, delivering education and business reviews, developing tailored solutions, coordinating cross-functional growth initiatives, and tracking portfolio performance. The role requires extensive advertising sales experience, strong agency relationships, executive-level communication, and the ability to work effectively in a dynamic matrix organization.
Top Skills: Snapchat
An Hour Ago
Remote or Hybrid
United States
Senior level
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Design and implement AI agents, plugins, automations, and enterprise integrations for HR Technology platforms. Lead requirements gathering, technical analysis, solution design, testing, documentation, deployment, security, and data integrity efforts across HR, IT, and business stakeholders. Integrate platforms including ServiceNow, Workday, and other enterprise applications while supporting the HR automation and AI roadmap.
Top Skills: APIsAutomation AnywhereAWSAzureConcurGCPKnimeServicenowServicenow RpaUipathWorkdayWorkday Hcm

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account