Responsible for architecting and scaling the LlamaIndex cloud platform, delivering integrated developer experiences for context-aware applications.
https://pretty-sodium-5e0.notion.site/Founding-Backend-Engineer-JD-79b38bb380eb472b8d363688c3937bd0
- Staff Backend engineer with experience building multi-tenant cloud deployments: Ideally has worked at b2b companies that have built multi-tenant cloud services and built data infrastructure. Example companies: Databricks, Snowflake, Datadog, Splunk, Confluent, and more.
for the backend JD: we are looking for someone leaning more infra / deployment, working with more open source systems rather than e.g. google specific technology
Large Language Models (LLMs) are capable of human and super-human reasoning, but they don’t understand your personal or organizational data. The core mission of LlamaIndex is to enable developers to LLM-powered applications on top of any private data source.
We are at the forefront of a new way to build software. Doing this successfully will usher a new age of knowledge automation and completely redefine the modern data stack.
Our product offerings consist of an open-source Python/Typescript framework as well as an in-development enterprise platform. The framework has 1M+ monthly downloads and is used from large enterprises to early-stage startups - it is both easy to get started but robust for production use. We’re backed by Greylock and a fantastic set of angels, such as Jack Altman, Lenny Rachitsky, Mathilde Collin, Raquel Urtasun, Joey Gonzalez, Dan Shipper, Ben Tossell, and more.
Responsibilities: You will be responsible for architecting and scaling LlamaIndex’s cloud platform. You will work closely with our framework engineering and full-stack engineering team to deliver a top-notch integrated developer experience for building the next-generation of context-aware (i.e. RAG) applications.
Qualifications: You have a proven track record of building scalable cloud services that process massive amount of data. This include the full lifecycle of architecting scalable infrastructure, deploying containerized services to cloud providers via infrastructure-as-code. You are an expert at building quickly, but scale as necessary. You should know the in-and-out of building user-facing APIs. Prior experience with ETL / data orchestration / distributed data processing are strongly preferred.
You’re also passionate about LLMs and the immense opportunities it offers for developers and end users. You’re able to contextualize all backend decisions with the goal of creating an amazing set of tools for developers to use.
Benefits:
- Competitive salary (100K-300K, based on experience and location).
- Equity options in a rapidly growing company.
- Comprehensive health insurance.
- Generous paid time off policy.
- Lunch + Snacks
Location:
We hire exceptional candidates worldwide and have a hybrid-friendly culture. We have a San Francisco office by Caltrain station.
Interested?
Similar Jobs
Information Technology • Professional Services
Architect and scale LlamaIndex's cloud platform, collaborating with engineering teams to create developer-friendly tools for context-aware applications.
Top Skills:
Cloud ServicesContainerizationInfrastructure-As-CodePythonTypescript
Information Technology • Professional Services
As a Founding Backend Engineer, you will architect and scale LlamaIndex's cloud platform, ensuring a seamless developer experience while building scalable infrastructure and user-facing APIs.
Top Skills:
Cloud ServicesContainerizationData OrchestrationDistributed Data ProcessingETLInfrastructure-As-CodePythonTypescript
Information Technology • Professional Services
The Founding Backend Engineer will architect and scale LlamaIndex's cloud platform, focusing on building scalable cloud services, containerized deployments, and user-facing APIs while collaborating with engineering teams.
Top Skills:
Cloud ServicesContainerizationData OrchestrationDistributed Data ProcessingETLInfrastructure-As-CodePythonTypescript
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
