Rollstack Logo

Rollstack

AI Software Engineer

Posted 23 Days Ago
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Build AI-powered features that automate data-driven slide decks and documents. Develop production LLM solutions using LangChain, RAG, LlamaIndex, and generative AI technologies; improve system performance and reliability; and collaborate with designers and engineers. Responsibilities span AI insights, content generation, integrations, optimization, and potentially LLM agents. The role requires advanced Python, machine learning and NLP expertise, and experience building and fine-tuning LLMs in production.
The summary above was generated by AI

At Rollstack, we are revolutionizing the way businesses share and communicate data and insights. Organizations worldwide rely on slide decks and documents to make informed decisions, whether for leadership, clients, or partners. Yet, preparing these materials often consumes countless hours. Rollstack fully automates that.

We help some of the world's leading organizations, from mid-sized to public companies like SoFi, Zillow, and Whirlpool, in automating their slide decks and documents. Headquartered in New York, we offer a remote-friendly workplace and are backed by Insight Partners and Y Combinator, the most successful startup incubator in the world that produced the likes of Airbnb, Twitch, Instacart, Dropbox, Reddit, DoorDash, Stripe, Coinbase, etc.

Our team operates with speed and focus to deliver outsized impacts for our customers. We approach every challenge with first principles, never assuming things have to be done a certain way. We are a diverse team that believes intelligence and kindness go hand in hand, welcoming individuals from all backgrounds. Our persistence and rapid execution define us as a category leader and a future generational company.


About the Role

As an AI Software Engineer at Rollstack, you’ll build core features that automate how companies share data through slides and documents. You’ll work across the stack on integrations, AI insights, and performance optimization. This role is ideal for engineers who thrive on impact, autonomy, and fast-paced product development.


As a LLM Engineer, you will
  • Build AI-Powered Features: Combine industry best practices with innovative thinking to develop our product's first AI capabilities.

  • Utilize Existing Frameworks: Leverage libraries like LangChain, RAG, and LlamaIndex to create scalable, production-ready solutions for data analysis and content generation.

  • Enhance System Performance: Improve reliability and speed up time-to-market by optimizing software performance to meet customer needs.

  • Collaborate with Teams: Work closely with designers and software engineers to boost user adoption and engagement.

  • Innovate with AI Technologies: Pioneer best practices using cutting-edge AI tools and techniques.

Tech Stack
  • TypeScript + React frontend with Tailwind CSS and Shadcn/UI, using modern hooks for composable UI and fast iteration.

  • Node.js backend with a sync engine using Prisma ORM and Temporal workflows, powering internal services.

  • K8s platform on AWS, deployed with Argo CD for zero‑downtime releases and easy rollbacks.

  • Logs in SigNoz, application tracing in Sentry, and product analytics in PostHog.

  • Generative‑AI layer powered by OpenAI API, Gemini, LangChain, and Langfuse to deliver automated insights.

  • Issue tracking with Linear.

Who We Are Looking For
  • Experience with LLM Frameworks: Proficiency in current large language model frameworks like LangChain, Retrieval-Augmented Generation (RAG), and LlamaIndex.

  • Machine Learning and NLP Expertise: 3+ years of experience in machine learning and natural language processing, focusing on generative models.

  • Strong Python Skills: Advanced programming skills in Python.

  • LLM Agents Development (Bonus): Bonus points for experience in building LLM agents for data analysis and content generation.

  • Production Experience with LLMs: Proven experience in researching, building, and fine-tuning large language models in production environments.

Why Join Us
  • We are backed by the best (Y Combinator, Insight Partners ...) and are redefining how individuals and teams, across industries and around the world, work smarter and faster.

  • Work alongside an exceptional team of builders, including alumni from Amazon, Meta, Pinterest, Tesla, and AiFi.

  • Be part of a fully remote, globally diverse workplace that values ownership, impact, and collaboration.

  • Contribute to a product that users love and that truly sells itself.

  • Once a year, the entire company gathers in a new city for a week of connection, collaboration, and fun. It’s a highlight of our year.

  • Earn competitive compensation and meaningful equity in a fast-moving, high-leverage startup where your work directly shapes the company’s trajectory.

HQ

Rollstack New York, New York, USA Office

New York, New York, United States

Similar Jobs

14 Days Ago
Remote or Hybrid
US
175K-175K Annually
Expert/Leader
175K-175K Annually
Expert/Leader
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Lead the architecture, development, and scaling of data pipelines and infrastructure for a customer-facing Data Lake platform. Build ETL and ingestion systems using GCP, Debezium, Pub/Sub, Dataflow, BigQuery, Python, Golang, and SQL. Establish engineering standards, deliver strategic projects, mentor engineers, influence cross-functional technical decisions, optimize data services, and shape the platform roadmap.
Top Skills: BigQueryCi/CdConfluenceDataflowDebeziumGoGoogle Cloud Platform (Gcp)JIRAPub/SubPythonRest ApisScrumSQL
2 Hours Ago
Remote
Senior level
Senior level
Information Technology
Design, build, and scale an agentic voice AI framework for banking customers. Develop LLM guardrails, grounding, policy enforcement, evaluation, tool-calling, and runtime architecture. Optimize real-time voice latency, maintain production reliability, reduce configuration friction, and collaborate with distributed product and engineering teams. The role also requires strong technical judgment, proactive ownership, AI-assisted development, and leadership through direction-setting, unblocking, and mentorship.
Top Skills: Amazon RdsAmazon S3Argo CdAWSClaude Agent SdkClaude CodeDatadogDockerDynamoDBElixirGeminiGitJavaScriptJenkinsKafkaKubernetesOpenai Agents SdkPostgresPythonReactTerraformTypescript
One Month Ago
Remote or Hybrid
CA, USA
264K-395K Annually
Expert/Leader
264K-395K Annually
Expert/Leader
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Own the architecture and technical strategy for Square’s go-to-market systems. Build and operate production AI agents, automated workflows, and integrations that improve sales productivity. Lead complex initiatives through architecture, implementation, testing, deployment, and operations while establishing AI evaluation, observability, security, reliability, and human-oversight practices. Partner with Sales, Product, Data, and Engineering leaders to translate business needs into scalable solutions, make build-versus-buy decisions, mentor engineers, and improve business impact through data and user feedback.
Top Skills: Ai AgentsCrm PlatformsGoLarge Language Models (Llms)RetrievalTool CallingWorkflow Orchestration

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account