BJAK Logo

BJAK

Backend Engineer, AI Systems

Posted 3 Days Ago
Remote
Hiring Remotely in United States
Entry level
Remote
Hiring Remotely in United States
Entry level
Build and operate the inference and orchestration backend powering AI interactions across mobile and desktop applications. Responsibilities include designing production AI services, optimizing latency and throughput, managing caching, batching and streaming, and maintaining monitoring, logging, alerting, and incident response systems. The role requires reliable APIs, distributed-systems debugging, and scalable integration with LLMs, embeddings, and multimodal models.
The summary above was generated by AI
About Act

There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they're not AI-native. Our mission is to build proactive applications for anyone in the world, who are not used to complex prompting. We aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.

Our first application is an agent-first mobile communication app. We believe building applications that users use daily for communication, coordination and collaboration needs will help integrate AI into their lives. The net effect is to eliminate misinformation, achieve low coordination costs, enable high quality tasks and collaboration at scale with minimal or little prompting.

 
Role

As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.

You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

 
Focus
  • Build and operate backend systems that serve AI-powered features in production.

  • Design inference pipelines, orchestration layers, and service boundaries around models.

  • Own production concerns: monitoring, logging, alerting, and incident response.

  • Optimize latency and throughput across inference, caching, batching, and streaming.

 
Ideal Experiences
  • Strong backend engineering fundamentals in production environments.

  • Experience running high-throughput, low-latency services.

  • Familiarity with AI inference patterns (LLMs, embeddings, multimodal).

  • Comfortable debugging distributed systems under load.

  • Bias toward shipping and learning from production behavior.

 
Outcomes
  • Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.

  • APIs are stable, clear, and support seamless integration with frontend and ML systems.

  • Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.

  • Iterative improvements based on real usage continuously increase system performance and reliability.

 
Tech Stack
  • Python

  • NodeJs

  • Pytorch

  • OpenAI / Anthropic / open-source LLMs

  • SQl & noSQL

  • Kubernetes

  • Docker

 
How We Work

The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product

 
Interview process

If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.

Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.

We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.

Similar Jobs

58 Minutes Ago
In-Office or Remote
Senior level
Senior level
Hardware • Other • Appliances
Leads day-to-day manufacturing and operations activities, ensuring production, delivery, quality, cost, and customer requirements are met. Oversees purchasing, production control, planning, manufacturing and test engineering, maintenance, manufacturing, and logistics. Establishes operational goals, manages P&L and staff, executes strategic programs, reviews performance with executives and customers, and develops workforce strategies. Requires substantial management experience, manufacturing or electrical project expertise, and strong people leadership.
Top Skills: Electrical SystemsManufacturing Systems
59 Minutes Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
24-27 Hourly
Mid level
24-27 Hourly
Mid level
HR Tech • Payments • Professional Services • Software
Manage employee customer inquiries by phone, email, and chat regarding payroll, benefits, timekeeping, HR, and software. Resolve cases through CRM workflows, provide accurate and empathetic support, escalate complex issues, maintain product expertise, and communicate customer feedback and software bugs to internal teams. The role requires a 12pm–9pm EST schedule after approximately four weeks of mandatory paid virtual training.
Top Skills: CRMSaaS
59 Minutes Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Healthtech • Logistics • Social Impact • Software • Telehealth
Provides clinical oversight and guidance to a Texas-based Virtual Nurse Practitioner, including medical record review, monthly consultations, regulatory compliance, telemedicine protocol adherence, case reviews, clinical audits, and quality improvement initiatives.
Top Skills: Electronic Medical Records (Emr)Remote Patient Monitoring ToolsTelemedicine

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account