Design and build backend systems and APIs for AI-driven products, ensuring scalability, reliability, and integration of ML models while collaborating with engineering and product teams.
The Role
We’re looking for a Senior Software Engineer to build and scale the backend systems that power our AI agent. This role sits at the intersection of backend engineering, machine learning, and product, and is focused on turning AI capabilities into reliable, production-ready systems.
You won’t be training models, but you will make them work in the real world. You’ll build APIs, services, and data systems that connect LLMs and ML models to user-facing experiences, ensuring performance, reliability, and scalability.
What You’ll Do- Design and build APIs and backend services that power AI-driven product experiences
- Develop systems that integrate LLMs and ML models into production workflows
- Build and maintain data pipelines supporting training, inference, and evaluation
- Partner closely with ML Engineers, Data Scientists, and Product to ship end-to-end features
- Improve system performance, reliability, and scalability across services
- Contribute to experimentation and feedback loops that improve model and product performance
- Debug complex production issues and drive root cause resolution
- Raise the bar on code quality, system design, and engineering standards
- AI-powered features are reliably delivered through scalable, well-architected backend systems
- ML and LLM capabilities are seamlessly integrated into product experiences with strong performance and uptime
- Clear, maintainable APIs and services enable fast iteration across engineering and product teams
- Systems are designed with strong observability, enabling rapid debugging and improvement
- Engineering decisions consistently balance speed, quality, and long-term scalability
- 5+ years of experience in software engineering, with strong backend focus
- Strong proficiency in Python and experience building production-grade systems
- Experience designing APIs and service-oriented architectures
- Experience working with ML/AI systems in production environments (LLMs, ranking, recommendations, or similar)
- Familiarity with databases (SQL and/or NoSQL) and data-intensive systems
- Experience with cloud platforms (AWS, GCP, or Azure) and modern infrastructure
- Exposure to containerization and orchestration (Docker, Kubernetes)
- Ability to operate in ambiguity and take ownership of loosely defined problems
- Strong product mindset with focus on real user outcomes
- Clear communication and ability to collaborate across engineering, ML, and product
The expected base salary range for this role is $200,000–$225,000 USD and will vary based on skills, experience, role level, and geographic location. Final compensation will be determined by considering these factors alongside overall role scope and responsibilities.
In addition to base salary, Wizard offers:
- Equity in the form of stock options
- Medical, dental, and vision coverage
- 401(k) plan
- Flexible PTO and company holidays
- Fully remote work within the United States
- Periodic company offsites and team gatherings
Wizard is committed to fair, transparent, and competitive compensation practices.
Wizard AI New York, New York, USA Office
New York, New York, United States, 10013
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Design, build, and ship production-grade agentic AI systems that connect code context with runtime observability. Implement end-to-end LLM systems (prompting, tool calling, retrieval, memory, agents), define evaluation metrics and datasets, integrate with development workflows and Dynatrace, set technical strategy, mentor engineers, and own monitored production systems.
Top Skills:
Agentic Ai/AgentsAWSDynatraceGoGCPIdesLarge Language Models (Llms)Memory ManagementAzurePromptingPythonRetrieval (Rag)Static AnalysisTool Calling
_0.png)
Healthtech • Software
Lead backend development on the scheduling platform modernization, contribute across products, write APIs, and drive AI-accelerated software development workflows.
Top Skills:
.NetAgent OrchestrationAi-Assisted DevelopmentLlm ToolingPython
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead the design and implementation of data architecture strategies within AI and ML, collaborating with stakeholders to enhance data solutions and ensure compliance with governance policies.
Top Skills:
AWSAzureDatabricksFastapiGCPPythonSnowflakeSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
