What You'll Do
Contribute to the architecture and lead development of production AI products including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks
Design and implement components of our centralized AI platform including model routing, provider management, vector search, and AI application frameworks with seamless MCP (Model Context Protocol) integrations
Build scalable AI products that integrate with diverse technologies including accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability
Implement context engineering and system design for AI applications, ensuring optimal information retrieval, context assembly, and multi-turn conversation management
Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives in the regulated accounting space
Provide technical guidance and mentorship to other engineers on the growing AI team, promoting best practices for AI product development, deployment, and governance
What You'll Bring
7+ years of professional software engineering experience with 3+ years focused on building backend for production applications
Strong proficiency in Python, alongside familiarity with AI application frameworks, context engineering, and scalable system design for AI products
Experience designing products that integrate with multiple technologies, APIs, and data sources in cloud-native environments (AWS preferred)
Strong desire to develop deep hands-on experience with LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations
Proven ability to own tech product initiatives, drive technical standards, and communicate complex system designs to both technical and business stakeholders
Nice To Haves/Other
Experience building chatbots or conversational AI products in production
Background in system integration, API design, or enterprise software platforms
Familiarity with accounting workflows and financial data processing
Experience with AI observability, debugging tools, and production AI monitoring
Hands-on experience with advanced RAG architectures, reranking systems, and retrieval optimization techniques
Knowledge of reinforcement learning from human feedback (RLHF) or other RL techniques for improving AI product performance
Experience building AI platform components like embedding pipelines, semantic search systems, or multi-modal processing frameworks
Here’s Why You Should Apply
- What is engineering working on? Our FQ Engineering Blog showcases a number of our recent efforts straight from the engineers working on them. Check it out!FloQast New York, New York, USA Office
FloQast New York, NY Office
155 Wooster Street, New York, NY, United States, 10012
Similar Jobs at FloQast
What you need to know about the NYC Tech Scene
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
