Photon Logo

Photon

Sr Gen AI Engineer - NY/NJ

Reposted One Month Ago
In-Office or Remote
2 Locations
40K-141K Annually
Senior level
In-Office or Remote
2 Locations
40K-141K Annually
Senior level
Design, build, and deploy production-grade Generative AI applications: multi-agent systems, advanced RAG pipelines, LLM integration and swapping, model fine-tuning and quantization, scalable FastAPI backends, containerized deployment, and monitoring/optimization for latency, cost, and reliability.
The summary above was generated by AI

Role Summary:
We are seeking a Generative AI Engineer to build, optimize, and scale production-ready AI applications. You will design complex multi-agent systems, implement advanced RAG pipelines, and manage the deployment of both frontier and local LLMs. The ideal candidate blends deep machine learning expertise with modern software engineering practices.


Technical Stack:

LLMs: Gemini, OpenAI, Claude, Llama, and Local Model deployment.

Frameworks: LangChain, LlamaIndex, and Hugging Face.

Orchestration: LangGraph and Multi-Agent Systems (MAS).

Development: Python, FastAPI, and Asynchronous Programming.

RAG & Data: PostgreSQL, Vector Databases, and Advanced Retrieval strategies.

ML/DL: PyTorch, TensorFlow, and Model Fine-tuning.

Deployment: Docker, Production API management, and LLM monitoring.

Tools: Prompt Engineering, Workflow Design, and GenAI Optimization.


Key Responsibilities:

Develop and orchestrate sophisticated AI workflows using LangGraph and multi-agent architectures.

Build and maintain Advanced RAG systems utilizing LlamaIndex and vector databases for high-accuracy retrieval.

Integrate and swap diverse LLMs (commercial and open-source) based on performance and cost requirements.

Design and deploy high-performance, scalable backend services using FastAPI and Async Python.

Fine-tune large language models (LLMs) using PyTorch/TensorFlow to improve domain-specific performance.

Optimize GenAI workflows for latency, cost, and reliability using advanced prompt engineering and monitoring tools.

Containerize and deploy AI services via Docker to production environments.


Required Qualifications:

Hands-on experience building and deploying GenAI applications in a production setting.

Strong proficiency in Python and the modern AI library ecosystem (LangChain, LlamaIndex, etc.).

Experience with vector search, embedding models, and advanced data retrieval patterns.

Knowledge of model fine-tuning techniques and local LLM quantization/hosting.

Familiarity with production-grade monitoring, API security, and CI/CD for ML.


Compensation, Benefits and Duration

Minimum Compensation: USD 40,000
Maximum Compensation: USD 141,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post

Photon New York, New York, USA Office

New York, United States

Similar Jobs

42 Minutes Ago
Remote or Hybrid
United States
211K-285K Annually
Senior level
211K-285K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Leads Rapid7’s global technical sales organization across Sales Engineering Specialists, Forward Engineering, Labs, and the Center of Excellence. Develops technical sales strategy, organizational roadmaps, succession frameworks, and engineering capabilities while partnering with sales leadership. Oversees integrations, demo infrastructure, enterprise platform architecture, ROI modeling, resource planning, and cross-functional execution. Drives organizational scaling, executive alignment, talent development, and measurable contributions to revenue and product innovation.
Top Skills: APIsCloud ComputingEnterprise Security PlatformsSecurity Orchestration Automation And Response (Soar)
42 Minutes Ago
Remote or Hybrid
United States
89K-121K Annually
Mid level
89K-121K Annually
Mid level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Supports customers using Rapid7’s Vector Command Red Team service through attack surface analysis, reconnaissance, OSINT, reporting, customer communications, and request prioritization. The role coordinates with Red Team, MDR, and MVM teams; conducts manual network and service reconnaissance; develops scripts to analyze attack surface data; monitors customer exposures; and performs entry-level external penetration testing. It also includes customer onboarding, monthly reporting, update calls, and translating technical security concepts for nontechnical stakeholders.
Top Skills: Ieee 802.11Internet Protocol SuiteLinuxOsintPenetration Testing ToolsPowershellPythonUnixVector Command PlatformWindows
50 Minutes Ago
Remote or Hybrid
United States
117K-158K Annually
Senior level
117K-158K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Leads Procore consulting engagements by translating client business needs into requirements, architecting and implementing solutions, designing quality processes, reviewing testing and budgets, improving workflows, supporting sales, and mentoring engineering and consulting teams. The role serves as a Procore subject matter expert, oversees quality management and SDLC methodologies, develops service offerings, and drives client satisfaction and team growth.
Top Skills: ProcoreSoftware Development Life Cycle (Sdlc)

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account