Epiq Logo

Epiq

Junior Software Engineer – AI/LLM Systems

Sorry, this job was removed at 06:11 p.m. (EST) on Thursday, Apr 23, 2026
In-Office
New York, NY, USA
In-Office
New York, NY, USA

Similar Jobs

46 Minutes Ago
Hybrid
New York, NY, USA
95K-120K Annually
Senior level
95K-120K Annually
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Serve as a technical functional analyst for risk-related programs, gathering and influencing requirements, coordinating vendors and development teams, managing project plans, timelines, budgets, and test plans, and integrating cloud and AI solutions into GRC and risk-management systems. Produce leadership-level documentation and status reporting while collaborating with Architecture, Risk IT, and business partners to deliver technical solutions that improve risk capabilities.
Top Skills: AIAzure DevopsCloudPower BIPowerPointPythonSQL
2 Hours Ago
Hybrid
70K-95K Annually
Senior level
70K-95K Annually
Senior level
Information Technology • Insurance • Software
Serve as a trusted advisor leading complex enterprise SaaS implementations for MGA/insurance clients. Gather requirements, configure applications, execute data conversions, manage full project lifecycle, deliver training and UAT, liaise with product/engineering, mentor consultants, and ensure projects meet scope, budget, timeline, and quality targets.
Top Skills: AgileBackend Development SystemsMS OfficePmbokPolicy Administration SystemsRatersSaaSVertafore
2 Hours Ago
Remote or Hybrid
New York, NY, USA
Expert/Leader
Expert/Leader
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Lead the global obligations management function: design and maintain a centralized obligations register, map legal and partner mandates to controls, manage RFI knowledge base and audit register, ensure traceability and remediation, partner with regional legal/compliance/audit teams, and scale the team and GRC tooling to replace manual trackers.

At Epiq, your work contributes to complex, global legal outcomes. You’ll join a values‑driven community where integrity guides decisions, relentless service sets the bar, and we thrive on big challenges together. We invest in your growth with enterprise‑wide learning and mobility. We celebrate who you are, and we respect life beyond work with flexibility that’s recognized externally. Enabled by modern platforms and AI, you’ll do the most meaningful work of your career and see your impact at scale.

Job Description:

Job Summary

We’re building cutting‑edge AI‑powered products and need a junior engineer who is eager to learn about large‑language‑model (LLM) technology while helping us ship new features. If you enjoy working on real‑world products and want to grow your skills in AI, this role is for you.

Essential Job Responsibilities

  • Build and ship AI features with LLMs, retrieval‑augmented generation (RAG) pipelines, embeddings, and simple multi‑model workflows under guidance from senior teammates. 
  • Help design low‑latency, high‑accuracy systems that can scale reliably in production.
  • Support cloud operations on AWS/Azure, learning how to keep costs under control. 
  • Create prompt libraries and participate in evaluation pipelines, guardrails, and automated quality checks. 
  • Collaborate with product and linguistics experts to translate user stories into concrete rules and domain logic. 
  • Run benchmarks and tweak models for accuracy, performance, latency, and cost, reporting findings to the team. 
  • Build internal tools for prompt iteration, dataset curation, and model evaluation with guidance from more experienced engineers.

Qualifications & Requirements

Education

  • Required: Bachelor's degree in Computer Science, Information Technology, or a related field.

  • Preferred: Master's degree in Computer Science or a related field.

Skills

  • Production‑grade software engineering – Proven experience building, testing, and deploying code in live environments.
  • Python mastery – Comfortable writing clean, idiomatic Python (3.x), using core libraries and data‑science tools (e.g., pandas, NumPy, scikit‑learn, FastAPI, Django).
  • Cloud‑native development – Hands‑on experience with cloud platforms (AWS, GCP, or Azure), including IaC (Terraform, CloudFormation), serverless functions, container orchestration (Kubernetes), and CI/CD pipelines.
  • Basic ML/LLM awareness – A foundational grasp of machine‑learning concepts and large‑language‑model principles, paired with a genuine curiosity to dive deeper.
  • Observability & performance – Familiarity with monitoring, logging, and tracing in distributed systems (Prometheus, Grafana, ELK stack, OpenTelemetry).
  • Optional advanced exposure – Experience with vector databases, retrieval‑augmented generation, or prompt engineering is a plus, but not mandatory.
  • Product‑oriented mindset – Ability to translate technical ideas into user‑centric features that delight customers.
  • Growth‑oriented teamwork – Eager to learn, proactive, and thrives in a collaborative environment where mentorship and support for junior talent are core values.

The Compensation range for this role is 80,000 to 95,000 USD annually and may be eligible for an annual bonus.

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.

Must be authorized to work in the United States for any employer. 

Your specific salary will be determined based on several factors:

  • Location-based market rate for the role

  • Your abilities in relation to the job specification

  • Performance during screening and interview

  • Pay parity with the wider team in the considered location

Further details about the package will be provided during the initial screening call with the Talent Acquisition Team.

Click here to learn about Epiq's Benefits.

Epiq Leadership Compass

Fosters Relationships & Collaboration

Builds trust and alignment through open communication, shared goals, and strong partnerships to drive collective success.

  • Build trust-based partnerships

  • Nurture long-term relationships

  • Remove collaboration barriers

  • Celebrate cross-team success

Engages & Influences

Inspires action and alignment through clear communication, purposeful influence, and a compelling vision.

  • Use storytelling to build buy-in

  • Align communication with organizational goals

  • Guild alignment through strong engagement

Maximizes Performance

Sets and reinforces performance standards that drive results, ensure accountability, and align with Epiq’s goals.

  • Use data to identify improvement opportunities

  • Make informed decisions

  • Align team goals with boarder strategy

  • Empower teams to manage their own goals

  • Translate vision into clear priorities

  • Prepare for disruptions with strong change management

Achieves Operational Success

Drives continuous improvement and operational excellence through smart processes, data insights, and quality execution.

  • Improve workflows for team efficiency

  • Use clear documentation and expectations

  • Resolve issues quickly using data and feedback

It is Epiq’s policy to comply with all applicable equal employment opportunity laws by making all employment decisions without unlawful regard or consideration of any individual’s race, religion, ethnicity, color, sex, sexual orientation, gender identity or expressions, transgender status, sexual and other reproductive health decisions, marital status, age, national origin, genetic information, ancestry, citizenship, physical or mental disability, veteran or family status or any other basis protected by applicable national, federal, state, provincial or local law. Epiq’s policy prohibits unlawful discrimination based on any of these impermissible bases, as well as any bases or grounds protected by applicable law in each jurisdiction. In addition Epiq will take affirmative action for minorities, women, covered veterans and individuals with disabilities. If you need assistance or an accommodation during the application process because of a disability, it is available upon request. Epiq is pleased to provide such assistance and no applicant will be penalized as a result of such a request.  Pursuant to relevant law, where applicable, Epiq will consider for employment qualified applicants with arrest and conviction records.

HQ

Epiq New York, New York, USA Office

777 3rd Ave, 12th Floor, New York, NY, United States, 10017

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account