Bloomberg Logo

Bloomberg

Senior LLM Engineer - Artificial Intelligence

Sorry, this job was removed at 05:17 p.m. (EST) on Wednesday, Aug 21, 2024
Be an Early Applicant
In-Office
New York, NY
In-Office
New York, NY

Similar Jobs

5 Days Ago
Hybrid
New York, NY, USA
157K-213K Annually
Mid level
157K-213K Annually
Mid level
Cloud • Design
As an ML Research & Implementation Engineer at Bubble, you'll enhance AI development tools, optimize LLMs, and build agentic workflows, collaborating with teams to advance AI-powered solutions for application development.
Top Skills: AWSHugging FaceLangchainNode.jsPostgresPythonRedisTypescript
30 Minutes Ago
In-Office
New York, NY, USA
300K-325K Annually
Senior level
300K-325K Annually
Senior level
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As an Engineering Director, you'll lead Airwallex's GTPN team, overseeing engineering strategies, collaborating on financial solutions, and optimizing product outcomes through data-driven insights.
Top Skills: Engineering PracticesSoftware Development
4 Hours Ago
Remote or Hybrid
57 Locations
83K-198K Annually
Senior level
83K-198K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
This role manages AI operational support, leading teams in delivering AI/ML services, driving innovation, and resolving operational challenges while fostering client relationships.
Top Skills: AIArizeAws BedrockAzure OpenaiCloud Ai ServicesEvidentlyFaissGcp Vertex AiLangchainLlamaindexMlMlopsPineconeRag ArchitecturesVector Stores

Bloomberg's Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases. We are expanding our group and seeking highly skilled individuals who will be responsible for contributing to the team (or teams) of Machine Learning (ML) and Software Engineers that are bringing innovative solutions to AI-driven customer-facing products.

At Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets.

Bloomberg has been building Artificial Intelligence applications that offer solutions to these problems with high accuracy and low latency since 2009. We build AI systems to help process and organize the ever-increasing volume of structured and unstructured information needed to make informed decisions. Our use of AI uncovers signals, helps us produce analytics about financial instruments in all asset classes, and delivers clarity when our clients need it most.

The advent of large language models (LLMs) presents new opportunities for expanding our NLP capabilities in our products. As a Senior LLM Platform Engineer in the AI Department, you will have the opportunity to make key technical decisions which help define the future of infrastructure for LLM training and inference at Bloomberg!

Join the AI Department as a Senior LLM Engineer and you will have the opportunity to:

  • Build production LLM systems to power business functions in the Bloomberg Terminal
  • Optimize and support LLM workloads in on-prem HPC and cloud environments
  • Contribute to internal initiatives related to LLM research and development
  • Work with specialized hardware for tensor computations

We are looking for senior LLM Platform Engineer with the following experience:

  • 4+ years of programming experience with an object-oriented programming language
  • A degree in Computer Science, Engineering or similar field of study or equivalent work experience
  • Experience in designing, developing, and supporting ML applications
  • Understanding of ML model architectures, specifically, transformers, and underlying computations
  • Experience in profiling, benchmarking and optimizing ML applications

We'd love to see:

  • Deep working proficiency in Python
  • Experience in using HPC compute platforms and understanding anatomy of distributed computations
  • Proficiency with various ML accelerators (NVIDIA GPUs, TPUs, other vendor ASICs) and building efficient workloads for them
  • Solid understanding of networking (Infiniband, AWS EFA, RoCE)
  • Experience managing infrastructure in Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email [email protected]

We give back to the technology community and you can read more about our outreach at: http://www.techatbloomberg.com/ai

HQ

Bloomberg New York, New York, USA Office

New York, NY, United States

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account