BJAK Logo

BJAK

Principal Machine Learning Engineer

Reposted Yesterday
Remote
Hiring Remotely in United States
Expert/Leader
Remote
Hiring Remotely in United States
Expert/Leader
Lead the development of production-grade machine learning systems, build ML pipelines, and optimize models for deployment and performance.
The summary above was generated by AI
About the Role

A1 is building a proactive AI system that understands context across conversations, plans actions, and carries work forward over time.

You will be responsible for turning research direction into working, production-grade ML systems. This role owns the execution layer of A1’s intelligence – training pipelines, inference systems, evaluation tooling, and deployment.


Focus
  • Build and own end-to-end ML pipelines spanning data, training, evaluation, inference, and deployment.

  • Fine-tune and adapt models using state-of-the-art methods such as LoRA, QLoRA, SFT, DPO, and distillation.

  • Architect and operate scalable inference systems, balancing latency, cost, and reliability.

  • Design and maintain data systems for high-quality synthetic and real-world training data.

  • Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership.

  • Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies.

  • Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products.

  • Make pragmatic trade-offs and ship improvements quickly, learning from real usage.

  • Work under real production constraints: latency, cost, reliability, and safety


Requirements
  • Strong background in deep learning and transformer-based architectures.

  • Hands-on experience training, fine-tuning, or deploying large-scale ML models in production.

  • Proficiency with at least one modern ML framework (e.g. PyTorch, JAX), and ability to learn others quickly.

  • Experience with distributed training and inference frameworks (e.g. DeepSpeed, FSDP, Megatron, ZeRO, Ray).

  • Strong software engineering fundamentals – you write robust, maintainable, production-grade systems.

  • Experience with GPU optimization, including memory efficiency, quantization, and mixed precision.

  • Comfort owning ambiguous, zero-to-one ML systems end-to-end.

  • A bias toward shipping, learning fast, and improving systems through iteration.


Ideal Experience
  • Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer.

  • Contributions to open-source ML or systems libraries.

  • Background in scientific computing, compilers, or GPU kernels.

  • Experience with RLHF pipelines (PPO, DPO, ORPO).

  • Experience training or deploying multimodal or diffusion models.

  • Experience with large-scale data processing (Apache Arrow, Spark, Ray).


How We Work

Our organization is very flat and our team is small, highly motivated, and focused on engineering and product excellence. All members are expected to be hands-on and to contribute directly to the company’s mission.


Interview process

If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.

Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.

We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.

Top Skills

Apache Arrow
Deep Learning
Deepspeed
Fastertransformer
Fsdp
Jax
Machine Learning
Megatron
PyTorch
Ray
Spark
Tensorrt-Llm
Transformer-Based Architectures
Zero

Similar Jobs

11 Days Ago
In-Office or Remote
Eden Prairie, MN, USA
135K-231K Annually
Senior level
135K-231K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead the design and development of AI/ML models for healthcare. Collaborate with business partners and other teams to ensure high-quality execution and adherence to architectural principles.
Top Skills: Azure Ai ServicesDatabricksPythonSQL
11 Days Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
150K-200K Annually
Senior level
150K-200K Annually
Senior level
Automotive • Big Data • Insurance • Software • Transportation
The Principal ML Engineer at Agero will develop and productionize a Dispatch System using ML models, optimize decision-making processes, and lead a team to improve operational performance.
Top Skills: AirflowAWSAzureGCPPythonPyTorchSagemakerSQLXgboost
22 Days Ago
In-Office or Remote
5 Locations
135K-231K Annually
Expert/Leader
135K-231K Annually
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead end-to-end AI/ML projects: research, prototype, optimize, and productionize ML and LLM solutions for healthcare. Mentor and recruit teams, run experiments and A/B tests, present results to leadership, and pursue AI research and IP.
Top Skills: Deep LearningDpoGansGenerative AiGnnsLarge Language Models (Llms)MultimodalNlpPpoPythonPyTorchSsmsTensorFlowTransformers

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account