Palona AI Logo

Palona AI

AI Infrastructure Engineer

Posted 23 Hours Ago
In-Office
New York, NY, USA
Mid level
In-Office
New York, NY, USA
Mid level
Build and operate scalable, secure cloud infrastructure for real-time AI services. Improve reliability with SLOs, observability, capacity planning, and failure testing. Implement IaC, CI/CD, deployment safety, secrets and vulnerability management. Partner with product and AI teams, diagnose distributed failures, reduce cost, and automate platform patterns to enable faster, safer releases.
The summary above was generated by AI

Palona’s AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience.

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona’s AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.

Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching.

What you will own:
  • Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications.
  • Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention.
  • Build deployment and release systems that make production changes fast, repeatable, auditable, and safe.
  • Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production.
  • Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities.
  • Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries.
  • Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity.
  • Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations.
  • Build internal tooling and paved paths that let engineers ship and operate services with less manual work.
  • Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment.

Requirements
  • 3+ years industrial experience in relevant technical domain.
  • Strong software engineering fundamentals and experience building or operating production distributed systems.
  • Hands-on experience with a major cloud platform; AWS experience is especially relevant.
  • Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging.
  • Ability to write reliable automation and services in Python or another modern programming language.
  • Sound judgment around availability, latency, scalability, security, and cost tradeoffs.
  • A track record of taking ambiguous operational problems from diagnosis through durable resolution.
  • Clear communication during architecture reviews, launches, and incidents.
  • AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems.

Benefits
  • Competitive Salary and Stock Option Plan.
  • Medical, dental, vision, retirement, leave, and disability benefits as applicable.
  • Family Leave
  • Short Term & Long Term Disability
  • Paid time off and company holidays.
  • Learning and development support.

Similar Jobs

6 Hours Ago
Remote or Hybrid
California, USA
Senior level
Senior level
Artificial Intelligence • Computer Vision • Machine Learning • Robotics
Design, deploy, and maintain large-scale bare-metal GPU clusters for distributed training. Tune Slurm schedulers and Kubernetes integrations, optimize storage and high-speed networking, and build observability pipelines to ensure reliable, high-throughput GPU workloads for distributed deep learning.
Top Skills: AnsibleBashCephCgroupsDcgmDeepspeedDgxGrafanaHelmHgxInfinibandKuberayKubernetesLinuxLustreMpi OperatorNcclNfsNvidia B200Nvidia B300Nvidia H100NvlinkNvme-OfPrometheusPythonRayRoceSlurmSmdbSubnet ManagerTerraformWeka
12 Hours Ago
In-Office
Senior level
Senior level
Sports
Build AI-native automation systems, developer tooling, and high-scale data ingestion for sportsbook odds and market feeds. Create AI workflows/agents that generate and validate code, maintain data feeds, automate debugging/testing/deployments, and monitor failures with automated remediation. Focus on internal automation, LLM orchestration, and distributed backend pipelines to accelerate the engineering team.
Top Skills: AWSClickhouseGoLlm ToolingPostgresPythonTypescript
Mid level
Artificial Intelligence • Hardware • Software • Semiconductor
Design, implement, and maintain Python frameworks and services that orchestrate distributed engineering workflows across machines and clusters. Build scheduling, execution, resource management, failure recovery, and test infrastructure. Define APIs and abstractions, reason about concurrency and distributed-systems behavior, debug complex multi-system issues, write automated tests and documentation, and partner with platform, CI, release, QA, and product teams to deliver scalable infrastructure.
Top Skills: AsyncioBuild SystemsCi SystemsCluster SchedulersConcurrent.FuturesContainersKubernetesMultiprocessingPytestPythonRelease InfrastructureRemote Execution Systems

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account