Comspark International Inc. Logo

Comspark International Inc.

HPC Engineer/Architect

Reposted 23 Days Ago
Be an Early Applicant
In-Office
New York, NY, USA
Expert/Leader
In-Office
New York, NY, USA
Expert/Leader
Support and operate large-scale Linux HPC clusters and parallel file systems (GPFS); deploy and maintain GPU-based compute infrastructure; manage and migrate job schedulers (LSF to Slurm); automate deployment, testing, CI/CD and user lifecycle with Ansible, Python and shell scripting; performance tune storage and networks (InfiniBand); consult researchers and maintain HPC benchmarks and monitoring.
The summary above was generated by AI

Job Title: HPC Engineer/Architect

Work Location: New York, NY 10001

Job Type: Contract

Work Type: Hybrid

Duration: 6+ Months

USC/GC/H4/H1

Job Summary:

  • You will support day-to-day operations of large-scale parallel file systems, deploy and maintain Linux HPC infrastructure across multiple data centers, and assist HPC engineers and architects with day-to-day operations and tickets.

  • Support day-to-day operations of large-scale parallel file systems

  • Deploy and Maintain Linux HPC infrastructure across multiple datacenters

  • Assist HPC engineers and architects with day-to-day operations and tickets

Experience:

  • 16 to 20 years

Required Skills:

  • Linux Operating Systems (RHEL/CentOS), Parallel file system (GPFS), Job Scheduler LSF/Slrm

  • Anxible, Python, Shell scripting

  • GPU-based compute infrastructure (including CUDA)

  • CentOS 4.5

  • HPCC

Responsibilities:

  • Design, architect and oversee implementation of Linux based HPC clusters and storage

  • Deploy physical hardware using HPC deployment tools and configuration and orchestration tools (Ansible)

  • Parallel file system (GPFS) performance tuning, monitoring and troubleshooting

  • Perform systems benchmarking, and developing automated tests for the HPC environment, ensuring the reliability and efficiency of our computational infrastructure

  • Infiniband network maintenance and troubleshooting

  • Automate and monitor the HPC user lifecycle process

  • Slurm installation, configuration, performance tuning and troubleshooting

  • Plan, design and implement a transition from the LSF scheduler to Slurm

  • Manage the Slurm scheduler and translate Research policies into scheduler configurations

  • Consult with faculty and students to develop research pipelines for use on the HPC cluster

  • Develop and maintain user lifecycle software suite in Python, implement CI/CD pipeline

  • Test and automate upgrades of critical system applications using Ansible and shell scripts.

  • The ability to communicate effectively with clinicians, researchers, and other team members to develop technological solutions is key

Qualifications:

  • Experience working in a large-scale research based HPC environment

  • Proven experience working with distributed file storage solutions (i.e., GPFS)

  • Experience with deploying and troubleshooting Linux Operating Systems (RHEL/CentOS)

  • Experience with Scripting and Automation (Ansible, Python, Shell Scripting)

  • Solid understanding of job schedulers (LSF/SLURM)

  • Experience with GPU-based compute infrastructure (including CUDA)

Similar Jobs

An Hour Ago
Hybrid
New York, NY, USA
102K-144K Annually
Senior level
102K-144K Annually
Senior level
Fintech • Software • Financial Services
Manage and expand relationships with institutional investment-management clients. Develop senior stakeholder networks, understand client needs, support existing-client sales opportunities, gather feedback to guide product expansion, maintain knowledge of investment technology, and ensure engagement across client organizations. The role also provides mentorship to analysts and requires strong financial-services knowledge, communication, organization, and problem-solving skills.
Top Skills: DerivativesFixed-Income SecuritiesInvestment Reporting TechnologyMS OfficeStructured Products
Yesterday
Easy Apply
Hybrid
New York, NY, USA
Easy Apply
120K-150K Annually
Senior level
120K-150K Annually
Senior level
Fintech • HR Tech
Own Gusto’s franchise partner channel by recruiting and signing franchisors, negotiating agreements, onboarding and managing partner relationships, and driving franchisee adoption. Responsibilities include outbound prospecting, pipeline forecasting, performance reporting, renewals, co-marketing coordination, and cross-functional collaboration with sales, legal, marketing, revenue operations, product, and integrations teams.
Top Skills: Ai ToolsOutreachPartner Management PlatformsSalesforce
Yesterday
Remote or Hybrid
New York, NY, USA
194K-321K Annually
Expert/Leader
194K-321K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Leads ServiceNow’s U.S. Healthcare Provider sales business, driving revenue growth, market share, executive customer relationships, sales strategy, pipeline performance, and partner engagement. Recruits and develops a high-performing sales organization, manages complex sales cycles, collaborates with product and marketing teams, and ensures compliant go-to-market execution. Requires deep healthcare provider expertise, executive presence, extensive sales leadership experience, AI awareness, and willingness to travel.
Top Skills: AIAi-Powered ToolsServicenowWorkflow Automation

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account