OpeningsFirst
How it worksPricingLog inGet started
OpeningsFirst › Jobs in the United States › Jobs in San Francisco County, California

AI/ML Infra Engineer - Hosting

Hamilton Barnes · hamilton-barnes.com
San Francisco County
Apply on Hamilton Barnes’s site

OpeningsFirst finds jobs like this first

  • Straight from company career pages. We check thousands of them every few hours.
  • The day they’re posted, often before LinkedIn or Naukri.
  • Only your kind of job: Machine Learning / AI Engineer jobs in San Francisco County.

New openings the day they’re posted, at 8 am and 6 pm. Cancel anytime. Full refund within 7 days.

Subscribers got this job on 17 October 2026. New jobs reach them at 8 am and 6 pm, 5 days before they open here. Get the next one first

The job in short

ML infrastructure hosting engineering.

PythonNode.jsKubernetesLinuxMachine learningLLMPyTorchNetworking

Details

Found
12 d ago · posted 2026-10-17
Location as listed
San Francisco County, California, United States
Role
Machine Learning / AI Engineer
Source
The company’s own careers site

Full description

Ready to take the next step in your career? Join a rapidly growing AI cloud infrastructure provider building high-performance compute platforms for large-scale AI training and inference workloads. With expanding GPU infrastructure across Europe and the United States, the organisation enables AI teams to access scalable compute environments without traditional infrastructure limitations. As a Senior ML Infrastructure Engineer, the successful candidate will help build and scale Kubernetes-based machine learning platforms supporting large-scale training and inference systems. The role focuses on workload orchestration, GPU scheduling, inference optimisation, and distributed systems reliability, working alongside highly technical teams at the intersection of machine learning, cloud infrastructure, and high-performance computing. If you would like to learn more about this opportunity, feel free to reach out and apply today! Responsibilities: • Build and scale internal ML infrastructure platforms focused on AI training and inference workloads • Develop systems for workload orchestration, job scheduling, and reliable execution across Kubernetes environments • Improve and maintain inference infrastructure, including model packaging, deployment, and serving optimisation • Collaborate with infrastructure and platform teams to maximise GPU utilisation, hardware performance, and operational reliability • Design scalable systems and reusable platform capabilities that improve developer experience and operational efficiency • Support CI/CD, GitOps, and infrastructure automation workflows across ML platform environments • Troubleshoot GPU performance, distributed systems behaviour, networking, and storage bottlenecks • Contribute to platform architecture discussions and long-term infrastructure scalability initiatives Skills/Must Have: • Strong ML engineering background with hands-on experience supporting both training and inference infrastructure • Experience with infrastructure engineering, platform engineering, or software engineering environments • Strong programming skills in Python (Go experience is a plus) • Deep experience with Kubernetes, including operators, CRDs, workload orchestration, and GPU scheduling • Comfortable operating in Linux environments and debugging GPU-related issues, including CUDA, drivers, networking, and filesystems • Strong systems thinking and ability to design scalable, reliable, distributed infrastructure • Experience with CI/CD pipelines, GitOps workflows, and infrastructure automation Desirable Skills: • Familiarity with orchestration and scheduling platforms such as Kueue, Flyte, Ray, or Slurm • Experience with PyTorch or JAX environments • Hands-on experience deploying inference workloads using vLLM, SGLang, TensorRT-LLM, or Triton • Knowledge of GPU networking and performance optimisation, including InfiniBand, NVLink, and NCCL • Experience working within HPC or large-scale distributed systems environments Benefits: • Stock options Salary: • $250,000 base salary

Machine Learning / AI Engineer jobs in the United States · All Hamilton Barnes jobs

Jobs in India · Jobs in the US · Who’s hiring in India · Who’s hiring in the US · How OpeningsFirst works · Free jobs widget
OpeningsFirst · Use with AI · Terms · Privacy · Refunds · Contact Showing prices for outside India or India