Member of Technical Staff - Model Optimization and Inference
Transparent Search Group · transparentsearchgroup.com
SeattleLead / Manager2+ yrs
Posted 1 month ago. 18 more Machine Learning / AI Engineer jobs in Seattle, Washington went up on company career pages this week.
See the newer ones
Straight from the company’s own careers site.
The job in short
Model optimization and inference engineering.
PythonRustReactAirflowKubernetesTerraformLLMLLMs
Details
- Found
- 43 d ago · posted 2026-10-03
- Location
- Seattle, Washington
- Pay (as listed)
- $250,000–$350,000 a year
Full description
Member of Technical Staff - Model Optimization and Inference
Company: Confidential — venture-backed technology company
Location: Seattle, WA (in office 5 days per week; relocation assistance available)
Compensation: $250,000 - $350,000 + equity
Employment Type: Full-time
Visa Sponsorship: Visa sponsorship available
About the Company
The client builds photorealistic, real-time AI avatars with emotional intelligence: a full-duplex audiovisual system that can listen, speak, react and respond like a real person. The research team includes PhDs from MIT, UW, Oxford, CMU and Johns Hopkins.
Founded in 2024, the client has raised $60M and has about 25 people.
The Role
The client is hiring an experienced ML Infrastructure/Systems Engineer (2+ years) to own end-to-end inference optimization across LLMs, audio models and diffusion components, with a focus on latency, throughput and cost.
What You Will Do
• Own end-to-end inference optimization across the model stack.
• Implement and tune KV cache strategies for long-context conversations.
• Evaluate, deploy and extend serving frameworks such as vLLM, SGLang and TensorRT-LLM.
• Profile and benchmark latency and throughput and remove bottlenecks.
• Accelerate diffusion inference and apply quantization techniques (INT8, INT4, GPTQ, AWQ).
• Build internal tooling that makes optimization work faster and more rigorous.
What You Bring
• 2+ years building and maintaining production ML systems
• Designing scalable infrastructure from scratch
• Track record optimizing latency, throughput and cost
• Debugging distributed systems
Nice to Have
• Video or audio model experience
• CUDA kernels and low-level optimization
• Real-time video streaming (WebRTC)
Benefits
HSA with about $2,000 annual company contribution, 15 days PTO plus public holidays and a company-wide office closure week.
Tech Stack
Kubernetes, Terraform, Python, Rust, Go, Dagster, Ray, Airflow, WebRTC, vLLM, Triton Inference Server, TensorRT
Before you apply: get a free recruiter-readiness score for your resume at CareerStanding — about a minute, no signup, and your resume stays in your browser.
Machine Learning / AI Engineer jobs in the United States · All Transparent Search Group jobs · Senior Machine Learning / AI Engineer jobs in Seattle, Washington · Senior Machine Learning / AI Engineer jobs in the United States · Senior and manager-level jobs in Seattle, Washington · Senior roles at Transparent Search Group