Member of Technical Staff, Inference Systems Company: Confidential — founded by Stanford alumni with deep AI infrastructure experience Location: Palo Alto, CA (on-site 5 days per week) Compensation: $230,000 - $350,000 + competitive equity Employment Type: Full-time Visa Sponsorship: Visa transfers and new sponsorship (H-1B, TN) About the Company The client is building a next-generation AI inference platform from the ground up with a relentless focus on performance. It was founded by Stanford alumni with deep AI infrastructure experience, including early work at Together AI, and is engineering the entire inference stack with Rust at its core. The client has raised a $10M seed from notable investors and is currently in stealth ahead of announcing its fundraise and product. The Role The client is hiring Members of Technical Staff (2+ years) to build a high-performance inference platform from scratch. You are a systems engineer who knows inference internals (attention, KV cache, batching, scheduling) and wants to own the whole stack rather than a narrow slice. You will join a small team building a new inference system in Rust, where you shape every design decision. What You Will Do • Build a new inference runtime in Rust, owning batching, scheduling, request routing and the serving stack. • Design KV cache management, prefix caching and optimizations that reduce latency and cost per token. • Scale serving across GPUs and nodes. • Profile, benchmark and ship performance improvements across the inference pipeline. • Make core architecture decisions with the founding team. What You Bring • 2+ years of systems engineering experience • Deep knowledge of inference internals: attention, KV cache, batching and scheduling • Experience inside inference engines such as vLLM, SGLang or TensorRT-LLM • Strong systems programming (Rust, C++ or similar) • Ability to work on-site in Palo Alto 5 days a week Tech Stack Rust, Python, PyTorch, C++, Go, vLLM, SGLang, TensorRT-LLM, CUDA, Triton, NCCL Before you apply: get a free recruiter-readiness score for your resume at CareerStanding — about a minute, no signup, and your resume stays in your browser.