OpeningsFirst
How it worksPricingLog inGet started
OpeningsFirst › Jobs in the United States

Head of Inference Performance Visibility

Etched · etched.com
San JoseOn-siteDirector
Apply on Etched’s site

OpeningsFirst finds jobs like this first

  • Straight from company career pages. We check thousands of them every few hours.
  • The day they’re posted, often before LinkedIn or Naukri.
  • Only your kind of job: Executive / Director jobs in San Jose. 19 new this week.

From tomorrow’s email

Senior Director, Demand Generation Strategy
San Jose · found 15 h ago
Sr Director, Product Marketing
San Jose · found 15 h ago
Director of Quality
San Jose · found 16 h ago

Company names are shown to members.

New openings the day they’re posted, at 8 am and 6 pm. Cancel anytime. Full refund within 7 days.

The job in short

Lead the definition of performance telemetry and observability for AI accelerator systems.

C++Rust

Details

Found
26 d ago · posted 2026-02-19
Location as listed
San Jose
Role
Executive / Director
Pay (as listed)
$2,500 a month
Source
The company’s own careers site

Full description

About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and latency across both prefill and decode workloads. Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing industry in history. Job Summary We are hiring a Head of Performance Visibility to define how performance is understood across next-generation AI accelerator systems. Our ML accelerator platform spans custom silicon, supercomputing software, compiler stacks, runtime libraries, and distributed inference environments. Performance at this scale is no longer a device-level question — it is a high-performance distributed system problem. You will define the performance metrics that connect raw hardware signals to distributed workload context, ML cluster dynamics, pod communication patterns, and emergent bottlenecks. This role requires more than telemetry. You will establish new abstractions, structured counter ontologies, cross-layer event correlation frameworks, distributed time-alignment strategies, and scalable reasoning systems operating across nodes, racks, and clusters. Working at the intersection of hardware design, driver architecture, runtime systems, and ML infrastructure, you will shape how these layers expose and consume performance intelligence. This is a foundational role defining not just tooling, but how our platform reasons about efficiency, scalability, and system behavior for years to come. Key Responsibilities besides Mentorship and Leadership System-Level Performance Design • Define the architectural approach for collecting and structuring telemetry across CPUs, drivers, interconnects, and multiple accelerators • Design scalable models for correlating performance events across device and host boundaries Cross-Layer Event Correlation • Develop mechanisms to align hardware counters, runtime activity, communication phases, and workload semantics across model-layer execution into coherent, actionable insight • Implement time synchronization and trace-alignment strategies across multi-device systems Telemetry & Counter Modeling • Define structured counter taxonomies separating base signals from derived metrics • Design derived performance models bridging low-level hardware signals and workload-level behavior • Influence instrumentation strategy for future hardware generations Distributed Performance Reasoning • Build tools that identify bottlenecks among multi-accelerator workloads across chips within hosts • Build cluster-scale performance analysis for distributed inference across data center networks Tooling & Insight Delivery • Contribute to analysis engines and developer-facing tooling that transform raw telemetry into intuitive insight • Shape how performance intelligence is surfaced to engineers debugging large-scale AI systems You may be a good fit if you have • Deep experience building complex systems at the intersection of hardware and software • Personally envisioned and built significant portions of profiling, tracing, or observability systems — not solely defined requirements or product strategy • Demonstrated ability to translate raw hardware signals into scalable, production-grade telemetry and analysis infrastructure • Experience correlating time-series events across distributed systems • Deep systems programming expertise (C++ or Rust), with a track record of shipping low-level infrastructure operating close to hardware or runtime systems • Experience designing distributed correlation mechanisms, timestamp-alignment strategies, or performance modeling frameworks across multiple devices or hosts • Experience designing distributed tracing or observability platforms at scale • Experience with high-performance computing systems and large AI training clusters • Experience with timestamp synchronization strategies and event alignment in distributed environments • Experience with hardware counter design and instrumentation strategy • Experience with performance modeling for large-scale ML workloads • Experience leading cross-functional architectural initiatives spanning hardware and software teams Benefits • Medical, dental, and vision packages with generous premium coverage • $500 per month credit for waiving medical benefits • Housing subsidy of $2.5k per month for those living within walking distance of the office • Relocation support for those moving to San Jose (Santana Row) • Various wellness benefits covering fitness, mental health, and more • Daily lunch and dinner in our office • Unlimited compute budget subject to ROI justification How we’re different Etched believes in the Bitter Lesson. We are the first inference-focused frontier AI system. Our addressable market is the entirety of inference, unlike many of our competitors. We are a fully in-person team in San Jose (Santana Row), and greatly value engineering skills. We do not have boundaries between engineering and research, and we expect all of our technical staff to contribute to both and work across disciplines as needed.

Executive / Director jobs in the United States · All Etched jobs

Jobs in India · Jobs in the US · Who’s hiring in India · Who’s hiring in the US · How OpeningsFirst works · Free jobs widget
OpeningsFirst · Use with AI · Terms · Privacy · Refunds · Contact Showing prices for outside India or India