OpeningsFirst
How it worksPricingLog inGet started
OpeningsFirst › Jobs in the United States › Jobs in San jose, California

Software Engineer, Agent Harness & Evaluation

Sivad Consulting
San JoseMid level3–15 yrs
Apply on Sivad Consulting’s site

OpeningsFirst finds jobs like this first

  • Straight from company career pages. We check thousands of them every few hours.
  • The day they’re posted, often before LinkedIn or Naukri.
  • Only your kind of job: Machine Learning / AI Engineer jobs in San Jose. 3 new this week.

From tomorrow’s email

Machine Learning Engineer 4 - Machine Learning Foundations (MLX)
Capital One · San Jose · found 5 d ago
Machine Learning Engineer 4 - Machine Learning Experiences (MLX)
Capital One · San Jose · found 5 d ago

New openings the day they’re posted, at 8 am and 6 pm. Cancel anytime. Full refund within 7 days.

Subscribers got this job on 22 October 2026. New jobs reach them at 8 am and 6 pm, 5 days before they open here. Get the next one first

The job in short

AI agent harness and evaluation.

PythonTypeScriptLLM

Details

Found
6 d ago · posted 2026-10-22
Location as listed
San Jose, California, United States
Role
Machine Learning / AI Engineer
Pay (as listed)
$180,000–$325,000 a year
Source
The company’s own careers site

Full description

Software Engineer, Agent Harness & Evaluation – San Jose, CA $180k to $325k We are hiring Software Engineers to improve the performance, reliability, and efficiency of AI agents for hardware applications. You'll identify failure modes, design and run evaluations, develop new agent capabilities, and turn successful experiments into production software. You'll join a sizable, rapidly growing team of software engineers, researchers, hardware experts, customers, and founding and field teams, working across customer discovery, evaluation design, applied research, product development, and deployment for a broad range of hardware-engineering problems. Responsibilities • Finding where AI agents fail, then designing and running evaluations to improve their performance, reliability, and efficiency • Building new agent capabilities, including tool interfaces, context management, memory, and multi-step or multi-agent orchestration • Digging into traces and experiment results to find bottlenecks, and telling real improvements apart from benchmark noise • Working with customers and domain experts to understand what they need, then shipping and maintaining fixes from start to finish (within about 3 months) • Turning successful experiments into well-built, maintainable production software Qualifications • Strong software engineering skills, particularly in Python and TypeScript. • Familiarity with modern language models, agent systems, and common ML workflows. • Strong communication skills, customer judgment, and the ability to identify the crux of ambiguous technical problems. • Self-directed and ambitious, with strong ownership, creativity, and product judgment. • Strong commitment to customer and business outcomes. • Experience with LLM agents, orchestration, tools, memory, tracing, ML inference, and transformer architectures • Ability to interface directly with customers to understand requirements and deliver technical solutions • 3 - 15 years of experience as a software engineer with work on large-scale agent systems • Experience at a rigorous tech company (Applied Intuition, Palantir, Tesla, etc.) or AI startup (Fireworks, Harvey, Y Combinator companies, etc.) Nice to Haves • Interest in EDA, RTL, or hardware-software systems. • Experience or interest in electronic design automation (EDA), semiconductor domains, RTL, or hardware-software systems Education • Bachelor's in CS,​ EE,​ or similar degree from a top university

Machine Learning / AI Engineer jobs in San Jose, California · Machine Learning / AI Engineer jobs in the United States · All Sivad Consulting jobs

Jobs in India · Jobs in the US · Who’s hiring in India · Who’s hiring in the US · How OpeningsFirst works · Free jobs widget
OpeningsFirst · Use with AI · Terms · Privacy · Refunds · Contact Showing prices for India or elsewhere