AI Research Engineer, Inference
Op Recruiting · oprecruiting.com
ChicagoHybrid2+ yrs
Subscribers got this job on 18 October 2026.
New jobs reach them at 8 am and 6 pm, 5 days before they open here. Get the next one first
The job in short
Low-latency deep learning inference optimization, custom kernels and hardware acceleration.
Machine learningDeep learningLLMsNLPComputer visionPyTorchFPGALLM
Details
- Found
- 8 d ago · posted 2026-10-18
- Location as listed
- Chicago, United States
- Role
- Machine Learning / AI Engineer
- Source
- The company’s own careers site
Full description
Job Title: AI Research Engineer – Deep Learning Inference
Location: New York, NY | London, UK
About the Opportunity
Join an industry-leading global quantitative technology organization at the forefront of machine learning innovation. We are seeking a High-Performance AI Research Engineer to drive speed and scalability across our real-time predictive modeling infrastructure. In this role, you will bridge the gap between machine learning research and hardware acceleration, building low-latency inference systems that process continuous global data streams to drive core business decisions.
Responsibilities
•
Drive performance optimizations across all aspects of large-scale model execution, including custom kernel creation, data streaming pipelines, and novel hardware integration.
•
Partner directly with machine learning researchers to co-design neural architectures optimized for extreme real-time execution.
•
Author low-level primitives and custom operations to extract maximum compute throughput from modern hardware architectures.
•
Evaluate, benchmark, and deploy novel hardware acceleration tech, ranging from off-the-shelf accelerators to custom specialized silicon.
•
Formulate and execute engineering initiatives that address complex, non-obvious bottlenecks in ultra-low-latency deep learning inference.
Requirements (Must-Have)
•
At least two years of hands-on experience engineering production-grade deep learning systems within any complex domain (such as robotics, computer vision, audio, NLP, physics, or recommender platforms).
•
Strong lower-level engineering foundation, including experience writing custom compute kernels (e.g., CUDA, Triton, Pallas, or CuTe DSLs).
•
Proficiency with framework compilation internals and low-level runtime environments (PyTorch, JAX, XLA, or CUDA Graphs).
•
Practical exposure to hardware acceleration tech, such as FPGAs, ASICs, or specialized AI processors.
•
Proven ability to adapt algorithms and technical concepts across different domain applications.
Preferred Qualifications
•
Experience optimizing or serving Large Language Models (LLMs) and foundation architectures.
•
Note: Prior background in quantitative finance or trading is explicitly NOT required.
Compensation & Benefits
•
Highly competitive base salary, performance-based bonus incentive, and premium health/wellness benefits package.
We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, color, ethnic origin, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
OP Recruiting, a member of the Objective Partners family of specialized talent solution providers, uses AI-assisted tools, including Alex by Apriora, to support our recruiting process. These tools may review application materials and analyze interview responses to provide insights about a candidate's experience and qualifications. AI output informs our recruiters; decisions about whether to advance or present a candidate are made by people. Learn more about our use of AI, including how to request an accommodation: https://www.oprecruiting.com/ai-in-our-hiring-process.
#LI-EH1 #LI-Hybrid
Machine Learning / AI Engineer jobs in the United States · All Op Recruiting jobs