ML / Fine-Tuning Engineer
Dataeconomy · dataeconomy.io
HyderabadHybridSenior5+ yrs
The job in short
Fine-tuning ML models.
PythonNode.jsAWSLLMLLMsPyTorchFine-tuningInsurance
Details
- Found
- 22 d ago · posted 2026-09-08
- Location as listed
- Hyderabad, Telangana, India
- Role
- Machine Learning / AI Engineer
- Source
- The company’s own careers site
Full description
Job Title:ML / Fine-Tuning Engineer
Location: Hyderabad OR Pune
Notice Period : 0-30 Days
Mode of Work:Hybrid
Experience :5+ Years
We are looking for ML / Fine-Tuning Engineer who can deliver (under supervision of ProServe Tech Lead) the end-to-end
fine-tuning of open-source LLMs for a narrow, high-volume production task on
AWS — SFT and alignment experiments (GRPO, DPO), debugging training on
multi-GPU clusters, and iterating to strict accuracy targets. Models from 8B to
70B parameters.
What We Expect:
• Fine-tune
open-source LLMs (Qwen, Llama) from experiment to production-ready
checkpoint
• Run
SFT and RL alignment (GRPO, DPO) to improve output accuracy
• Execute
training on AWS GPU instances (p4d, p5, g5) using distributed training
• Diagnose/fix
training issues: loss imbalances, OOM errors, gradient instabilities
• Collaborate
with evaluation and data engineering to iterate on quality gaps
• Make
data-driven model scaling decisions (8B → 14B → 70B)
based on offline metrics
Requirements
• Experience: 5+
years ML engineering, with 2+ years in LLM fine-tuning
• LLM
Models: Hands-on with open-source LLMs — Qwen and Llama
required
• Training
Methods: SFT, LoRA/QLoRA, GRPO, DPO/RLHF
• Frameworks: NVIDIA
NeMo/NeMoRL, VeRL, HuggingFace TRL — must have used at least two
• Distributed
Training: DeepSpeed ZeRO, FSDP2, multi-node GPU orchestration
• AWS
Infrastructure: p4d/p5/g5 GPU instances, SageMaker Training Jobs
• Languages: Python,
PyTorch; CUDA debugging a plus
Preferred (Not Required): Fine-tuning for
tool-calling/agent tasks; multi-node GRPO/RLHF with NeMoRL or VeRL; tokenizer
internals and chat-template rendering for tool-use formats.
Benefits
• Comprehensive Medical Coverage:
Health insurance
of INR 5.0 Lakhs for you and your family (up to 6
members), ensuring complete peace of mind.
• Robust Protection Plans:
Group Personal Accident
Insurance and Group Term Life Insurance to safeguard you and
your loved ones.
• Retirement Benefits:
PF and Gratuity provided as
per standard government regulations.
• Flexible Work Options:
Enjoy hybrid work
arrangements & flexible working hours.
• Generous Leave Policy:
21 days of annual leave, in
addition to 10 company-declared holidays.
• Employee Well-being Spaces:
Access to a dedicated
break-out area with round-the-clock refreshments for
relaxation and rejuvenation.
Machine Learning / AI Engineer jobs in Hyderabad · Machine Learning / AI Engineer jobs in India · All Dataeconomy jobs