Senior AI Data Engineer
CM Legal · cmlegalsearch.com
New York, WashingtonHybridSenior5+ yrs
Subscribers got this job on 17 October 2026.
New jobs reach them at 8 am and 6 pm, 5 days before they open here. Get the next one first
The job in short
AI data engineering.
PythonDatabricksLLMLangChainRAGPrompt engineeringLegal
Details
- Found
- 8 d ago · posted 2026-10-17
- Location as listed
- New York NY
- Role
- Data Engineer
- Source
- The company’s own careers site
Full description
A leading technology law firm is seeking a Senior AI Data Engineer to join the Innovation team of its AI subsidiary. This is a high-impact individual contributor role responsible for building and maintaining the AI infrastructure layer that powers the firm’s AI-powered data applications on its Northstar Lakehouse.
The engineer will design and own production RAG pipelines, embedding infrastructure, and vector search, ensuring retrieval quality is monitored and reliable. The role also covers the LLM integration layer, including prompt engineering, output validation, fallback handling, and cost-aware API usage, along with observability tooling that tracks response quality, latency, and token consumption. Working closely with a Senior Data Application Engineer and the Data Engineering & Platform team, the engineer will build governed data pipelines within Unity Catalog controls and apply responsible AI practices across all features.
Candidates should have 5+ years of data engineering or AI engineering experience with hands-on production responsibility for RAG pipelines and LLM integration in a cloud data platform environment, along with strong Python, Databricks, and vector search experience. Familiarity with orchestration frameworks such as LangChain or LangGraph and legal sector experience are a plus.
The firm offers a flexible hybrid arrangement for candidates near an office, with remote work available in approved states. The salary range is $200,000$250,000.
Data Engineer jobs in New York, New York · Data Engineer jobs in the United States · All CM Legal jobs