OpeningsFirst
How it worksPricingLog in
OpeningsFirst › Jobs in the United States › Jobs in Redmond, Washington › Data Scientist jobs in the United States

Data Scientist II, EngThrive Insights - CoreAI

Microsoft · microsoft.com
RedmondMid level2+ yrs
Apply on Microsoft’s site
Posted 7 days ago. 309 more Data Scientist jobs in the United States went up on company career pages this week. See the newer ones

Share this job on LinkedIn · X

Straight from the company’s own careers site.

The job in short

Data scientist building and evaluating LLM and agentic AI systems with retrieval-augmented generation.

PythonSQLAzureMachine learningLLMLangChainReinforcement learningData scienceAgenticPrompt engineering

Details

Found
5 d ago · posted 2026-11-09
Location
Redmond, WA, US

Full description

Leverages understanding of data science and business to examine a project and consider factors that can influence final outcomes within a technical area. Evaluates project plan for resources, risks, contingencies, requirements, assumptions, and constraints. Documents key business objectives. Effectively communicates business goals in analytical and technical terms. Consistently shares insights with stakeholders. Collaborates with immediate team members on defining metrics and frameworks for evaluating somewhat complex AI/large language model (LLM) systems and agentic product performance. Experiments with model before selection (e.g., LLM, prompting approach) for tasks within a product or solution Diagnose basic issues and identifies opportunities to drive improvements within AI/LLM systems within domain area. Prototypes and develops AI models using containerized environments (e.g., AI Azure Foundry, LangChain) to operationalize, build, and validate scalable tools/applications/solutions for use by the immediate team. Develops and deploys systems for basic retrieval-augmented generation workflows, assisting in the selection of data sources, retrieval systems, and generative models to ensure quality output. Assists senior members in assessing and refining LLM systems and models. Understands where to acquire data necessary for successful completion of the project plan. Utilizes querying, visualization, and reporting techniques to describe acquired data, including format, quantity, identities, and other surface properties. Explores data for key attributes and contributes to the development of data quality report describing results of the task, initial findings, and impact on the project by leveraging appropriate AI tools (e.g., Codex, GitHub Copilot). Collaborates with others to perform data-science experiments using established methodologies, statistics, optimization, and probability theory for general purpose software and statistical packages. Assesses different tools and techniques and selects the appropriate one. Serves as an effective partner in data preparation efforts to Solution Architects, Consultants, and Data Engineers. Identifies data integrity problems. Leverages knowledge of modeling and machine learning solutions (e.g., state-of-the-art statistical analysis, causal modeling, reinforcement learning) to identify the best approach to complete objectives. Understands modeling techniques (e.g., validation, hypothesis testing, optimal use of data) and machine learning in order to select the correct approach to prepare data, train and optimize the model, and evaluate the output for statistical and business significance. Understands the risks of data leakage, the bias/variance tradeoff, methodological limitations, etc. Writes all necessary scripts in the appropriate language: T-SQL, U-SQL, KQL, Python, R, etc. Constructs hypotheses, designs controlled experiments, analyzes results using statistical tests, and communicates findings to business stakeholders. Effectively communicates with diverse audiences on data-quality issues and initiatives. Understands operational considerations of model deployment, such as performance, scalability, monitoring, maintenance, integration into engineering production system, stability. Develops operational models that run at scale through partnership with data engineering teams. Understands and keeps up to date on embedding models and vector databases. Learns and understands the current state of the industry, including knowledge of tools, techniques, strategies, and processes that can be utilized to improve process efficiency and performance. Maintains knowledge of current trends within the discipline. Attends internal research conferences and participates in on-hands training, when appropriate. Actively contributes to the body of thought leadership and intellectual property (IP) best practices. Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) or consulting experience OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 2+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) OR equivalent experience. These requirements include but are not limited to the following specialized security screenings: Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) OR equivalent experience. Experience with observational causal inference methods, design of controlled experiments, regression modeling, and hypothesis testing. Experience evaluating LLMs and/or AI agents — designing offline/online evaluations, defining quality metrics, and measuring model behavior. Experience designing surveys and analyzing response data Proficiency in Python programming Proficiency in analytical query languages like SQL, KQL (Kusto Query Language), or similar analytical query languages. Experience developing analytics on Spark-based big data platform technologies such as Databricks. Data storytelling — crafting and presenting compelling data stories to business decisionmakers Familiarity with developer productivity metrics and frameworks (e.g., DORA, SPACE, or similar). Demonstrated effective use of AI coding assistants in daily data science development workflow

All Microsoft jobs

Get jobs like this every morning

Jobs in India · Jobs in the US · Who’s hiring in India · Who’s hiring in the US · Browse all jobs · Companies · How OpeningsFirst works · Free jobs widget · Leadership jobs in India · Leadership jobs in the US · Senior jobs in India · Senior jobs in the US · Fresher jobs in India · Entry-level jobs in the US · Remote jobs in the US · Jobs paying $150k+ · Leadership hiring this week · Guides
OpeningsFirst · Use with AI · Terms · Privacy · Refunds · Contact · Follow us on LinkedIn · X