Nikhil Abhyankar · Virginia Tech

Building Safe LLM Agents for Open-Ended Scientific Discovery

LLMs possess scientific domain knowledge that can be leveraged to help scientists speed up the discovery process. We build agents that ground every proposal in this knowledge, validate it against real evidence, and run the next experiment when the data cannot yet tell competing hypotheses apart.

Explore the projects

The Scientific Discovery Process

The scientific discovery process: propose, validate, experiment, refine, and back to propose. 01 02 03 04 Propose Validate Experiment Refine Open-Ended Discovery hypotheses ⇄ evidence
  1. 01

    Propose candidates

    The LLM drafts candidate hypotheses as equations, programs or crystal structures, guided by domain knowledge and priors.

  2. 02

    Validate against evidence

    Every proposal is executed, fitted and scored on data, simulators or property oracles. Nothing is accepted on the model’s word.

  3. 03

    Choose the next experiment

    The agent queries where its competing hypotheses disagree most, so each new observation rules something out.

  4. 04

    Refine belief

    Successes, failures and confidence checks update the agent’s belief about which hypotheses hold, steering later rounds away from spurious fits and memorized answers.

Accepted Publications

LLM-ACES

NeurIPS 2026

Closed-Loop Discovery of Dynamical Systems with LLM-Guided Adaptive Search

LLM-AutoSciLab

NeurIPS 2026

Closed-Loop Scientific Discovery via Active Experimentation with LLMs

LLM-FE

TMLR 2026

Automated Feature Engineering for Tabular Data with LLMs as Evolutionary Optimizers

Portrait of Nikhil Abhyankar

About

Nikhil Abhyankar

PhD, CS at Virginia Tech

Nikhil works on making LLM-based systems reliable enough for decision-making over structured data and scientific workflows. His research sits where LLM reasoning, tabular data and AI for science meet, with a focus on methods and benchmarks that expose real failure modes and improve end-to-end performance.

Research Interests
  • AI4Science
  • Structured Data Analysis
  • Open-Ended Discovery
  • LLM Reasoning
Venues
NeurIPS · ICLR · COLM · NAACL · TMLR