Multi-Agentic Oncology Value Scorecard Creation with LLMs
Based on some great discussions with my previous Pfizer colleagues Brett South, Jay Ronquillo, Jon Mauer, and Stephen Watt, this project aims to replicate established oncology value frameworks, such as the ISPOR Scorecard and ASCO Value Framework, using Large Language Models (LLMs) to validate their capabilities in reproducing human-derived scorecards. The project implements and compares three LLM-based approaches—multi-agent systems, single LLM pipelines, and retrieval-augmented generation (RAG)—using data from ClinicalTrials.gov, PubMed, and OpenFDA, with a fourth MOA-based multi-agent framework later integrated for enhanced synthesis and traceability.
