Virginia Tech University Libraries

Virginia Tech University Libraries will plan an investigation of the auditability of Large Language Models for relevance screening in evidence synthesis. This project will run iterative experiments to improve the accuracy and auditability of the artificial intelligence-assisted screening workflow. The project will incorporate the feedback from evidence synthesis library professionals across the nation and will produce feasibility findings, prototype workflows, and implementation guidance that libraries can use to assess how artificial intelligence-assisted screening can be incorporated into evidence synthesis services while preserving established methodological standards. Deliverables include an artificial intelligence-enabled evidence synthesis prototype; an instruction manual; and a report.