Streamlining science: Recreating systematic literature reviews with AI-Powered decision tools
Authors
Advisors
Issue Date
Type
Keywords
Citation
Abstract
In recent years there has been an explosion of new information technologies that use artificial intelligence (AI) to improve decision-making in scientific research. However, the pace of innovation has far exceeded the capacity of researchers to evaluate such technologies. This project evaluates two new AI-powered research assistant tools for decision-making in literature review: Elicit, which uses GPT, and Research Rabbit, which uses a snowballing algorithm and natural language processing. Using a database search as a control, this project will evaluate overlap of records retrieved, proportion of records missed, time savings, and usability for each tool. The goal is to ascertain the technologies' reliability, efficiency, and acceptance. Such thorough evaluation is necessary to establish trust in these tools' performance and therefore to promote their adoption. This is the first known assessment of AI tools that operate by iteratively employing user's decisions as feedback for retrieving information for literature review. © 2023 29th Annual Americas Conference on Information Systems, AMCIS 2023. All rights reserved.
Table of Contents
Description
10 August 2023 through 12 August 2023