Streamlining science: Recreating systematic literature reviews with AI-Powered decision tools

No Thumbnail Available
Authors
Manning, Christy
Zhuma, Sophie
Nagrecha, Shivani
Yessoufou, Mouiz
Koutogui, Toko
Gruetzemacher, Ross
Advisors
Issue Date
2023
Type
Conference paper
Keywords
Artificial intelligence , Decision support systems , Literature review
Research Projects
Organizational Units
Journal Issue
Citation
Manning, C., Zhuma, S., Nagrecha, S., Yessoufou, M., Koutogui, T., Gruetzemacher, R. Streamlining science: Recreating systematic literature reviews with AI-Powered decision tools. (2023). 29th Annual Americas Conference on Information Systems, AMCIS 2023.
Abstract

In recent years there has been an explosion of new information technologies that use artificial intelligence (AI) to improve decision-making in scientific research. However, the pace of innovation has far exceeded the capacity of researchers to evaluate such technologies. This project evaluates two new AI-powered research assistant tools for decision-making in literature review: Elicit, which uses GPT, and Research Rabbit, which uses a snowballing algorithm and natural language processing. Using a database search as a control, this project will evaluate overlap of records retrieved, proportion of records missed, time savings, and usability for each tool. The goal is to ascertain the technologies' reliability, efficiency, and acceptance. Such thorough evaluation is necessary to establish trust in these tools' performance and therefore to promote their adoption. This is the first known assessment of AI tools that operate by iteratively employing user's decisions as feedback for retrieving information for literature review. © 2023 29th Annual Americas Conference on Information Systems, AMCIS 2023. All rights reserved.

Table of Contents
Description
29th Annual Americas Conference on Information Systems: Diving into Uncharted Waters, AMCIS 2023
10 August 2023 through 12 August 2023
Publisher
Association for Information Systems
Journal
29th Annual Americas Conference on Information Systems, AMCIS 2023
Book Title
Series
PubMed ID
DOI
ISSN
EISSN