Handsearching had best recall but poor efficiency when exporting to a bibliographic tool: case study

Abstract

Objective: To compare the effectiveness and efficiency of methods used to identify and export conference abstracts into a bibliographic management tool.

Study design and setting: Case study. The effectiveness and efficiency of methods to identify and export conference abstracts presented at the American Society of Hematology (ASH) conference 2016-2018 for a systematic review were evaluated.

A reference standard handsearch of conference proceedings was compared to: 1) contacting Blood (the journal who report ASH proceedings); 2) keyword searching; 3) searching Embase; 4) searching MEDLINE via EndNote; and 5) searching CPCI-S. Effectiveness was determined by the number of abstracts identified compared with the reference standard, while efficiency was a comparison between the resources required to identify and export conference abstracts compared to the reference standard.

Results: 604 potentially eligible and 15 confirmed eligible conference abstracts (abstracts included in the review) were identified by the handsearch. Comparator 2 was the only method to identify all abstracts and it was more efficient than the reference standard. Comparators 1, and 3-5 missed a number of eligible abstracts.

Conclusion: This study raises potentially concerning questions about searching for conferences’ abstracts by methods other than directly searching the original

conference proceedings. Efficiency of exporting would be improved if journals permitted bulk downloads.