Evidence Synthesis Methods Interest Group

 View Only
last person joined: 18 hours ago 

Charge: To promote and develop competencies around evidence synthesis including systematic reviews, meta-analyses, scoping reviews, and other related methods of research synthesis, through activities such as: Facilitating discussion and peer-support; Creating and managing a resource page; Encouraging programming and publications around systematic reviews through ACRL.
Community members can post as a new Discussion or email ALA-acrlesmig@ConnectedCommunity.org
Before you post: please note job postings are prohibited on ALA Connect. Please see the Code of Conduct for more information.
  • 1.  Reporting of "false positives"/"false negatives"

    Posted Jul 22, 2021 02:30 PM

    Hello,

    I'm hoping that someone on this list may be able to help.

    I've received a question from a patron regarding a reviewer's comments on an article submission.  The article uses systematic map methodology, and reports the search/screening process in a PRISMA diagram. 

    The reviewer commented that:   "In the survey of articles published, have authors looked at false discovery rates is not clear in the manuscript. It may be good to indicate somewhere in the text about rate of false positives/negatives in the search method."

    The patron isn't sure what is meant by "false positives" and "false negatives", and I'm not sure either.  My initial thought is that "false positives" are those articles retrieved in the search that did not meet the screening requirements, and that "false negatives" are relevant articles that were not retrieved by the search.  If this is the case, "false positives" are reported in the PRISMA diagram, but I'm not sure how to address the "false negatives."

    If anyone has insight into what the reviewer might be asking, or possible methods to address their concerns, I would be very grateful.

    Thanks in advance for your help!

    Best wishes,

    Jocelyn Boice


    --
    Jocelyn Boice
    Associate Professor | Liaison to:  Natural Resources, Mathematics, Statistics, Computer Science
    Colorado State University Libraries
    1019 Campus Delivery
    Fort Collins, CO 80523
    970-491-3882 | jocelyn.boice@colostate.edu



  • 2.  RE: Reporting of "false positives"/"false negatives"

    Posted Jul 23, 2021 11:42 AM
    I could be totally wrong, but I'm guessing that they are referring to verification or validation of your search strategies. If yes, you could discuss the steps (e.g., citation tracking) you took to mitigate not finding relevant studies in your manuscript.

    Sources:
    Validating, Verifying and Revising Your Searches  https://library.medicine.yale.edu/tutorials/1137
    Development and validation of a search filter to identify equity-focused studies: reducing the number needed to screen https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-018-0567-x

    --





  • 3.  RE: Reporting of "false positives"/"false negatives"

    Posted Jul 23, 2021 05:31 PM
    Hi Amy,

    Thanks very much for this suggestion!  I will share this information with the patron.

    Best wishes,

    Jocelyn

    ------------------------------
    Jocelyn Boice
    ------------------------------