Dear Colleagues,
We are a research team evaluating the efficacy of an AI literacy intervention, the PROMPT Design Framework.
We are recruiting up to 8 independent raters to evaluate generative AI prompt-output pairs using a rubric. Prior knowledge of generative AI or AI literacy conventions is preferred but not required.
Raters will be compensated $225 upon submission of their completed ratings. Raters must also submit a Penn State non-employee information form and register with Penn State's PaymentWorks systems to receive compensation. Raters will also be acknowledged in scholarly communications resulting from the study.
Please submit this rater interest form by Sun., October 19th to be considered: https://psu.libwizard.com/f/AI-lit-rater
More Information
PROMPT Design Framework: Empirical Evaluation of an AI Literacy Intervention is a mixed methods study to determine the efficacy of the PROMPT framework as an AI literacy intervention. (The study was deemed exempt by Penn State University's Institution Review Board (STUDY00027385), and funded in part by a Penn State University Libraries Research Grant.)
Stage 1 of the study is a pre/post intervention protocol that engages consenting undergraduate student-participants in using generative AI to complete a given research task. Students first complete the task prior to learning the PROMPT framework, then learn the PROMPT framework as an AI literacy intervention, and finally repeat the research task using generative AI. Raters will evaluate a sample of up to 25 generative AI prompt-output pairs using a rubric.
Raters will participate in an onboarding and rubric norming session in November 2025.
Raters will be provided up to 25 anonymized prompt-output pairs from Stage 1 of the study and evaluate them using a rubric. These files will be available following the on-boarding session in November.
Raters will spend up to 10 minutes evaluating each prompt-output pair, for a total time commitment of approximately 4 hours.
Raters who submit complete ratings by January 31, 2026 will receive $225 (a rate of approximately $55/hour). Raters will also be acknowledged in scholarly communications resulting from the study.
Please submit this rater interest form by Sun., October 19th to be considered: https://psu.libwizard.com/f/AI-lit-rater
For more information, please reach out to Sarah Hartman-Caverly (smh767@psu.edu), principal investigator and associate librarian, Penn State University Libraries.
Thank you for your interest!
Sarah Hartman-Caverly and Dr. Ada Leung, co-investigators, Penn State University
------------------------------
Sarah Hartman-Caverly
Reference & Instruction Librarian
Penn State Berks Campus Thun Library
------------------------------