LLAMA MAES (Measurement Assessment and Evaluation Section) Section
At ALA Midwinter 2015 in Chicago, about 30 brave souls ignored blizzard warnings on Sunday afternoon and stayed at McCormick Place to participate in the MAES Hot Topics in Assessment discussion on "Using Ethnographic Research in Library Assessment." To initiate discussion, we heard about four completed or in-process studies from:
- Terry Taylor, DePaul University
- Kirsten Kinsley, Florida State University
- Terri Fishel, Macalester College
- Neely J. Tang, Cornell University
Attached is a summary of the presentations, a handout from one of the speakers, and a handout about a multi-institution life mapping project.
Following a survey of the MAES membership, an article was published in LLAMA's journal describing the results:
Monena Hall, Lisa R Horowitz, Janice S Lewis (2014) Learning from Our Members : An MAE Approach Results of the 2013 LLAMA MAES Survey, 1-11. In Library Leadership & Management 28 (4). https://journals.tdl.org/llm/index.php/llm/article/viewFile/7088/6305
It is hoped that MAES Committees will follow up on this survey with programs, projects and more that reflect the interests of the members.
This Assessment Toolbox is a place to post links to helpful information on assessment, examples of surveys, and other assessment tools. Please add your own favorite links to assessment information.
General Assessment Links:
- Instruction: Sample Rubrics from the Association for the Assessment of Learning in Higher Education
- Sample size calculator
- National Center for Educational Statistics Academic Libraries Peer Comparison Tool
- Microsoft Excel Statistical Options
- Survey Random Sample Calculator
- Social Science Research Methods
- Society for Technical Communication Web Usability Toolkit
- Library Assessment Conference Presentations and Posters
- Evidence-based Library and Information Practice, 4th International Conference 2007 Papers
- Open Access Journal: Evidence Based Library and Information Practice
Examples of Assessment Tools:
- Assessment Team LibGuide (from Washington University Libraries)
- Employee Survey (from Univ Nevada Las Vegas)
- Home-grown triennial user surveys (from MIT)
Date/Time: Sunday, January 26, 2014, 4:30 to 5:30
Location: Philadelphia Convention Center Room 102 A
- Lisa Hinchliffe, Professor/Coordinator for Information Literacy Services and Instruction, University of Illinois at Urbana-Champaign
- Donna Tolson, Library Strategist, University of Virginia Library
Lisa Hinchliffe will provide an overview of culture of assessment and organizational practices that are associated with such a culture. Following these opening remarks, discussion group attendees will participate in table discussions of barriers to developing a culture of assessment, reporting out their findings to the group. Then, Donna Tolson will discuss how the University of Virginia developed a culture of assessment at their library, current issues they are facing, and new priorities such as how to assess strategic directions. Her presentation will lead into table discussions about prioritizing assessment efforts. The discussion will conclude with a general Q & A.
This might of interest to other MAES members:
Southeastern Library Assessment Conference
The Southeastern Library Assessment Conference provides an opportunity for those interested in advancing the library assessment and user experience conversation to gather together to share and discuss practical ideas and information.
Call for Proposals
The Southeastern Library Assessment Conference invites proposals for the October 21-22, 2013, conference to be held in Atlanta, Georgia.
Program proposals should be designed to fit within a 45-minute timeframe, which includes time for questions. We encourage thoughtful, timely proposals on any topic related to assessment in libraries of all types, including, but not limited to:
- Creating assessment plans
- Data-driven decision making
- Demonstrating value
- Developing a culture of assessment
- Ethnographic studies
- Getting started with assessment
- Impact on student learning, retention, progression, and/or graduation
- Learning outcomes
- Library instruction
- Reporting results to stakeholders
- Spaces and facilities
- Special collections and archives
- User experience
Proposals should include:
- Program title
- Name, institution, position title, and email address of each presenter
- Abstract of 200 words or fewer. The abstract should state clearly the relevance of the topic to library assessment and practical implications for libraries.
- Brief 2-3 sentence abstract suitable for the conference website and program
- At least three learning outcomes to be addressed during the program
Please submit proposals online by April 17, 2013. Notification of acceptance is by May 13, 2013.
Please direct any questions you have to the Conference Coordinating Committee.
Susan Bailey, Emory University
John Bodnar, Emory University
Ameet Doshi, Georgia Institute of Technology
Jennifer Jones, Georgia State University
Erin Nagel, Clayton State University
Sonya Shepherd, Georgia Southern University
Thank you - W. Bede Mitchell, Dean
Georgia Southern University
It was great to reconnect with so many MAES members at the Library Assessment Conference, which wrapped up today in Charlottesville, VA. MAES was extremely well-represented in the presentation schedule as well as in the poster session. Presenters included:
Consuela Askew (Florida International) "Using a Mixed Method Approach to Assessing Roaming Services: A Case Study"
Kathy Crowe (UNC-Greensboro) "Shop Your Way to Service Excellence: Secret Shopping for Academic Libraries
MAES Chair Rachel Besara and Kirsten Kinsley (both from Florida State) "Increasing the Impact & Value of a Graduate Level Research Methods Course by Embedding Assessment Librarians and Library Assessment"
Allyson Washburn (BYU) "Student Information Seeking Behaviors: A Case Study in Collaboration"
Ken Wise (Tennessee) "Methods for Measuring Return on Investment for Digitized Special Collections"
Lisa Horowitz (MIT) "The Assessment Needs of a Data-Driven Organization"
Jeanne Brown (UNLV) "Quest for Continuous Improvement: Applying Feedback and Data Gathered through Multiple Methods to Evaluate and Improve Use of a Library's Discovery Tool"
Scott Britton (Univ. of Miami) "Mining Library and University Data to Understand User Populations and Behavior" (this was a standing-room only presentation!)
Meg Scharf (Central Florida) "Closing the Loop: Are Libraries Communicating Assessment Results to Students?"
Bob Fox (Louisville) was on the closing panel, presenting a wrap-up perspective from research libraries
Poster presenters included: Jeanne Brown, Karen Neurohr, Cheryl Albrecht, Rachel Besara, and Kirsten Kinsley.
I'm sure that I missed some MAES members but, wow, this was an impressive showing!
Slides and other materials will be available on the conference website at: http://www.libraryassessment.org/ Additionally, as in past years, ARL will produce complete proceedings of the conference.
Jennifer Paustenbaugh, Immediate Past Chair, LLAMA-MAES
Keynote Cory Lown will provide context, strategies, and resources for creating data visualizations for effective communication. Cory is Digital Technologies Development Librarian at North Carolina State University where he designs and develops applications to improve end-user resource discovery and use of library services.
Following Cory's talk five librarians will provide brief presentations on how they applied data visualization in their libraries:
Rachel Besara, Florida State University: Using Roambi, a mobile business intelligence application
Klara Maidenberg, Ontario Council of University Libraries: Visualizing the Council's Ask a Librarian data
Este Pope, Coconino Community College: Using Prezi to present data to the District Governing Board
Jamie Hollier, Colorado State Library: Using infographics to evaluate a new computer centers
Robert Dugan, University of West Florida: Using Counting Opinions to assess user experiences