Syndicate content

LLAMA Assessment Section Resources Committee Committee

View:   Faces | List

Online Doc Approved minutes, Resource Committee Meeting 2017.06.24

by John Wiggins on Sun, Jul 9, 2017 at 01:46 pm

Roll Call: John Wiggins, Rich Paustenbaugh, Helen Look, Steve Borrelli, Jeff Belliston (recorder), Nancy Colyar

Approval of May Minutes: Approved

New Committee Assignments:

o    Our committee descriptive form was submitted in March.

Roll Call: John Wiggins, Rich Paustenbaugh, Helen Look, Steve Borrelli, Jeff Belliston (recorder), Nancy Colyar

Approval of May Minutes: Approved

New Committee Assignments:

o    Our committee descriptive form was submitted in March.

o    Use the old appointments process to volunteer.

o    If appointment is ending, then fill out the volunteer form. The official encouragement is to continue onward unless you hear that you're not welcome to do so.

·         Eventually, there will be a call for volunteers on the new ALA Connect.

o    Helen has ​ not identified any new committee positions ​that are ​needed. She would like to have a Vice-Chair so the leadership is staggered. Please consider if you would like to be Vice-Chair and then Chair.  Anyone who wishes to continue on the committee is welcome/encouraged to do so.

o    ALA is finding that members are flocking to roundtables because they identify with values and the committee structure doesn't identify with values.

·         This may also be because RTs are cheaper so the barrier is much lower.

·         Trend in membership in the organization and the divisions is down.

o    We talked about how LLAMA, despite being an umbrella organization, tends to attract mostly academic librarians.

  • How do we get our programs in front of a more diverse audience?

A member-at-large and a vice-chair for the Assessment Community of Practice are both open for nominations; contact Helen (or Consuella Askew​, incoming chair of the Assessment Community).

Programming Discussion:

  • We helped with the ALCTS CMS IG program scheduled for Sunday 1:30 to 3:00 p.m.in the Hyatt Regency McCormick.

Continuing Topics:

o    Dashboard - John is interested in working on but not before August. Nancy is interested but has no expertise in the area so getting some​one who know​s something about it is important.

o    Data Visualization - The Competencies & Methods ​Committee is also interested in this area.

·         The Co​P as a whole seems to be interested to the point that there could be a webinar series on this with dashboards, other visualizations, etc. and when to use what.

§  The advantages of a webinar include that LLAMA ​keeps​ a higher percentage of any funds that are generated, and webinars fit ​within ​budgets.

o    Certification is something that we ought to be thinking about.

·         Nancy raised a question about what "certification" really means.

·         The earlier discussion in which John participated was just a start, but included the idea that perhaps it’s more badging than certification.

·         If it's really a certification, then it needs to be tracked, which requires personnel and infrastructure. Does the new CoP model support this?

·         Just attending a program should not lead to a certification. If it's really a certification, then an assessment of what someone can actually do would be important.

o    If we do virtual programs, it would be great to have some training about virtual programs to ensure a high quality participant experience. In a ​face to face​ conference there are almost always other options if one session is a bust. It’s more of a challenge to make changes during a virtual program based on participant feedback, and a bad virtual program can be troubling to those who’ve paid.

o    There was some concern about what seems to be a push to bring in revenue as a motivator for programming.

o    Webinars like the former DCLM ran need not be one-time. They could be updated and run again.

·         Moving forward

o    We need a short pause as we get the membership settled.

o    We need to identify a Vice-Chair and orient our newer leaders (there will be a LLAMA orientation for new committee chairs, and there is a leadership handbook on the LLAMA website).

o    We plan to explore a webinar series in collaboration with Robin's group.

o   ​We need to decide on what our meeting schedule will be and explore methods for web conferencing​

These minutes were approved online by attendees of the meeting on July 7, 2017.

More...

Online Doc Approved minutes, Resource Committee Meeting 2017.05.25

by John Wiggins on Tue, Jun 27, 2017 at 10:28 am
  1. Roll call
    1. Attending: Jeff Belliston, Nancy Colyar, Wenli Gao, Helen Look, Rich Paustenbaugh, Diane Porterfield, John Wiggins
    2. Regrets: Steve Borrelli, Terry Sklair Taylor
    3. John shared an update that we had tried to have LLAMA set up a webinar/web conferencing call but there were logistical problems.
  2. Review/revise/approve minutes from previous meeting, if needed (TBA): http://connect.ala.org/node/266690
  1. Roll call
    1. Attending: Jeff Belliston, Nancy Colyar, Wenli Gao, Helen Look, Rich Paustenbaugh, Diane Porterfield, John Wiggins
    2. Regrets: Steve Borrelli, Terry Sklair Taylor
    3. John shared an update that we had tried to have LLAMA set up a webinar/web conferencing call but there were logistical problems.
  2. Review/revise/approve minutes from previous meeting, if needed (TBA): http://connect.ala.org/node/266690
    1. Members were unable to review the March meetings before the May meeting as they were posted only minutes before the start. John asked members with any revisions or concerns to email him by the end of the day Friday 5/26. If nothing substantial is shared, John will update the status of the March minutes to Approved and share them publicly.  [No concerns were shared by the deadline—JW]
  3. Committee housekeeping
    1. Responding to the LLAMA Assessment Repository survey:
      1.                                           i.    Helen reminded members to complete the survey that will guide the development of a Library Assessment Repository. The survey will gather information about who might want to use the repository, how they might want to use it, and what they might contribute. The survey can be found at https://www.surveymonkey.com/r/assessment_repository and will remain open until the end of the month.
      2.                                          ii.    There was feedback that the survey reflected a limited view of potential uses for the repository. It should support people at different levels of need for information including beginning assessment librarians.
      3.                                         iii.    John asked if Rich could forward the survey to some of his recent public library contacts.
      4.                                           i.    ALA Annual Conference meeting on Sat 6/24, 8:30-10am at McCormick Place S105
        1. Planning to attend: Jeff, Steve, Nancy, John, Helen, Rich
        2. Uncertain: Terry
        3. Regrets: Wenli, Diane
        4.                                          ii.    Committee membership will change as of July 1.  Helen Look will become Chair; Steve, Wenli, Nancy, Diane, and John will be starting their second year. Jeff, Rich, and Terry had one-year terms that are ending June 30 and might be renewing.  Note that with the revised Community of Practice organizational model, there is some uncertainty about terms and start/end dates as the new model doesn’t identify a specific, regular cycle for committee service.
  4. Updates from LLAMA/Assessment Community (based on proposed agenda developing for 4.a below)
    1. Community exec board meeting (also including committee chairs) is planned for about two weeks ago (selecting date now)
    2. Soft deadline for volunteer signups through June 9, but it will be kept open (since the new structure doesn’t have actual terms for the few formal roles)
    3. There is a LLAMA Happy Hour planned for Sunday June 25, 6-7:30, location not yet announced
    4. Round of committee updates planned
    5. Reminder that our committee report form is due at/immediately after Annual
    6. Our input re: question of whether to hold an additional/separate Assessment Community Happy Hour—perhaps if not a separate event, at least stickers or ribbons to identify ourselves within the LLAMA Happy Hour (stickers or badge ribbons have been available in previous years).  The Assessment Community leaders are pursuing stickers.--JW
  5. Programming discussion
    1. Remaining meetings for this membership cycle:

6.1 ALCTS Collection Assessment IG program partnership—Rich pursued contacts within the public librarian community and uncovered and confirmed two speakers from Jacksonville Public Library for our committee to sponsor as panelists/program contributors at this ALCTS IG event (1-2:30pm on Sunday, June 25 in Hyatt Regency McCormick, Burnham/CC 23A-C):

  • Charlene Adkins—Collection Development Manager—has day to day assessment role
  • Richard Mott—Manager for Strategic Initiatives (Charlene’s supervisor) and PLA Project Outcome Task Force member--sharing a broader view of how Project Outcome can related to collection assessment activities.
  • The finalized information will be shared with ALCTS Collection Evaluation and Assessment IG. Wenli has been asked to connect the two speakers with the program moderators so they will have direct communication.
  • There was a discussion about public libraries and their use of Tableau. There may be a preconference opportunity. Do we want to accept this as work for our committee? Helen reported that there had been a Tableau preconference proposal submitted by LLAMA MAES Education but it was delayed due to technical problems at the convention center. Its current status is unclear. 

John will pursue promotion within Assessment Community/LLAMA after Wenli forwards the ALCTS event description. (John forwarded the ALCTS description to our Assessment Community marketing team).

The committee members expressed great appreciation for Rich’s efforts to develop these contacts and to see this program partnership with our PLA colleagues into fruition. The group was commended for its work and getting things done so quickly.

6.2 Dashboards--brainstorming and program development.  Sub-group to work on this: Nancy, Diane, John (after August) with Helen’s support; when a specific (set of) proposal(s) are available, other members will consider roles

  • Data manipulation
  • Audience (ext: users, accreditation-seeking units) (int: funders, staff, managers)
  • What is and isn’t a dashboard?  Best practice for dashboards
  • How do you build a dashboard?
    • How do you manipulate data (i.e. clean it up so that it comes across well in the dashboard?)
    • Lightning round of examples and the thought behind the individual examples (perhaps a MidWinter/Hot Topics discussion starter)
    • Which dashboards are successful?

Programming options?

  • If for Annual: deadline for next Annual program is July 2017—might have a bigger audience.  Title, Abstract; list potential speakers required as a minimum to request a program spot be held for us.  We understand that hour-long programming slots are better attended than longer sessions, so we’d need to scope our topic.
  • For Mid-Winter, we’d need an existing slot—maybe Hot Topics?
  • Webinar(s) for more basic info
  • Workshops (such as a pre-conference) for actual training sessions
  • We reviewed data gathered in our Assessment Survey and identified 2-3 potential speakers.
    • Somebody (at LAC) volunteered to talk about Balanced Scorecard principles. This person might be a possibility. Jackie Bronicki from the University of Houston volunteered about Tableau Server. She’s also good with data cleanup and could be a very good resource. Wenli is also a good possibility. Jeff mentioned Brian Roberts from BYU, who is doing a lot of work with Tableau dashboards, as a possibility.
    • We could consider an overall approach to dashboards and then address different pieces of our vision with different kinds of programming.

7. Parking Lot/Future program ideas and approaches 

  • 6.0   (added during meeting) revive MAES Education pre-conference on data visualization & the public version of Tableau (participants bring own devices with pre-installed pT), perhaps with Excel as an alternative, perhaps with PLA involvement (Helen was involved in the original proposal, which was accepted for Annual 2017 but then postponed due to technical issues)
  • 6.1  assessment of discovery tools and web sites
  • 6.2 micro assessments/guerilla assessments 
  • 6.3 some programs should offer value to beginners/new assessment professionals (perhaps at no cost)
  • 6.4 some programs should offer value to more seasoned librarians (perhaps with cost)
  • 6.5 Master spreadsheets (for resource assessment)

Next meeting: Saturday June 24 8:30am-10am at McCormick Place S105 (listed on the scheduler as "All Committees and Working Groups" without LLAMA in the title--note field confirms "All LLAMA Committees and Working Groups"

 

More...

Online Doc Approved minutes, Resource Committee Meeting 2017.03.09

by John Wiggins on Fri, Jun 2, 2017 at 11:45 am

1. Roll call -- All members except Terry were present for the call.

2. Review/revise/approve minutes from previous meeting:

3. Committee housekeeping

1. Roll call -- All members except Terry were present for the call.

2. Review/revise/approve minutes from previous meeting:

3. Committee housekeeping

  • Remaining meetings for this membership cycle
  • April 27 (teleconference)
  • May 25 (teleconference)
  • ALA Annual (face-to-face)
    • Probably Saturday morning 8:30 to 10:00 during the All Sections/All Committee meeting

4. LLAMA/Assessment Community of Practice reorganization

  • Received some updates from Ann Cooper Moore.
  • At request of ACM, John filed a report saying what the committee has been doing including conducting the survey and sharing the results and that we are now working on programming ideas.
  • The Assessment CoP doesn't intend to make any particular changes.
  • Yet to be done: Complete a charge in the LLAMA standard committee charge format. John will share the document and some initial responses thereto. John will be using the current charge. It's lengthy compared to the provided examples.
    • List our charge
    • Deliverables
    • Expected time commitment of members
    • Desired skills, knowledge, experience
    • Likely staff contacts
    • Resources available
    • This might be a good place to indicate that we would like some support for virtual meetings.
    • Update from Kerry on launch of new ALA Connect. Date pushed back to after Annual. ALA and LLAMA websites are already being redesigned.
      • Hopefully there will be an online form for committee reporting.
  • Update from ALA President
  • FYI, ALA gets requests for interviews. Among other
    • How libs dealing with Presidential Executive Orders.
    • Getting good feedback on initiatives
    • Executive Director positions for ALA and Washington Office are moving forward.
    • Continuing to create content about what libraries are doing.
    • Overview of work on "critical now" issues including exclusion of people based on nationality or religion based on Presidential Executive Order.

5. Programming discussion

5.1 Collection Assessment (Rich, Wenli, Helen, and Terry)

  • The committee supported the general direction discussed below.
  • Rich and Wenli will be part of the core.
  • Helen can be part of the core or a resource.
  • Nancy can be a resource if we look for an academic librarian participant.
  • John will serve however he can.
    • There should be a direct relevance to collection assessment.
    • We need to stress our ability and willingness to fully advertise within LLAMA.

5.1.1 ALCTS Collection Assessment IG possibility

  • Wenli contacted the IG. They are interested in partnering with us.
  • An element of interest for them is how skills are acquired or training of assessment librarians (on-the-job and/or via MLS programs) and who is doing assessment and what does this look like?
  • We don't need to talk about the philosophy of training or the need for training.
  • We can actually start to provide some training.
  • The ARL Spec Kit done on collection assessment last year may be a place to start for presenters. This is the kind of resource we can mention and link to.
    • This is for their confirmed 90-minute slot at ALA Annual 2017.
    • Call will go out the end of this month.
    • Seems like a great opportunity if we can come to an agreement of what we'd like to do by the end of this meeting.
    • Wenli has been part of the selection process previously. Helen has been an attendee at their events.
      • ACM saw this as an exciting opportunity for the section and
      • One thing we might do is to suggest speakers who might not be thought of.

5.1.2 Identification of possible public librarian presenter/participants

  • Identified potential speakers
  • Linda Hofschire (https://ripl.lrs.org/co2017/speaker/linda-hofschire/)
  • - extensive experience in public libraries
  • Rebecca Teasdale (https://ripl.lrs.org/blog/speaker/rebecca-teasdale/)
  • - library assessment in IL and OR
  • Likely more out there but highlighted these because of their experience with workshops for public librarians.
    • Knowing the confirmed time slot would be important as we help to provide a speaker.
    • Wenli will confirm that we want to provide a public library speaker. We also need to know how much time that person will have.

5.2 Dashboards (John has raised his hand for this.)

  • Next formal opportunity would be at ALA Annual if we coordinate with the Hot Topics in Assessment Discussion Group that has a dedicated program slot.
  • Has the idea that we should propose a lightning round on different dashboards
  • Committee members agreed that this is a good idea.
  • If the group isn't interested we could look at later opportunities.
  • John will contact the DG leaders about this idea, Ellen Safley and Kirsten Kinsley.

6. Parking Lot/Future program ideas and approaches 

  • Mostly due to time, only one item in #6 got any attention.

6.1 Scope of Assessment Programming/Discussions within ALA and potential partners

6.1.1--Nancy and John interested in assessment of discovery tools and web sites

  • Nancy is already looking for literature in this area.

6.1.2--Helen, Terry, and Nancy have presented on micro assessments/guerilla assessments and might develop something if there’s interest. 

6.2--Summary of general ideas:

6.2.1 save the time of our colleagues.

6.2.2 be engaged outside of LLAMA.

6.2.3 how do we measure our impact, that it's important to people.

6.2.4 some programs should offer value to beginners/new assessment professionals (perhaps at no cost)

6.2.5 some programs should offer value to more seasoned librarians (perhaps with cost)

6.3 Program ideas for further identification, selection, and development

6.3.1 Master spreadsheets (for resource assessment)

6.3.2 Brainstorm additional options

7. Any homework for next meeting

More...

Online Doc Approved minutes, Resources Committee Meeting 2016.12.08

by John Wiggins on Thu, May 25, 2017 at 09:19 am

:05 1. Roll call

  • Helen Look (co-chair), Jeff Belliston (recorder), John Wiggins (chair), Nancy Colyar, Steve Borrelli, Terry Taylor, Wenli Gao
  • Rachael Elrod has stepped down since our last meeting.
  • Diane Porterfield and Rich Paustenbaugh could not attend this meeting and indicated so in advance.

 

:10 2. Review/revise/approve minutes from previous meeting:

:05 1. Roll call

  • Helen Look (co-chair), Jeff Belliston (recorder), John Wiggins (chair), Nancy Colyar, Steve Borrelli, Terry Taylor, Wenli Gao
  • Rachael Elrod has stepped down since our last meeting.
  • Diane Porterfield and Rich Paustenbaugh could not attend this meeting and indicated so in advance.

 

:10 2. Review/revise/approve minutes from previous meeting:

Approved minutes, Resources Committee Meeting 2016.11.10 (requires login to ALA Connect)

  • Approved in revised format and made public by John with slight revisions in institution designations of a few current members.

 

:15 3. Committee housekeeping

  • ALA MW meeting still a possibility (ultimately finalized as a data working group to offer prioritized suggestions to full committee at Jan 26 meeting)
  • John wants to make sure that we can make progress. Hopes to be able to do with one hour meetings but we should keep in mind that we may need to extend meetings.

 

:25 4. LLAMA Changes--Special ballot. Changes for LLAMA before special ballot/voting period.  Please consult site shared below to prepare. (info repeated from October meeting)

  • Initiative is likely to pass. Today is the closing date.

4.1 http://connect.ala.org/node/260148 to access the ballot

4.1.1 Was delivered as an email update from ALA Connect with a link to a poll

 

:30 5. Updates on deliverables from previous meeting 

5.1 Assessment Section survey (officially closed 11/30/2016)- Survey was launched at the Library Assessment Conference in print and online at http://tinyurl.com/2016assess (recent summary of responses shared via email)

Summary of results shared via email on Saturday 12/3/2016 (104 total responses, etc.)

Discussion:

  • Nancy learned from reviewing the question about "What have you learned?" that there are a number of tools she was not aware of. Those provide some possibilities.
  • Jeff saw many mentions of Tableau and data visualization.
  • Wenli suggested coding the responses. Doesn't know how long this will take. She offered (and was readily accepted) to do some initial text mining question by question. John offered to re-output the data if that would be helpful. She will do this at least a week before our next formal meeting. If sooner that would be wonderful.
  • We may want to do some text mining by the demographics (academic versus public, etc.)
  • John requested that Wenli run the text miner on Q8 about the groups and committees that people are part of.
    • Nancy suggested that we could address some of this in even an hour meeting at ALA MW.
    • The results don't line up naturally with how the Assessment Section has divided itself.
    • John hasn't shared these beyond us since Anne Moore wants to review them more carefully before doing so and she hasn't been able to yet.
    • John asked that Jeff give him a heads up after Jeff's had a chance to thoroughly review the data regarding any personally identifiable information that needs to be redacted.
      • John highlighted for us some responses that he saw as particularly relevant or potentially related to the committee's charge:
      • John expressed disappointment that some people who listed expertise in Q3 but did not give their name. Others said they don't have any expertise. We will need to go beyond what's here to our networks to identify good people. The idea of sharing (and associated time commitments) may have scared some people off.
      • How do we see ourselves moving from these responses to action that we might take with regard to programming?
      • Qs 1 and 2 will be the most fertile for programming
      • Q3 may give ideas for presenters
      • Q4 might give us sense of audience
      • Q8 would provide ideas about partnering
        • We will look further at these during an optional F2F meeting (for those who can attend) at ALA MW in Atlanta to prep for our (official) teleconference meeting on Jan 26.

 

5.2 Library Assessment Conference

The conference program is now openly accessible at http://libraryassessment.org/schedule/index.shtml.

DELIVERABLE: Steve Borrelli, Helen Look, Terry Taylor, Wenli Gao and John Wiggins were asked to report on trends we might see at the Library Assessment Conference at the end of October.

We can also report on the LLAMA Assessment Section affinity group meeting, which offered some input into near-future directions of the section (and discussion was based on two of our survey questions, in part). We didn't get to this last meeting.

  • Steve felt like about 20% of the sessions either used Tableau or were talking about Tableau. There were also a lot of sessions on sharing the results from assessments and culture of assessment.
  • There are differences of opinion about the value of Tableau.
  • It has a steep learning curve.
  • It also has a steep price.
  • Dashboards are of great interest.
  • There is some danger in focusing on a single software product.
    • Terry felt like there is a wealth of approaches being used for assessment. She mentioned "appreciative inquiry" in particular. This method helps people focus on what's going right and building on that helps people move forward.
    • Text mining of chat reference to isolate complaints about noise to potentially identify solutions. This seemed an interesting idea--mining chat questions for assessment/improvement purposes.
    • Looking at the schedule will indicate that many sessions have slides that you can refer to.
    • Communal notes also exist for various sessions. These are generally available through the session abstracts on the conference site.
    • Helen reported that it was not clear to some individuals who could attend the LLAMA Assessment Section affinity group. She is aware of some who were not members of LLAMA who wondered if they could go. We should be aware of this if we try to have an affinity session in the future LACs.

 

We don't seem to yet be at the point where we're ready to talk about programming ideas. We ended the meeting early as a result. The following agenda items are postponed to a future date:

5.3 Scope of Assessment Programming/Discussions within ALA and potential partners

DELIVERABLE - 1: If Nancy is ready at this meeting--explore within ALA which groups are working on collections use and how, to get us started on subsequent deliverable below--

DELIVERABLE - 2: follow up to deliverable # 1 above: (group) research project for perhaps the full year--small group researches list of other ALA divisional/sectional committees tasked with assessment program and/or suggests next steps regarding how we can find others/learn more about these committees as potential partners and overlapping audiences.

5.3.1 Possible partner for programming/marketing: ALCTS Collection Assessment IG--more of a programming group, not as much a committee/not really having meetings, that arranges for presentations.

5.4 PENDING OFFER OF potential resourcing for ResComm projects: Nancy and John interested in assessment of discovery tools and web sites

5.5 PENDING POSSIBILITY for ResComm programming: Helen, Terry, and Nancy have presented on micro assessments/guerilla assessments and might develop something if there’s interest.

 

6. Brainstorm results for activities to support committee charge

6.1 Summary of general ideas:

In general, save the time of our colleagues.

Be engaged outside of LLAMA.

How do we measure our impact, that it's important to people.

6.2 General support for gathering more ideas

Survey Assessment section elist

Identify problems committee members hope to address or our general interests. 

Evaluate and select activities wanting to launch.

What time frame should we be working from?  

6.3. Opt-in: creating small working groups around ideas that engage committee members.

 

Next meeting: Thursday January 26 at 9am MT / 10am CT / 11am ET

More...

Online Doc Approved minutes, Resource Committee Meeting 2017.02.23

by John Wiggins on Thu, May 25, 2017 at 09:18 am

1. Roll call – John, Helen, Wenli, Nancy, Terry, Rich, Diane. Steve & Jeff couldn’t attend

2. Minutes from previous meeting: Approved

3. Committee housekeeping

    Upcoming meetings

    ACRL meeting in March—Terry, Wenli, and Helen plan to attend ACRL. Rich hoping to attend. Jeff, Nancy, and John are available for our regular meeting.  Diane possibly unavailable. Steve is unavailable.

John will be sending out a doodle poll for availability on March 9th (probably 11am).

 4. LLAMA/reorganization update

1. Roll call – John, Helen, Wenli, Nancy, Terry, Rich, Diane. Steve & Jeff couldn’t attend

2. Minutes from previous meeting: Approved

3. Committee housekeeping

    Upcoming meetings

    ACRL meeting in March—Terry, Wenli, and Helen plan to attend ACRL. Rich hoping to attend. Jeff, Nancy, and John are available for our regular meeting.  Diane possibly unavailable. Steve is unavailable.

John will be sending out a doodle poll for availability on March 9th (probably 11am).

 4. LLAMA/reorganization update

Won’t need to specify a community of practice when you join. Sections will become Community of Practices. With our group, assessment, we already did a reorganization – working toward being more inclusive, more open – we will need to continue doing the work that we do.

There will be more info from Ann & Consuela to create new roles – such as project manager. Will also coming up with high level goals so the different groups can work toward those goals for the next 2-3 years.

 People with 2 year appointments will continue, people that had 1 year or that end this year can choose to continue on or join another committee or there will be opportunities to join specific projects.

The LLAMA board (or someone) is working on a process to create a project proposal form for uniformity.

 Committees vs. Community of Practice. Assessment section becomes Assessment community of practice and under that groups (as opposed to being called committee).

 Llama has 2 staff positions. Possibly creating another position to track what is happening in the community of practice, that person possibly becoming the Chair after a year since they’ll know everything that is going on.

Suggestion (at midwinter) was that there should be a webinar or guide on the best way to participate in a community of practice.

There will be variations on how people can engage.

 5. Program ideas or possible approaches to developing programs

We have some data that we gathered on assessment. Some good general guidance but not a lot specifically on resources.

Suggestions for other programs:

5c is working with ALCTS – what to do with collections in today’s [budgetary] environment/ what to do when your resources for collections change / how to change collections based on data-driven decisions.

    • Possible presenters:
      • Terry & Helen but both busy
      • Rich will try to do a search on who has written in the public library arena – we do well finding people in the academic arena but should try to bring in people with public library ties.
      • Other suggestions to identify presenters
        • PLA – projectoutcome.org  
        • John, current President of LLAMA – Colorado State Library did assessment conference
    • Contact with ALCTS will be Wenlie. We’ll reach out now to share the idea of working with them – they can share their timeline and degree of interest.

 We may have passed the ALA annual programming deadline. John will check and we’ll still develop the idea.

 Dashboards (6.1.1)

    • There were people identified in our surveys that can help with that.
    • Programming ideas
      • What Dashboards can’t do. What are they for/what are they not for?
      • What are the workarounds when your platform (Sharepoint) doesn’t work with dashboards well.
      • Examples of different dashboards – what people choose to display and why.
        • As a Poster session, maybe in a virtual manner for those who can’t go to ALA or midwinter.
        • Hybrid - where collect beforehand and then do a lightning round talk where people are available after for questions. 
      • Failed projects – best of or worst of -- If collect from others and generalize. What you wouldn’t do again.
    • Will continue to explore ideas of dashboard programming

 

[5C--Possible partner identified for programming/marketing: ALCTS Collection Assessment IG--more of a programming group, not as much a committee/not really having meetings, that arranges for presentations.  Helen participates in that IG.]

 

More...

Online Doc Articles about assessing discovery services

by Nancy Colyar on Thu, Mar 9, 2017 at 03:12 pm

I began with this one, which includes the others in its bibliography.

Library Discovery Products: Discovering User Expectations through Failure Analysis http://ejournals.bc.edu/ojs/index.php/ital/article/view/9190/pdf

I began with this one, which includes the others in its bibliography.

Library Discovery Products: Discovering User Expectations through Failure Analysis http://ejournals.bc.edu/ojs/index.php/ital/article/view/9190/pdf

1. Bess Sadler, “Stanford's SearchWorks: Unified Discovery for Collections?” in More Library Mashups: Exploring New Ways to Deliver Library Data, edited by Nicole C. Engard, 247–260 (London: Facet, 2015).

2. Jody Condit Fagan et al., “Usability Test Results for a Discovery Tool in an Academic Library,” Information Technology & Libraries 31, no. 1 (2012): 83–112.

3. Megan Johnson, “Usability Test Results for Encore in an Academic Library,” Information Technology & Libraries 32, no. 3 (2013): 59–85.

4. Andrew D. Asher, Lynda M. Duke, and Suzanne Wilson, “Paths of Discovery: Comparing the Search Effectiveness of EBSCO Discovery Service, Summon, Google Scholar, and Conventional Library Resources,” College & Research Libraries 74, no. 5 (2013): 464–88.

- Nancy

More...

Online Doc Approved minutes, Resources Committee Meeting 2017.01.26

by John Wiggins on Mon, Feb 27, 2017 at 12:58 pm

1. Roll call

Attendees: Helen Look (co-chair), Steve Borrelli, Diane Porterfield, and Wenli Gao (recorder)

Regrets: Jeff Belliston, John Wiggins (chair), Nancy Colyar, Terry Taylor, and Rich Paustenbaugh

 

2. Review/revise/approve minutes from previous meeting

Approved in revised format. Helen will remove the direct quotations from survey respondents to protect the privacy of respondents and they can be added back later if deemed necessary.

 

3. Committee housekeeping

1. Roll call

Attendees: Helen Look (co-chair), Steve Borrelli, Diane Porterfield, and Wenli Gao (recorder)

Regrets: Jeff Belliston, John Wiggins (chair), Nancy Colyar, Terry Taylor, and Rich Paustenbaugh

 

2. Review/revise/approve minutes from previous meeting

Approved in revised format. Helen will remove the direct quotations from survey respondents to protect the privacy of respondents and they can be added back later if deemed necessary.

 

3. Committee housekeeping

We will move to 1 hour meeting from now on.

Tabled the discussion of March meeting. Helen and Wenli plan to attend the ACRL conference, and Steve and Diane will not. We will further discuss in February meeting.

 

4. Midwinter updates

LLAMA sections will become Communities of Practice. It may take about 12-18 months for the full transition but anticipate that many details will need to be worked out along the way. When people join LLAMA, they don’t have to check boxes to indicate what section they want to join. They can participate in any Community of Practice. In July, 2017, we will have this new structure. Some groups may change, but all groups will continue their work. There will be no committee appointments. LLAMA will be more open, flexible, and offer members engagement through the Communities of Practice.

Jeff, John, Nancy, and Helen met at ALA Midwinter for the Resources Committee meeting. They discussed the re-organization and reviewed the survey results. For beginner level topics, it was suggested we identify some authoritative resources and make information available for free. For more mid-level and advanced topics, people may pay to participate in the webinars. There was also a discussion about having a blog for profiles/interviews of assessment colleagues which can include recommended resources.

Currently LLAMA webinars are not free. There is discussion about opening up webinars for free viewing after an embargo period. This would be away to show the quality of the webinars for people who may want to register for future webinars.

 

5. Updates on deliverables from previous meeting 

Nancy gave names of the groups working on collections. If we need additional information, she can do more research.

Potential resourcing for projects: Nancy and John interested in assessment of discovery tools and web sites; Helen, Terry, and Nancy have presented on micro assessments/guerilla assessments and might develop something if there’s interest. 

 

6. Discussion of survey results

We can use survey to identify what topics can be free and what topics can turn into webinars. Potential webinar presenters can be identified from the list of people who volunteered to share their expertise. We will use February meeting to focus on specific ideas from the survey.

 

Next meeting: Thursday February 23 at 9am MT / 10am CT / 11am ET

More...

Online Doc Approved minutes, Resources Committee Meeting 2016.11.10

by John Wiggins on Thu, Dec 8, 2016 at 09:39 am

LLAMA, Assessment Section, Resources Committee

Rachael Elrod, acting recorder

 

 

Date and Time

 

November 10, 2016

10:30 am EST

 

 

Location and Instructions

 

 

Our meeting will run 8:30-10am MT | 9:30-11am CT | 10:30am-12pm ET.

LLAMA, Assessment Section, Resources Committee

Rachael Elrod, acting recorder

 

 

Date and Time

 

November 10, 2016

10:30 am EST

 

 

Location and Instructions

 

 

Our meeting will run 8:30-10am MT | 9:30-11am CT | 10:30am-12pm ET.

 

To connect, call toll free 1-866-810-2923; use passcode 81376858.

 

 

Attendees

 

 

Diane Porterfield (Central Penn College), Helen Look (University of Michigan), Rich Paustenbaugh (Utah Valley University), Wenli Gao (University of Houston), Rachael Elrod (University of Florida), Nancy Colyar (Birmingham-Southern College),Terry Taylor (DePaul University), John Wiggins (Drexel University)

 

Regrets

 

 

Jeff Belliston (Brigham Young University), Steve Borrelli (Pennsylvania State University)

 

 

Facilitator

 

John Wiggins (Chair)

 

 

Agenda

 

  1. Roll call
  2. Review/revise/approve minutes from previous meeting
  3. Committee housekeeping
  4. LLAMA Changes – Special ballot opening on Nov 16: continue discussion regarding review of proposed changes for LLAMA before special ballot/voting period.
  5. Updates on deliverables from previous meeting

 

 

Discussion Notes and Committee Decisions

 

 

  1. No comments on minutes from previous meeting/accepted and approved

 

  1. Extended first three committee meetings to orient ourselves, this is the third 1.5 hour meeting. We don’t have our plan of everything we want to accomplish this year. Should we extend any of our meeting times to accommodate future discussions? –this question was not addressed by the end of the meeting; John will follow up by email

 

  1. LLAMA ballot on re-organization will be sent next week.  In summary,  organizational changes have less emphasis on sections which will become “communities of practice”, most activity will be on committees like ours. Looking for a more flexible organization. Proposed as a good example for all of ALA. We will be a test case if this passes. Information online, recording of virtual town hall. Main issue is that it is unclear for members how we will get our business done, this is not described yet.

 

Another one of the expected outcomes is using less acronyms so that people will understand what groups are about/their purpose. People at LLAMA mixer were unsure if they were members of a section or committee. These changes may help the membership or prospective membership.

 

Special election will end on December 8th, results reported to members on December 9th. We will vote as individuals, not as a committee.

 

  1. Share comments feedbacks on proposed survey, had approved by section Executive Committee. We got some print and online input. Overall officially 16 surveys collected though not all respondents answered all questions.

 

We are doing this survey for the section which will be shared with the section Executive Committee.

 

Survey timeline was noted: hoping to start distribution next Monday and close in 2.5 weeks. See what results we get and revise if needed again after that.

 

Jeff emailed the committee his suggestions for improving the survey.

 

Does the survey do what we want it to do? Jeff – first person to respond to first question was unclear of what the question was asking based on the response. The committee noted that the answer reflected the respondent’s context of taking the survey at the conference, and ultimately decided not to update the question.   

 

Do we have or need an open ended question such as “Anything else you’d like to share about assessment?” May help contextualize some of the answers. Ultimately, the committee declined to add this question.

 

We don’t spell out LLAMA in our survey. After discussion, John will update the survey header to read:

 

“American Library Association (ALA)

Library Leadership & Management Association (LLAMA)

Assessment Section Programming Survey”

 

The committee reviewed if the results are solely for internal use? Will this be shared somewhere else? IRB issue. Just focused on getting information to help the committee do its work. If we do not formally present or publish, it should be fine to not get IRB approval. However, we should be careful in using direct quotes that people compose—sometimes there is enough information that someone might identify the respondent.

 

The committee considered if we were interested in demographic data about our respondents? How many librarians/staff are at your library? Full-time, FTE?  Perhaps “small, medium, or large” libraries, though ambiguous. Thinking about our audience, assessment librarians are likely to form strongly-held opinions regarding how well-honed we’ve developed our questions.

 

Part-time assessment work might need to be described differently, but ultimately the committee decided to add a new option  “Assessment is the main part of my job responsibilities?” to help clarify a choice for full-time assessment librarians.  Respondents are instructed to select as many options as applicable. This was the only survey revision from the committee after thorough discussion.

 

Survey distribution:

Terry volunteered to connect with ILI and the ACRL Value of Libraries group, of which she is a member; Rich will pursue his connection with the UT State Librarian.  John will contact committee members who have identified themselves as liaisons or having connections to some of the groups.

 

Still needing to be claimed: YALSA, RUSA, music librarians, AASL

 

We did not complete the agenda developed for the current meeting.  John will contact committee members to extend the December meeting by starting ½ hour early.

 

 

Action Items (Members Responsible)

 

 

  1. John will contact committee members to extend the December meeting by starting ½ hour early.
  2. John will update Anne Cooper Moore regarding survey question change
  3. Anne Cooper Moore will provide sponsor/introductory note
  4. John will contact committee members to help distribute survey.

 

 

 

More...

Online Doc Approved minutes, Resources Committee Meeting 2016.10.27

by John Wiggins on Thu, Nov 10, 2016 at 04:32 pm

:05 1. Roll call (Diane, Helen, Jeff, John, Nancy, Rich, Steve, Terry, Wenli; Rachael shared her regrets in advance)

:10 2. Review/revise/approve minutes from previous meeting: Draft minutes Resources Committee Meeting 2016 10 13 (requires login to ALA Connect)

  • We should clarify whether "access" or "assess" was meant in the minutes.
  • Approved.
  • John will make them public.

:15 3. Committee housekeeping

:05 1. Roll call (Diane, Helen, Jeff, John, Nancy, Rich, Steve, Terry, Wenli; Rachael shared her regrets in advance)

:10 2. Review/revise/approve minutes from previous meeting: Draft minutes Resources Committee Meeting 2016 10 13 (requires login to ALA Connect)

  • We should clarify whether "access" or "assess" was meant in the minutes.
  • Approved.
  • John will make them public.

:15 3. Committee housekeeping

  • We have two meetings scheduled before the release of the LLAMA open ballot. This will provide an opportunity to discuss items of interest.

:20 4. Updates on deliverables from previous meeting

 

4.1 Proposed Assessment Section survey - feedback and suggestion to pilot the survey

DELIVERABLE--draft survey questions.

Revised version now live at http://tinyurl.com/2016assess (live--sincere response collection/no test responses needed); includes feedback from Assessment Section Executive Committee.

  • We made excellent progress in moving the idea of having a survey to collect ideas for programming.
  • The earlier version was shared with Assessment Section Executive Committee.
  • Encouraged to share at Library Assessment Conference (LAC) mixer that takes place next week.
  • The Section Chair formalized the tone of the questions and the means of collecting names and emails was standardized.
  • Suggested that the Chair formally endorse the survey. She agreed. This will give the sense that it comes from the Section as a whole rather than the committee.
  • Distribution will be via listservs following the LAC.
  • Will pass out paper surveys at LAC. Attendees will also be able to use smartphones to take the survey.
  • Deadline of 30 November. Anne Cooper Moore agreed this was good. This will allow for some review of submissions before our first December meeting (12/8).
  • John asked how committee members feel about the survey. There was general agreement that it looks good.
  • John proposes that we summarize the data for others to help them use the results.
  • The timeline looks good.
  • At the November 10th meeting we can consider distribution methods beyond the Section e-list.

4.2 Hot Topics in Assessment discussion at MidWinter discussion

DELIVERABLE: (John) For Hot Topics in Assessment discussion at MidWinter, micro-assessments/guerilla assessments --Helen, Terry, Nancy could be contacted.

  • Shared info with Ellen and Kirsten, our at-large members.
  • They were graceful in accepting suggestions but it looks like they will encourage an open-mic session to share questions, conundrums, and quandaries that other attendees can then respond to. Hopes that there will be a shared Google doc before the meeting so that potential attendees can think both about their problems and solutions they might offer for the problems of others.
  • We can keep this idea on the table and look at this for a program that we might offer as a program ourselves. We want to make sure that whatever we offer does not duplicate what took place at the last ALA Annual. The topics would be space, collections, website, and discovery. Terry was part of the ALA Annual presentation. Helen said there will be some presentations at Charleston Conference on micro-assessments done at her institution.
  • We should follow up in our next meeting.
  • LLAMA has their meeting schedule in a pdf on the website.
  • ALA MidWinter LLAMA Hot Topics is 4:30-5:30 p.m. on Sunday.

4.3 Library Assessment Conference

DELIVERABLE: (Steve, Helen, Terry, Wenli and John) at 11/10 meeting are asked to report on trends we might see at the Library Assessment Conference at the end of October.

  • John, Steve, Helen, Terry, Wenli, and Jeff will also be at the LAC. We're asked to report on trends that we might note at the conference.
  • At the Exec Committee discussion about the mixer, they asked about volunteers for mixers at the tables. Helen and John have volunteered. They may need more volunteers (Monday, 31 October 2017, from 3:15 - 4:30 in Salon IV). Even if you don't volunteer, record informal observations that can be shared in our 10 November meeting.
  • John Wiggins encouraged that attendees focus on sessions of particular interest to the committee.
  • We could potentially mine the programs for expertise on topics of interest to us. Terry indicated that this technique was used in the development of assessment competencies and it worked well.
  • It would not be a bad idea for us to touch base while there. It might be nice to see how spread out we are in terms of the sessions we go to.

4.4 Scope of Assessment Programming/Discussions within ALA and potential partners

DELIVERABLE - 1: (Nancy) not due until 11/10 or after--explore within ALA which groups are working on collections use and how, to get us started on subsequent deliverable below--

  • The agenda verbiage does reflect Nancy's understanding of what is intended.

DELIVERABLE - 2: (group) research project for perhaps the full year--small group researches list of other ALA divisional/sectional committees tasked with assessment program and/or suggests next steps regarding how we can find others/learn more about these committees as potential partners and overlapping audiences.

4.5 Possible partner for programming/marketing: ALCTS Collection Assessment IG--more of a programming group, not as much a committee/not really having meetings, that arranges for presentations.

  • Keep this on the table per Nancy's understanding.

4.6 PENDING OFFER OF potential resourcing for ResComm projects: Nancy and John interested in assessment of discovery tools and web sites.

  • Keep this on the table per John's and Nancy's understanding.

 

:40 5. LLAMA Changes--Special ballot opening on Nov 16: review of proposed changes for LLAMA before special ballot/voting period.  Please consult site shared below to prepare.

  • Sections won't be as formal as they are now. They would be more ad-hoc as people want to organize them. They will be known as "Communities of Practice." We can organize on this level however it might work best. Most of the LLAMA programming will actually continue to happen through what we're doing right now on this call.
  • To folks who've been around for a longer time, it's unclear how things will operate in this space.
  • How a community of practice or committee comes about doesn't seem to have been addressed yet. Structural guidance isn't clear nor has it come up in some of the conversations that John has been part of. It's the main question that John has and has heard from others.
  • Terry asked how this places LLAMA in relation to other organizations under the ALA umbrella. It seems so different. Nancy indicated that LITA is watching this to see how it goes. Terry has been watching with interest to what is happening at the MidWinter Meeting. It's not just a meeting, there's more programming going on. Nancy indicated that there has certainly been discussion about what should be held virtually--business meetings or programs. There will be some tests of this. Part of the reason we can only go to the cities we go to is because of the number of concurrent sessions that are offered. There is ongoing discussion about this. Terry's still trying to get her head around what the reporting structure will be so it's not like herding cats. The Town Hall recording might provide some help with these issues. For Nancy, the more she's listened the clearer it has become. There's definitely a focus on trimming things and making them more efficient.
  • John endorses the Virtual Town Hall recording and he's one who prefers to read rather than listen. Big questions with changes are "How does this affect me?" and "How do I operate after the changes are implemented?" These haven't yet been answered quite as fully as he would like.
  • John would be happy to pass any questions the committee has through to the section. Nancy encouraged that we read all the background documents.
  • The changes are proposed for 1 January 2017. John is committed to helping committee members know what we'll be doing when this all happens.
  • It is interesting that this takes place right on the heels of the section restructuring itself.
  • This will be on the agenda for the next meeting. Jeff will not be able to participate. He will send concerns or comments via email prior to that meeting.
  • John will find an alternate recorder for that meeting.

5.1 http://www.ala.org/llama/llama-reorganization-information

5.1.1 Proposed by-laws

5.1.2 Recording of Virtual Town Hall--recommended

5.1.3 “Why Reorganize Now” and other FAQs shared

 

:60 6. LLAMA Assessment Repository Update

  • Helen made sure the group is aware that there is a proposal to create an easy-to-use assessment repository system. It would include material about both published studies but also assessments with negative or inconclusive results.
  • The biggest discussion at this point is whether Omeka or Open Science is the best platform. We need someone with a technical background to evaluate them.
  • This whole effort grew out of work done by LLAMA MAES Data Collection for Library Managers Committee in conjunction with LLAMA LOMS PELS Committee.
  • Nancy will communicate with Helen about individuals in LITA who could help with an evaluation.
  • One of the questions is "Is a database administrator needed?" Nancy responded that there are related and other important questions.
  • John indicated that Martha Kyrillidou's consulting on the project is over. He's not sure whether the second phase will move forward without a consultant.

:65 7. Brainstorm results for activities to support committee charge

 

7.1 Summary of general ideas:

In general, save the time of our colleagues.

Be engaged outside of LLAMA.

How do we measure our impact, that it's important to people.

  • Helen spoke to this toward the conclusion of the last meeting. She is the one who added engagement outside of LLAMA. Our potential audience for what we're doing should be quite broad (by library type, by responsibility, etc.).
  • Nancy indicated that, just listening to today's discussion, we have a lot of that can be shared.
  • Terry indicated that we have to practice what we preach so we need to be measuring what we do. John concurred wholeheartedly.
  • We will get some guidance from the survey, including helping us to understand the population. A lot of our success may be based on our outreach with the survey.
  • John is thinking that we might see what other lists cross with the ARL Assessment listserv. John's aware of a listserv from a state library that seems pointed to public libraries. Rich will ask the State Librarian of Utah, in a conversation later this morning, about this. Rich referred to things that are going on in Colorado along these lines. John asked if anyone has connections with school librarians. Nancy will try to reach out to someone she knows who served on the AASL board.
  • There was some discussion of music librarians, medical librarians, archivists (there are regional groupings).
  • John proposed that a Google spreadsheet be created where we can contribute ideas of groups and potential contacts within the group who might be able to distribute our survey.
  • The question came up about getting the survey out through ALA--possibly through the AL Direct email. It's at least worth a try.
  • We should try to put it in front of people in as many ways as possible.
  • John will want to make sure Anne Cooper Moore (chair, Assessment Section) is in the loop.

7.2 General support for gathering more ideas

Survey Assessment section elist and beyond: survey, potential discussion

Identify problems committee members hope to address or our general interests

Evaluate and select activities wanting to launch

What time frame should we be working from?  

7.3. Opt-in: creating small working groups around ideas that engage committee members.  

:85 Next meeting: Thursday November 10 at 8:30am MT / 9:30am CT / 10:30am ET for 1.5 hours. 

  • Adjourned with nine minutes to spare.
More...

Online Doc Approved minutes, Resources Committee Meeting 2016 10 13

by John Wiggins on Thu, Oct 27, 2016 at 12:21 pm

John Wiggins (Chair) called roll at 10:33am. In addition to him, Jeff Belliston, Nancy Colyar, Wenli Gao, Helen Look, Diane Porterfield, Terry Taylor, and Steve Borrelli (recorder) were in attendance. Rachael Elrod, Richard Paustenbaugh were not able to attend.

The Chair announced that Kerry Creelman has resigned from the committee. After a discussion about whether to look for a replacement for Kerry, the consensus was to move ahead with the current roster and to reach out to the New Professional Section as needed for additional help.

Members introduced themselves

John Wiggins (Chair) called roll at 10:33am. In addition to him, Jeff Belliston, Nancy Colyar, Wenli Gao, Helen Look, Diane Porterfield, Terry Taylor, and Steve Borrelli (recorder) were in attendance. Rachael Elrod, Richard Paustenbaugh were not able to attend.

The Chair announced that Kerry Creelman has resigned from the committee. After a discussion about whether to look for a replacement for Kerry, the consensus was to move ahead with the current roster and to reach out to the New Professional Section as needed for additional help.

Members introduced themselves

Minutes from the 08.22.16 meeting were approved

The group discussed future meetings that are scheduled during upcoming conferences. The Chair proposed that a virtual meeting be held for the midwinter meeting scheduled for 01.26.17, hold an on-site meeting for the June 2017 meeting, and the meeting that is scheduled to coincide with the ACRL Conference on 03.23.17 was left undecided.

The Chair provided updates on deliverables from the last meeting.

1. Update on communication with Services committee:

1.1. Facilities/Space.  Services committee offers for our consideration:

1.1.1.   Facilities: infrastructure: power and data, lighting, plumbing, HVAC, etc.

1.1.2.   Space: programming: general or specialized commons, collections space, group and individual study spaces, hours

1.2. Web site/services provided by website: John recommended committees remain in communication as we plan our programming and collaborate/negotiate as needed as we establish some precedents.

The group discussed websites as having components that are services while others that relate to resources. Examples included “ask a librarian” discussed as a service and outside the scope of our committee, whereas the web presentation/organization of electronic resources falling within the scope of the Resources Committee.

Aspects of Collections were discussed as within the scope of the committee, of particular interest is an administrative level view of collection assessment. Nancy volunteered to investigate to learn which groups are already looking into collection assessment at the administrative level.

 2. Discussed using the MAES listserv (now the Assessment Section e-list) to generate tips and ideas. The Organizational Practices committee is interested in seeing our results.  The At-Large members of the Assessment Exec. Comm. (who run Hot Topics) also want to do a survey, so we’re looking to coordinate.

2.1. From meeting minutes: Ask MAES listserv via survey about their thoughts, wishes, what they are already using.  Invite respondents to self-identify for expertise on assessing collections, discovery tools, facilities, websites.

2.2. Discuss potential ACTION ITEM: consider a small group to draft the survey questions and submit for review on Thu Oct 27.

Discussed was the appropriateness of the Assessment Section e-list for the survey. The ARL-ASSESS listserv was also discussed as an appropriate list to solicit responses. The group was in favor of distributing the survey broadly.

The purpose of the survey was discussed as to learn about the needs of the “sudden assessment librarian” (e.g. toolkits, bibliographies, etc.), the “accidental administrator” (e.g. how to use assessment to make management decisions), those who have been in the field for a number of years, as well as those librarians who have assessment as an aspect of their position.

Most important thing learned / muddiest point lines of questioning were discussed and the three questions below were drafted

What have you learned that has had the most impact in assessment?

What do you think you need/want to learn as soon as possible?

What expertise have you grown that you’re interested in sharing? 

John will send out the questions to the group for review and would like a response by 10.14 in order to share the questions with the executive committee on Monday 10.17.

Discussed was a desire to administer the survey by 10.27, however, no firm decisions on timeframe of administration were made

3. Hot Topics discussion—Ellen Safley and Kirsten Kinsley share the following feedback from the last forum—does anything spark topic ideas for one of the upcoming forums?

  • 3.1.    Follow up on assessment projects
  • 3.2.    More opportunity for small group discussion
  • 3.3.    Easy inexpensive ways to assess events and libraries
  • 3.4.    How to access social media habits of academic student body for best library use
  • 3.5.    How to assess impact of preservation depts.
  • 3.6.    Detailed ways to access events
  • 3.7.    What info others look for in assessment results
  • 3.8.    More assessment
  • 3.9.    Methods of collecting data
  • 3.10.  Library impact on student success.  Value.  Return on invest for events or in general
  • 3.11.  Something about successfully sharing data with leadership, public & other stakeholders

The group discussed item "3.3 Easy inexpensive ways to assess events and libraries” as a potential topic for an upcoming forum. The group thinks that this would be an interesting topic. Micro-assessments were discussed as not taking much time or resources (from the libraries or respondent perspectives), however, the group felt that the term may be confusing, “guerilla” assessments was proposed as a term that many in academic libraries might be familiar with. The Chair noted that we should consider using terminology that would be recognizable to a broad swath of the profession, suggesting we use the term “outcomes” when appropriate to accommodate those outside of academic libraries. It was noted that the idea also aligns well with 3.9 Methods of collecting data.

DELIVERABLE:

4. For November meeting: Steve, Helen, and John are asked to report on trends we might see at the Library Assessment Conference at the end of October. Terry and Wenli announced they are also planning to attend.

5. For potential follow-up: Nancy and John interested in assessment of discovery tools and web sites

Offer stands and depends on how committee prioritizes programming ideas for the service year.

6. At last meeting, the committee agreed to pursue how our Assessment section committee overlaps with other groups within ALA. Discuss potential ACTION ITEM: small group researches list of other ALA divisional/sectional committees tasked with assessment program and/or suggests next steps regarding how we can find others/learn more about these committees as potential partners and overlapping audiences.

The proposed action item was discussed as broader than the work Nancy had volunteered to work on. Discussed was the idea of individuals volunteering to review the groups within divisions they are active in and others could volunteer to fill in the gaps. Nancy agreed to lead the coordination effort.

We discussed co-sponsoring events with other groups in order to expand our impact.

7. Brainstorm results for activities to support committee charge

7.1. Summary of general ideas from previous meeting:

7.1.1.   In general, save the time of our colleagues.

7.1.2.   Be engaged outside of LLAMA.

7.1.3.   How do we measure our impact, that it's important to people.

The idea of creating a resource that others would want to join the effort to develop was suggested as a measure of impact. It was cautioned however that sustainability of the resource should be a consideration. A website listing tools and resources was one example; that or any similar effort could also lead to programming, webinar, etc. ideas that focus on more granular topics.

Considerations for how a resource might work for different types of librarians were discussed (i.e. school librarians, medical librarians, etc.).

Topic areas discussed for the resource included: how to manage an assessment program and tools for the sudden assessment librarian or accidental administrator.

Remaining agenda items were not addressed; next meeting will continue with discussion regarding our intended impacts.

8. General support for gathering more ideas

8.1. Survey Assessment section e-list

8.2. Identify problems committee members hope to address or our general interests

8.3. Evaluate and select activities wanting to launch

8.4. What time frame should we be working from?  Would suggest avoiding putting together something for this MW.

9. Opt-in: creating small working groups around ideas that engage committee members.

1:25 Next meeting: Thursday October 27 at 8:30am MT / 9:30am CT / 10:30am ET for 1.5 hours. Review deliverables/preparation for that meeting.

 

More...

Pages

Subscribe to LLAMA Assessment Section Resources Committee