Library impact case studies as a methodology for understanding the value of library services��
Presented by�
Sarah Graham
Library Research Support Services at the University of Sydney
Assessing service development and value
MATURITY | BENEFIT | ||
Embryonic | Service is experimental | Low | Slightly improves processes but in a manner that will be difficult to translate into benefit |
Emerging | Service is piloted and beginning to be rolled out | Moderate | Provides incremental improvements to established processes that will result in increased benefit to clients |
Adolescent | Uneven evolving of service model, some definition around consistent approach to support | High | Enables new ways of working that will result in significantly increased benefit for clients |
Early mainstream | Service model is proven and value is predictable Frameworks continue to evolve | Transformational | Enables new ways of ‘doing business’ with partners (faculties, research portfolio etc) across the university |
Mature mainstream | Proven service model with well-understood frameworks | | |
The University of Sydney
Page 3
Applying the criteria
| Maturity | Benefit |
Researcher profiles & outreach strategies | Adolescent | Moderate |
Grant and promotion metrics | Early Mainstream | High |
Strategic publishing | Adolescent | Moderate |
Open Access practices | Emerging | Moderate |
Industry and community partnerships | Emerging | High |
Engagement and impact assessment | Emerging | Moderate |
Systematic Reviews | Mature mainstream | High |
The University of Sydney
Page 4
Understanding the Impact of Our Services
The University of Sydney
Page 5
Measuring activity
2017
Science team produced 21 metrics reports in 2017
2018
Science team created 101 metrics reports in 2018 ≈ 380% increase
The University of Sydney
Page 6
Impact stories
The University of Sydney
Page 7
“As a result of your work, we now have interviews lined up with four corporates that we previously had no contact with.”
The University of Sydney
Page 8
“Really you should be co-recipient of this award as you did so much to assist me getting the publication evidence and documents together.”
The University of Sydney
Page 9
“A couple of other things to note. First, I am currently preparing both a Discovery and Centre of Excellence proposal. I will reuse bits of this in the relevant background sections of those applications too. Second, I passed some of the analysis that you did of my citations to colleagues who used it in nominating me for a Distinguished Fellow Award for the Economic Society […] it has been recycled and used in multiple ways.”
Research Impact Case Study
How did you engage?
Engagement
What was produced?
Outputs
What was the impact of what you did?
Feedback
How do you know it made an impact?
Evidence
The University of Sydney
Page 12
Forms of evidence
Quantitative | Qualitative |
Increased use of services | User feedback/testimonials |
Numbers of clients reached | Emails or correspondence from key or pivotal individuals |
Diversity of clients reached | Evidence of usage |
Numbers of external partners | Evidence of sustainability, for example, ongoing engagement with a group, significant increase in participation over time |
We make meaning when we tell stories; we understand when we hear stories.
Impact is…
Source:
Defining and evaluating impact in the humanities, Julia Boman, HERA, EUROPEAN SCIENCE FOUNDATION
http://www.carmen-medieval.net/download/1404041556/?at=1
The University of Sydney
Page 15