1 of 31

USING TECHNOLOGY TO REACH MORE STUDENTS IN TOUGH TIMES: AN ANALYSIS ON FIVE SEMESTERS OF DATA CONNECTING STUDENTS WITH THE INFORMATION LITERACY SKILLS THEY NEED TO COMPLETE THEIR ASSIGNMENTS

Steve Borrelli, Instructional Design Librarian

Alex Merrill Systems/Operations Manager & Digital Initiatives Librarian�Washington State University

2 of 31

Where do students learn about library skills and resources: What are the main points of contact with the Libraries?

  • Reference desk
  • One shot instruction session

3 of 31

Our bread and butter…?

  • The one shot session meets the needs of students in terms of providing an opportunity to learn everything they need to know about how to use a library, providing the tools they need to act in an information literate manner when addressing assignments.

4 of 31

What are some of the challenges with the one-shot session?

  • Too much information for students to absorb in one session
  • Not enough time to cover everything desired
  • Lack of a true assessment of learning
  • Timing of instruction in relation to student assignments
  • Not enough librarians to cover all the courses that request instruction
  • Reluctance of instructors to devote a class session to LI/IL skills
  • Student absences are unaccounted for
  • Little opportunity for rapport to develop between librarian and student
  • Challenging to have time for students to apply what they’ve learned
  • Unrealistic expectations from instructors about what will/can be covered in the allotted time

5 of 31

  • “The one shot is not information literacy. It’s a familiarization exercise that can serve as a doorway into information literacy.”
    • Bill Badke, “Ramping up the One Shot.” Allbusiness.com. Web. 22 July, 2009

6 of 31

Every once in a while opportunity comes knocking at your door.

  • 2006 Information Literacy (IL) included as one of the Six Learning Goals of the Baccalaureate
  • IL getting national attention
    • President Obama declares October 2009 as National Information Literacy month
  • fall 2009 WSU begins using Angel
    • All WSU Pullman campus courses have angel space
      • Hybrid or “blended” learning becomes the norm

7 of 31

For librarians, a hybrid learning experience means potential for:

  • Multiple opportunities for students to consider LI/IL related topics
  • Creating content for courses
  • Designing assignments
  • Opportunities for legitimate assessment
  • Providing instruction in more classes

8 of 31

Number of students receiving Li/IL instruction:

  • 2005 - 2006 10,681

  • 2008 – 2009 17,179

  • 62 %

9 of 31

What is ILE?

  • ILE = Information Literacy Education Learning Environment
  • Homegrown learning environment designed specifically to deliver information literacy instruction and assessment
  • Flexible tool for collaborative assignment design
  • Not a tutorial

10 of 31

11 of 31

Advantages to using ILE to reach more students:

  • Rapidly build course spaces
  • Use the best learning objects we can find on topic
  • Connect quiz questions with learning objects
  • Collaboratively design assignments
    • Assign quizzes, and essays
  • Assess students

12 of 31

Financial support:

  • 2007 = ~$5000
    • WSU Teaching and Learning Improvement Grant from the Office of Undergraduate Education
  • 2008 = ~$5000
    • WSU Samuel H. and Patricia W. Smith Grant from the Office of Undergraduate Research
  • 2009 =$14,000
    • Donation from Fred Tompkins, WSU graduate and university donor
    • Donation from the Hayner Trust

13 of 31

ILE Participation by Semester:

  • Course Sections Participants
  • fall 07
    • Geology 101 43 659
    • Hort/Crops 102 1 44
  • spring 08
    • Geology 101 42 452
    • Bio. 105 DDP 1 33
    • English 101 9 183
  • summer 08
    • Soils 101 DDP 1 8
  • fall 08
    • Geology 101 42 618
    • Hort/Crops 102 1 49
    • Bio. 105 DDP 1 60
    • English 101 19 266
    • Soils 101 DDP 1 16
    • Phil 260 DDP 1 25
    • GenEd 110 7 562
    • GenEd 300 1 5
  • spring 09
    • Geology 101 41 650
    • Bio. 105 DDP 1 56
    • English 101 21 425
    • English 298 1 7
    • GenEd 110 4 361
    • Phil 260 DDP 1 29
    • GenEd 300 DDP 1 12
  • Total Participation: 240 4480
  • Note: To date ILE has had a participation rate of 82.72%.

14 of 31

ILE Participation by Semester:

  • Course Sections Participants
  • fall 09
    • Biology 101 DDP 1 54
    • Geology 101 41 731
    • GenEd 110 4 344
    • English 101 12 263
    • GenEd 300 2 23
    • Philosophy 260 DDP 1 37
    • History Asia/373 1 51
  • Total fall 2009 62 1503

  • spring 2010 courses
    • English 101
    • English 201
    • English 298
    • GenEd 104 Pass
    • GenEd 110
    • GenEd 111
    • University 490.1
    • Soils 101 DDP
    • Biology 101 DDP
    • Geology 101

  • Users as of beginning of week 4 of spring 2010 semester = 1401

15 of 31

Flexibility is key:

  • Geology 101 – 40+ sections, 600-750 students
    • Skill building for final project
  • Hort 102 – Students from WSU and University of Idaho
    • phased research assignment, librarian in classroom, and online instruction
  • Composition classes – pre one shot preparation
  • History/Asia 373 – native content and assessment
    • Skill building including librarian graded assignment
  • University 409.1 McNair
    • Individual Information Literacy Resource page

16 of 31

What we looked at:

  • Results of quiz questions from 240 sections of nine courses across six colleges
  • 5 semesters of quiz questions answered in the ILE space
  • 39,484 instances of 173 questions
  • Questions mapped to IL standards
    • Question topic areas within standards

17 of 31

Overview of tests used:

  • Alternative Student’s t-test
    • Assumed Unequal Variance
    • Two tailed test
  • Mann-Whitney Test
    • Used as an alternative to the TTEST for non-parametric data
  • Why the two different tests?

18 of 31

Results of analysis:

Standard

Mean of all Questions

Evaluating Resources

82.61%

Using Information

77.66%

Needed Information

74.81%

Accessing Information

65.64%

19 of 31

Comparing the IL standards:

Standards Compared

Means

Means

P value (α .05)

Needed/Accessing

74.81%

65.64%

.062

Needed/Evaluating

74.81%

82.61%

.063

Needed/Using

74.81%

77.66%

.514

Accessing/Evaluating

65.64%

82.61%

.00089

Accessing/Using

65.64%

77.66%

.018

Evaluating/Using

82.61%

77.66%

.421

20 of 31

Accessing (2) /Evaluating (3):

Accessing

Evaluating

Mean

65.64%

82.61%

Variance

328.03

187.31

Standard deviation

18.11

13.68

t–test (p value)

.00089

Mann-Whitney (p value)

.0001

Equation for variance �(summary notation)

21 of 31

Accessing (2) /Using (4):

Accessing

Using

Mean

65.64%

77.66%

Variance

328.03

311.64

Standard Deviation

18.11

17.65

T-test (p value)

.018

22 of 31

Needed (1) /Accessing (2):

Needed

Accessing

Mean

74.81

65.64%

Variance

398.39

328.03

Standard Deviation

19.95

18.11

t-test (p value)

.062

Mann-Whitney (p value)

.039

23 of 31

Comparing concepts within Standard 2:

Concept

Mean of all questions asked

Primary/ Secondary

82.44

Type of Publication

78.17

Search Technique

71.06

Local Knowledge

71.05

Database Selection

69.96

Name Recognition

68.31

Searching

67.89

Citation Style

63.43

24 of 31

Comparing the means (standard 2):

Standards Compared

Mean

Mean

P value t-test (α .05)

P value MW (α .05)

Primary or Secondary/Name Recognition

82.44

68.31

.024

.046

Primary or Secondary/Searching

82.44

67.88

.014

.018

25 of 31

Comparing concepts within Standard 4:

Concept

Mean of all questions asked

Fair use

81.58

Copyright

79.26

Plagiarism

77.51

Citation and attribution

76.69

Local Knowledge

71.05

Name Recognition

68.31

26 of 31

Student comments:

  • It is a really valuable segment of program the more I look at it.  How long can I have this account even as a reference site when I try to research, and write an essay in the future?Distance Biology student

27 of 31

What was the most important thing you learned from doing these information literacy exercises?

  • “How to find scholarly sources” Fresh. Undecided
  • “How to weed out the good sources from the bad ones” Soph. Biol. student
  • “I learned more about MLA Format which can help me throughout my college experience, and it helped me explore and become more efficient using the online library.” Soph. Advertising

28 of 31

What was the most important thing you learned from doing these information literacy exercises?

  • “I think the most important thing I learned was the usefulness of Washington State University's online library resources. They were extremely helpful in the research of geology articles, and I am sure would be equally as useful for researching other topics.” Soph. Comm. student

29 of 31

ILE conclusions:

  • Reaching more students with less time in the classroom
  • Reaching them more often, in more classes
  • True assessment and data
  • Better understand the students
    • Provide more focused instruction

30 of 31

Statistical summary:

  • Students at WSU Pullman answer quiz questions with:
    • Greatest Proficiency – Evaluating Sources
    • Least Proficiency – Accessing Information
  • Within Accessing Information students tend to struggle with:
    • Selecting databases, recognizing names, searching, and understanding citation styles
  • Within Using Information students tend to struggle with:
    • Needing local knowledge of environment, policies, practices and recognizing names
  • Be selective in naming local resources, and provide context

31 of 31