1 of 35

Creatively Responding to Generative AI at CCSF

A Collaborative Presentation to the Technology Committee

Tuesday October 17, 2023, 2:15 pm

2 of 35

Who We Are

  • Dayamudra Dennehy, ESL & DE Co-Coordinator
  • Alisa Messer, English
  • Richard Velasquez, OLET, ED TechTrainer
  • Kevin Sherman, Cinema & TLTR Chair
  • Aaron Brick, Computer Science
  • Lisa Velarde, Library & Learning Resources

3 of 35

Introduction

The Impact of Generative Artificial Intelligence at CCSF

4 of 35

anxious scared

doubtful skeptical

excited

enthusiastic optimistic

confused

unsure

intrigued curious

The Center for Teaching Innovation at Cornell University

Range of GAI Attitudes

5 of 35

“AI is weird. No one actually knows the full range of capabilities of the most advanced Large Language Models, like GPT-4. No one really knows the best ways to use them, or the conditions under which they fail. There is no instruction manual. On some tasks AI is immensely powerful, and on others it fails completely or subtly. And, unless you use AI a lot, you won’t know which is which.”

--Ethan Mollick

Quoted by Tamara Tate, Digital Learning Lab, UC Irvine

6 of 35

CCSF Vision

CCSF shall provide a sustainable and accessible environment where we support and encourage student possibilities by building on the vibrancy of San Francisco

and where we are guided by the principles of inclusiveness, integrity, innovation, creativity, and quality.

Empowered through resources, collegiality, and public support, the college will provide diverse communities with excellent educational opportunities and services. We will inspire participatory global citizenship grounded in critical thinking and an engaged, forward thinking student body.

7 of 35

CCSF Mission

Consistent with our Vision, City College of San Francisco provides

educational programs and services that promote student achievement and life-long learning to meet the needs of our diverse community.

In the pursuit of individual educational goals, students will improve their critical thinking, information competency, communication skills, ethical reasoning, and cultural, social, environmental, and personal awareness and responsibility.

8 of 35

CCSF Student Code of Conduct: Academic Dishonesty

  • Academic or intellectual dishonesty such as cheating, plagiarism, or the use of

generative tools (including but not limited to GPT-4, Chat GPT, Claude, Cohere),

without the permission of the instructor to produce responses to school tasks or activities.

  • Cheating is defined as taking an examination or performing an assigned, evaluated task in a dishonest way.
  • Plagiarism is defined as the unauthorized use of the written language and thought of another author/tool without proper quoting or citing and representing the author's/tool’s work as the student's own.
  • A student may not use generative tools to produce content that the student submits as the student’s own thoughts and/or language.

9 of 35

Concerns of CCSF Faculty

  • Academic integrity and the use of AI in student work
    • When are Generative AI tools appropriate/not?
    • When are Generative AI tools helpful/not?
  • Designing & Communicating Clear Gen AI Policies
    • In classes, in departments, across the college
  • The “cheating” narrative
    • Gatekeeping
    • Equity
  • Pedagogy
    • Re-designing assignments & assessments in the Gen AI Age
  • Partnering with librarians for student & faculty support
    • Digital Literacy
    • Academic Integrity

10 of 35

Alisa Messer

English

11 of 35

English Dept: No Consensus On Gen AI

  • This is NEW for us: The landscape is changing
  • Model not knowing things.
  • How do we help students think critically about new tools?
  • A general lack of understanding of the tool
    • Built-In Bias
    • Misinformation/Disinformation       
    • Extractive labor and exploitation
    • Loss of jobs
    • Environmental costs

12 of 35

Richard Velasquez

OLET, Educational Technology Trainer

13 of 35

Generative AI is here to stay

Using AI Responsibly in Academia

•Focus on higher-order skills

•Verify before amplifying

•Model responsible use of AI

•Customize for your class

14 of 35

Kevin Sherman

Cinema, TLTR Chair

15 of 35

Testing Out AI Detection Tools in Class

  • Main concern with the AI detectors: They are not accurate.
  • A 300 word post can generate a 96% human score.
  • The first 100 words from that same post can generate a 4% human score.
  • Done over 100 times with different examples.
  • The AI generators differently depending on how much text is put into the field.
  • Have tried AI Content Director. Zero GPT. Yet to try the TurnItIn detector.

16 of 35

Aaron Brick

Computer Science

17 of 35

Detecting Artificial Intelligence: A New Cyberarms Race Begins: "False positives and negatives are considerable among current automated detectors. Detector accuracy also significantly drops off when content falls outside the dataset that trained the detector."

Research: AI Detectors are not accurate or equitable

Testing Detection Tools for AI Detection Text (a study out of Germany): "Our findings do not confirm the claims presented by the systems. They too often present false positives and false negatives…Our conclusion is that the systems we tested should not be used in academic settings."

Accused: How students respond to allegation of using Chat GPT on assessments (Drexel University): "Even if an AI detector was highly accurate and reliable, it would be insufficient for its purpose… This very low false positive rate still suggests that 80 students per year will be falsely accused of cheating with AI. Moreover, the perceived infallibility of such tools may mean that innocent students are left unable to defend themselves."

18 of 35

Lisa Velarde

Library & Learning Resources

19 of 35

Library’s new Online Workshop: Academic Integrity

  • Helps students distinguish between academic honesty & dishonesty
  • Acknowledges challenges & pressures students face
  • Helps students identify good work habits & problematic ones
  • Lists resources & supports
  • References generative AI

20 of 35

21 of 35

22 of 35

23 of 35

24 of 35

Library’s Academic Integrity Workshop

  • Contains short quiz that is automatically graded
  • Students earn a badge/credential called Academic Integrity Striver

SAMPLE

25 of 35

Access to the new workshop

Students and Faculty can access the workshop from the

Online Library Workshops page:

https://library.ccsf.edu/research/workshops

26 of 35

Dayamudra Dennehy

ESL, Distance Education Co-Coordinator

27 of 35

The “With or Without It” Contradiction

If students never learn AI, they will be at a disadvantage in their study and careers.

If they use AI too much and too early, they will also be at a disadvantage as they will be robbed of foundational skills necessary to use it well.

Tamara Tate, Digital Learning Lab, UC Irvine

28 of 35

Try It Out

Reflect

Learn More

Talk to Colleagues

Refine for Class

Insert prompts. Observe what happens.

Determine if and how students are using it for class

  • Ethical and accessible considerations
  • CCSF Guidelines
  • Discuss with dept.
  • Future GAI events
  • Ongoing PD
  • Develop course policies
  • Modify assessments
  • Communicate with students

Next Steps for Instructors

The Center for Teaching Innovation at Cornell University

29 of 35

Conclusion

Challenges & Solutions

30 of 35

Concerns of CCSF Faculty

  • Academic integrity and the use of AI in student work
    • When are Generative AI tools appropriate/not?
    • When are Generative AI tools helpful/not?
  • Designing & Communicating Clear Gen AI Policies
    • In classes, in departments, across the college
  • The “cheating” narrative
    • Gatekeeping
    • Equity
  • Pedagogy
    • Re-designing assignments & assessments in the Gen AI Age
  • Partnering with librarians for student & faculty support
    • Digital Literacy
    • Academic Integrity

31 of 35

Working Questions

  • Ethical concerns
    • How can we support AI literacy in a way that is ethical and equitable?
    • When might AI use be forbidden, discouraged, encouraged, or required?
    • Why/how might this vary for specific courses, assignments, students, or instructors?
  • Other concerns: Data privacy, unpaid labor, and equal access

Adapted from Daniel Stanford by Tamara Tate, Digital Learning Lab, UC Irvine

32 of 35

This is a Promethean Moment

This is a Promethen moment we have entered - one of those moments in history when certain new tools, ways of thinking, or energy sources are introduced that such a departure and advance on what existed before that you can’t just change one thing, you have to change everything.

That is, how you create, how you compete, how you collaborate, how you work, how you learn.

-Thomas L. Friedman

This quote from Joe Marquez, CUE Director of Academic Innovation, OTAN Presentation 10/10/23

33 of 35

Conclusion

  • There are legitimate fears & concerns about how Gen AI Tools are affecting our work as educators.
  • There are also opportunities for transformation. How do we create a Culture of Innovation?
  • Different voices need to be heard in the conversation, including students
  • The Gen AI Tools are constantly changing. This is the worst they will ever be.
  • What kind support do our students need for the effective use of Gen AI Tools?
  • What kind of PD & support do we need as faculty and administrators?
  • Could a Working Group be formed to consider all these issues and start to design data-informed & equitable Policy Guidleines?

34 of 35

Final Thought

Let’s learn from and with

each other.

35 of 35

Guiding Resources