1 of 28

Large Language Models in Academic Work and Medical Education

A Crash Course in genAI Chatbots

Ivana Mihalek

Faculty of Medicine in Rijeka,  Department of Molecular Medicine and Biotechnology, Rijeka, Croatia

ivana.mihalek@uniri.hr

2 of 28

A Crash Course in genAI Chatbots

  • Privacy in the chatbot world
  • Literature Search
  • Summarizing and Reviewing Scientific Papers
  • Planning and Administrative Tasks in Medical Education
  • LLMs from a Learner’s Perspective – LLM as a Socratic Learning Tool

Slides for this presentation

AI-powered chatbots are the friendly face of LLMs

3 of 28

Exercise 1: Privacy Settings in Chatbot Homepages

Slides for this presentation

4 of 28

Privacy in the chatbot world

ChatGPT example – privacy statement, private chat

when logged in

5 of 28

Privacy in the chatbot world

ChatGPT example – privacy statement, private chat

when logged in

6 of 28

Privacy in the chatbot world

ChatGPT example – privacy statement, private chat

7 of 28

Privacy in the chatbot world

when logged in

8 of 28

Privacy in the chatbot world

when logged in

9 of 28

Privacy in the chatbot world

10 of 28

Privacy in the chatbot world

11 of 28

Privacy in the chatbot world

12 of 28

Privacy in the chatbot world

13 of 28

Privacy in the chatbot world

How do I know all that stuff?

14 of 28

Privacy in the chatbot world

Exercise: make your conversation private in one of other major chatbot accounts

https://www.kimi.com/

15 of 28

Exercise 2: (A Reliable) Literature Search

Slides for this presentation

16 of 28

Literature Search

  • Traditional database queries (PubMed, Scopus) can be slow and keyword-dependent.
  • LLMs can complement these tools by helping to brainstorm search terms, generate structured queries, and summarize relevant findings from retrieved abstracts.

“Pomozi mi napisati query za PubMed trazilicu. Zelim pronaci znanstvene radove u zadnjih deset godina s Američkih sveučilišta koji opisuju varijante u K. pneumoniae bakteriji koje doprinose virulentnosti ili patogenosti te vrste”

Exercise: make chatbot write a Pubmed query

(use this, or make up your own query)

“Help me write a PubMed query. I want to find papers by US academic authors, published within the last 10 years and describing K. pneumoniae variants contributing to the virulence or pathogenicity of that species.”

New kid on the block

Gemini

17 of 28

Exercise 3: Summarizing Scientific Papers

Slides for this presentation

18 of 28

Summarizing and Reviewing Scientific Papers

  • LLMs can efficiently summarize complex studies, identify methodological limitations, and highlight thematic connections across papers.
  •  We need to learn how to critically assess generated summaries and recognize common inaccuracies or biases.

Summarize the key findings and clinical relevance of this abstract in 4 sentences. Identify study design, population, main outcome, and limitations

list three methodological weaknesses in this study that could influence clinical decision-making

Exercise: Find anything the model glossed over, oversimplified, or invented.

Claude Sonnet, Le Chat

19 of 28

Summarizing and Reviewing Scientific Papers

  • LLMs can efficiently summarize complex studies, identify methodological limitations, and highlight thematic connections across papers.
  •  We need to learn how to critically assess generated summaries and recognize common inaccuracies or biases.

Claude Sonnet, Le Chat

20 of 28

Exercise 4: Planning Administrative Tasks

Slides for this presentation

21 of 28

Planning and Administrative Tasks in Medical Education

  • Beyond teaching and research, educators face repetitive organizational duties such as scheduling, report writing, and professional correspondence.
  •  LLMs can automate parts of these processes while maintaining clarity and professionalism.
  • Today: Create form-fill ready syllabus and a lecture plan

Deep Seek

(you may want to use a text editor for writing prompts like this;

Note: a chatbot builds up on the previous conversation)

I am a practicing ophthalmologist, an MD PhD, and an experienced teacher.

Tell me about the current trends in topics covered and methodologies used in teaching neuroanatomy and neurophysiology of the eye, in the US and Great Britain universities.

22 of 28

Planning and Administrative Tasks in Medical Education

  • Beyond teaching and research, educators face repetitive organizational duties such as scheduling, report writing, and professional correspondence.
  •  LLMs can automate parts of these processes while maintaining clarity and professionalism.

Deep Seek

I want to design a course entitled "Neuroanatomy and Neurophysiology of the Eye". The lecture part should consist of 10 lectures, aimed at  third-year students of pre-clinical medicine. Please suggest the syllabus, There should be 10 lectures.

1) Explain the goal of the course in 5 sentences or less.

2) What should be the learning outcomes for the students of this course? Please break down into (A) cognitive, (B)affective, and (C) psychomotor domains, as applicable. Present the breakdown components as enumerated list (1, 2, 3, etc).

3) Specify the brief content of each lecture

4) Specify the prerequisites and suggest a textbook

23 of 28

Planning and Administrative Tasks in Medical Education

  • Beyond teaching and research, educators face repetitive organizational duties such as scheduling, report writing, and professional correspondence.
  •  LLMs can automate parts of these processes while maintaining clarity and professionalism.

Deep Seek

Help me create teaching plan for the second lecture, also referred to as the second teaching unit

The teaching unit should last 50 minutes, which should include 5 minutes for the review of the relevant facts from the previous units, and 5 minutes for the anonymous quiz at the end

Please write or create the following:

1. the aim of the teaching unit

2. the learning outcomes for the teaching unit

3. the learning outcomes of the class that are related to the learning outcomes for the teaching unit, by domain (cognitive, affective, psychomotor); should be numbered, and grouped as in the learning outcomes for the class

4. the timeline for the unit, presented as a table that includes the following columns:

Duration, teacher activities, student activities, materials and tools.

5. student evaluation methods as a table with columns

"Evaluation component", "evaluation type", "learning outcomes relates to", "the implementation and weight"

the "learning outcome relates to" should be listed as A1, A2, B1, as appropriate to connect to the learning outcomes of the unit; the evaluation type should be formative or summative;

24 of 28

Planning and Administrative Tasks in Medical Education

The anatomy of a prompt:

Deep Seek

I am a practicing ophthalmologist ...

I want to design a course … aimed at  third-year students of pre-clinical medicine … there should be 10 lectures ...

Help me create teaching plan for the second lecture ….

...

5. student evaluation methods as a table with columns

"Evaluation component", "evaluation type", "learning outcomes relates to", "the implementation and weight"

the "learning outcome relates to" should be listed as A1, A2, B1, as appropriate to connect to the learning outcomes of the unit; the evaluation type should be formative or summative;

establish the background

define the target audience for your request

give details, with the examples of what you are trying to achieve

25 of 28

Planning and Administrative Tasks in Medical Education

  • Beyond teaching and research, educators face repetitive organizational duties such as scheduling, report writing, and professional correspondence.
  •  LLMs can automate parts of these processes while maintaining clarity and professionalism.

Deep Seek

Here is what DeepSeek comes up with

Exercise: create your own syllabus, using other chatbot(s)   prompts are reusable!

26 of 28

Exercise 5: Socratic Learning

Slides for this presentation

27 of 28

LLMs from a Learner’s Perspective – LLMs as a Socratic Learning Tool

  • Let's take a look at how students can engage with LLMs as interactive tutors, using structured questioning to test understanding, explain reasoning, and promote reflective learning.

ChatGPT, Gemini

28 of 28

That's it.

See you around.

Slides for this presentation