1 of 14

Researchers Writing With(out) AI

MyFest25

Shyam Sharma, Professor of Writing & Rhetoric

State University of New York at Stony Brook

2 of 14

Making Knowledge Through Writing

  • Humanities: we use discourse as a dominant tool of knowledge making – we dialog, synthesize, and interpret (theorize from) published texts
  • Sciences: we gather new/hard data from labs, patients, field, community – there’s a “control” mechanism that’s more transparent, systematic, etc
  • Social sciences: we combine both methods – with relative control

AI poses more risks to Humanities (and qualitative research) whenever researchers delegate synthesis to AI tools (and not just processing/analysis)

3 of 14

While researchers in the sciences may approach “writing” more as a vehicle for new ideas based on real-world data than as a source of ideas (if the researchers are honest), researchers in the humanities risk losing social value of the knowledge they create and contribute if they don’t use AI very cautiously.

4 of 14

Impacts of AI in Research via “Writing”

  • Still “writing” is a lot more than what scholars beyond the humanities think – that increases risks of AI use across the board
  • Delegating “writing” delegates intellectual work, professional growth, ethical/social responsibilities, etc
  • Even delegating “summarizing” of information to AI poses risks
  • So, the risks are distinct but serious across the board

What do we do?

  • Rethink, redefine, relearn “writing” in the age of AI
  • Create and adapt tools to exercise agency and maintain ethics

5 of 14

Activity 1: Rethinking “Writing”

Look at the “writing with(out) AI” handout and take notes.

What “writing” tasks could you do “better” without AI?

  • For more originality, agency, depth, etc, on your part as a scholar
  • For slowing down, thinking through/grappling, having a better grasp
  • For being ethically more responsible, sensitive, accountable, etc

What tasks involve minimal or no risk when you write with AI?

Where do you think you’d need to rewrite the meaning of “writing”?

  • Discussion

6 of 14

“Dumber” tasks you may get done with AI tools

  1. generate Tuesday and Thursday dates in a table column from Jan to May
  2. separate student names from this messy table I copied from an LMS
  3. extract emails from this table and separate them with commas
  4. point out paragraphs in this manuscript that I can cut or condense
  5. summarize this article to help me pay attention to the theme of X as I read it
  6. suggest possible titles for a journal article based on my abstract

Dr. Shyam Sharma State University of New York at Stony Brook

7 of 14

More cognitively significant tasks

  1. interact to remind/brainstorm your own ideas – not learn from the AI tool
  2. interact by asking how, why, etc, as you flesh out/refine my own ideas/perspectives
  3. summarize an article to help you pay attention to theme X before you read it closely

  1. draft a conference paper based on your notes and multiple rounds of interaction
  2. analyze a set of articles, drawing your attention to gaps or patterns for you
  3. analyze the data you uploaded, under 5 key themes for discussion

  1. develop a intellectual position through extended interaction with an AI tool
  2. write up a “lit review” section based on 20 articles you uploaded
  3. write up an article’s “discussion” section based on study results provided

  1. write up the social impact section for a grant proposal
  2. substantively revise a journal article based on your notes
  3. write profiles for effective outpatient dept. care of (say) Moroccan geriatric patients

Dr. Shyam Sharma State University of New York at Stony Brook

8 of 14

Prevalent myths about “writing”

  1. Linearity myth: writing is a single, simple, linear process
  2. Transience myth: you can “write” after you’ve learned how to once
  3. Transparency myth: you can “write it up” once you have data/ideas
  4. Hierarchy myth: you can outsource “lower-order” writing tasks
  5. Content myth: content is separate from the “form” of writing
  6. Style myth: good writing is mostly about “brilliant” writing styles
  7. Genius myth: good writers are born “geniuses,” not educated

Dr. Shyam Sharma State University of New York at Stony Brook

9 of 14

How AI is putting old myths about writing on steroids

  1. Linearity: just use AI it will help you skip through the tough step
  2. Transience: you don’t have to learn it anymore, as AI can “write”
  3. Transparency: AI is “better” at writing it up than humans are
  4. Hierarchy myth: it’s okay to “offload” lower-order tasks to AI
  5. Content myth: AI knows it all, because it has infinite datasets
  6. Style myth: AI can write in any style you prompt it to write in
  7. Genius myth: anyone with AI and prompting skills is a genius writer

Dr. Shyam Sharma State University of New York at Stony Brook

10 of 14

Dr. Shyam Sharma State University of New York at Stony Brook

11 of 14

Activity 2: Creating Your Own Flowchart

  • Take a look at my general flowchart. Thinking of the context of research in your field and for a particular project, check off questions you would ask, leaving out what you wouldn’t and adding what you’d need to add. Create your own flowchart (by hand).

  • Prepare to share your flowchart with a small group.

  • Breakout room discussion – followed by a brief discussion.

12 of 14

Maha Bali: My own past use of AI tools

Task/Tool

ChatGPT [paid]

Copilot

Poe (paid)

Gemini

Claude

Keenious

Typeset/

Scispace

Deep Research

Brainstorming

Yes

Yes

Yes

Yes

Yes

Yes

Finding articles

Unreliable

Semi reliable*

Semi reliable*

Yes. OK.

Yes

Summarizing/

paraphrasing

Yes

Yes

Yes

Yes

Yes

A bit

Writing abstract

(Via poe)

Yes

Data analysis

(Via poe)

Yes

Yes

Translation

Yes

Yes

* Semi reliable means it provides reasonable summaries and real sources, but the sources may not say what is in the summaries

13 of 14

Thank you!

14 of 14

Genuine Scholarship…

AI-Generated Content…

Nature & Purpose

Is driven by curiosity, passion, and the purpose of advancing disciplinary understanding and/or addressing societal needs. It is a means to higher ends.

Test it: Write up a research note for your next article. Then ask ChatGPT to do the same, providing it some context.

Is plausible word patterns limited by underlying data, app design, market forces; also limited by user knowledge, skills, ethics.

Ask this: Does AI just wow me with “smart” ideas or reflects my field’s & society’s needs? Am I contributing new knowledge to my discipline or solution for society—or am I just producing something that sounds scholarly but fools my readers & society?

Evidence & Method

Reports findings from new data, using rigorous methods, and transparent documentation of process; research is designed upon scholarly context/ tradition; theory/perspective is applied or derived methodically.

Test it: Read the lit review and methodology of an article you wrote. Then use Elicit to write that lit review and ask Claude to draft that methodology (with some prompts).

AI generated content has no access to real world data; it is not based on transparent method (AI is “black box” by definition).

Ask this: What role did disciplinary conventions of data gathering and analysis play in my writing compared to those of the AI tools? Can I use AI generated content as “findings”? What databases does this AI tool have access to? How does AI define reality/ontology, knowledge/epistemology, and methodology? How does AI affect my rigor, transparency?

Novelty of thought & Interpretation

Involves original synthesis and advances new ideas, through cultural and value-based reasoning, and intuitive/human insight; process rewires brain.

Test it: Feed some data from your research to Gemini, asking it to interpret and discuss it. Compare with your writing.

Mimics logical patterns; can short circuit user reasoning, nuance, agency; can’t do human-like “abductive” reasoning.

Ask this: What conceptual nuance, contextual meaning, or cultural grounding of my writing does AI miss? Is my AI use making me mechanical, shallow, unoriginal, and less and less capable of “hard” thinking?

Intellectual Integrity & Social Responsibility

Demands citation, transparency; is accountable to peers and publics; shows contextual sensitivity, cultural awareness.

Test it: Ask DeepSeek to write a citation-involved paragraph.

No credit to source; no ethical stance or accountability for error or harm; no regard for privacy, intellectual property; no concern for society, profession.

Ask this: Are AI’s citations real, reliable, relevant? Who do I credit for the intellectual property? Sources? AI? Myself? Who is responsible for any adverse impacts? Can I fully reveal to my colleagues, my children, and other stakeholders how I used AI in this work?

Public Impact & Scholar Identity

Aims to advance knowledge, empower people, or improve society. Researcher/scholar builds a scholarly voice, identity, respect.

Test it: Summarize a recent publication of yours for a community group. Then ask CoPilot to do it. Which version sounds like you?

Detached from community, consequence, or purpose. Produces content, not contribution–short circuits learning.

Ask this: Does this content express my scholarly voice and identity in society? Does it help me grow as a scholar? How would publishing AI content affect my recognition in my discipline and society?

Dr. Shyam Sharma State University of New York at Stony Brook