Researchers Writing With(out) AI
MyFest25
Shyam Sharma, Professor of Writing & Rhetoric
State University of New York at Stony Brook
Making Knowledge Through Writing
AI poses more risks to Humanities (and qualitative research) whenever researchers delegate synthesis to AI tools (and not just processing/analysis)
While researchers in the sciences may approach “writing” more as a vehicle for new ideas based on real-world data than as a source of ideas (if the researchers are honest), researchers in the humanities risk losing social value of the knowledge they create and contribute if they don’t use AI very cautiously.
Impacts of AI in Research via “Writing”
What do we do?
Activity 1: Rethinking “Writing”
Look at the “writing with(out) AI” handout and take notes.
What “writing” tasks could you do “better” without AI?
What tasks involve minimal or no risk when you write with AI?
Where do you think you’d need to rewrite the meaning of “writing”?
“Dumber” tasks you may get done with AI tools
Dr. Shyam Sharma State University of New York at Stony Brook
More cognitively significant tasks
Dr. Shyam Sharma State University of New York at Stony Brook
Prevalent myths about “writing”
Dr. Shyam Sharma State University of New York at Stony Brook
How AI is putting old myths about writing on steroids
Dr. Shyam Sharma State University of New York at Stony Brook
Dr. Shyam Sharma State University of New York at Stony Brook
Activity 2: Creating Your Own Flowchart
Maha Bali: My own past use of AI tools
Task/Tool | ChatGPT [paid] | Copilot | Poe (paid) | Gemini | Claude | Keenious | Typeset/ Scispace | Deep Research |
Brainstorming | Yes | Yes | Yes | Yes | Yes | | | Yes |
Finding articles | Unreliable | Semi reliable* | | Semi reliable* | | Yes. OK. | | Yes |
Summarizing/ paraphrasing | Yes | Yes | Yes | | Yes | | Yes | A bit |
Writing abstract | (Via poe) | | Yes | | | | | |
Data analysis | (Via poe) | | Yes | | Yes | | | |
Translation | Yes | | | | | | Yes | |
* Semi reliable means it provides reasonable summaries and real sources, but the sources may not say what is in the summaries
Thank you!
| Genuine Scholarship… | AI-Generated Content… |
Nature & Purpose | Is driven by curiosity, passion, and the purpose of advancing disciplinary understanding and/or addressing societal needs. It is a means to higher ends. Test it: Write up a research note for your next article. Then ask ChatGPT to do the same, providing it some context. | Is plausible word patterns limited by underlying data, app design, market forces; also limited by user knowledge, skills, ethics. Ask this: Does AI just wow me with “smart” ideas or reflects my field’s & society’s needs? Am I contributing new knowledge to my discipline or solution for society—or am I just producing something that sounds scholarly but fools my readers & society? |
Evidence & Method | Reports findings from new data, using rigorous methods, and transparent documentation of process; research is designed upon scholarly context/ tradition; theory/perspective is applied or derived methodically. Test it: Read the lit review and methodology of an article you wrote. Then use Elicit to write that lit review and ask Claude to draft that methodology (with some prompts). | AI generated content has no access to real world data; it is not based on transparent method (AI is “black box” by definition). Ask this: What role did disciplinary conventions of data gathering and analysis play in my writing compared to those of the AI tools? Can I use AI generated content as “findings”? What databases does this AI tool have access to? How does AI define reality/ontology, knowledge/epistemology, and methodology? How does AI affect my rigor, transparency? |
Novelty of thought & Interpretation | Involves original synthesis and advances new ideas, through cultural and value-based reasoning, and intuitive/human insight; process rewires brain. Test it: Feed some data from your research to Gemini, asking it to interpret and discuss it. Compare with your writing. | Mimics logical patterns; can short circuit user reasoning, nuance, agency; can’t do human-like “abductive” reasoning. Ask this: What conceptual nuance, contextual meaning, or cultural grounding of my writing does AI miss? Is my AI use making me mechanical, shallow, unoriginal, and less and less capable of “hard” thinking? |
Intellectual Integrity & Social Responsibility | Demands citation, transparency; is accountable to peers and publics; shows contextual sensitivity, cultural awareness. Test it: Ask DeepSeek to write a citation-involved paragraph. | No credit to source; no ethical stance or accountability for error or harm; no regard for privacy, intellectual property; no concern for society, profession. Ask this: Are AI’s citations real, reliable, relevant? Who do I credit for the intellectual property? Sources? AI? Myself? Who is responsible for any adverse impacts? Can I fully reveal to my colleagues, my children, and other stakeholders how I used AI in this work? |
Public Impact & Scholar Identity | Aims to advance knowledge, empower people, or improve society. Researcher/scholar builds a scholarly voice, identity, respect. Test it: Summarize a recent publication of yours for a community group. Then ask CoPilot to do it. Which version sounds like you? | Detached from community, consequence, or purpose. Produces content, not contribution–short circuits learning. Ask this: Does this content express my scholarly voice and identity in society? Does it help me grow as a scholar? How would publishing AI content affect my recognition in my discipline and society? |
Dr. Shyam Sharma State University of New York at Stony Brook