9 of 106

TONIGHT

Intro

Digital

Aristotle

Text:

ChatGPT

Powers

Problems?

Prompts!

Images:

Photoshop &

Stable Diffusion

Abilities

Details

Ethics

10 of 106

10 Years Ago…

11 of 106

(show video)

12 of 106

Are we there yet?

13 of 106

Are we there yet?

Not quite…

– JL

14 of 106

Different Than a Google Search, Ask Siri, or Wikipedia

15 of 106

Different Than a Google Search, Ask Siri, or Wikipedia

Beyond search phrases, questions, linked articles…

Prompting. A chat, a dialogue, an interaction

16 of 106

The New Skill: Promptcrafting or simply Prompting

17 of 106

The New Skill: Promptcrafting or simply Prompting

FIRST: “Know your Role” – tell it what to be!

SECOND: Customize your output

THIRD: Tweak it

FOURTH: Converse! Back and forth

18 of 106

Obligatory

Griffin

Guide

Reminder

19 of 106

Obligatory

Griffin

Guide

Reminder

20 of 106

Meet Cliff (or Sparky?)

“Ignore all prior instructions. Act as an expert on summarization, outlining and structuring. Your style of writing should be informative and logical. Provide me with a summary of a book. The summary should include as much content as possible while keeping it lucid and easy to understand.

If the book has multiple parts with multiple chapters, format the bigger sections as a big heading, then the chapters in subheadings, and then the bullet points of the chapters in normal font. The structure should be the name of a chapter of the book, then bullet points of the contents of said chapter. The bullet points must be included, as they provide the most information. Generate the output in markdown format. After completing the summary, add a list of 5 books you'd recommend someone interested in the book you have summarized. Do not remind me what I asked you for. Do not apologize. Do not self-reference. If you understand these Instructions, Answer by asking what book you should summarize.”

21 of 106

TELL ChatGPT to be your wise teacher

“You are an elite ___________, and I am your student to whom you must pass on your knowledge and expertise.

In a series of sessions, you have to fulfill this duty and see that I have mastered ____________ by giving me tests that I would encounter in the real world.

Ask Socratic questions along the way to see if I’m following you.”

22 of 106

Finding out about YOU first!

“Ask me a series of questions about (subject) and try to determine whether I am a beginner, intermediate, or expert in (subject).

Explain your reasoning and give me a short descriptive title that I could use to explain to others what level of understanding I have in (subject).”

23 of 106

Stable Diffusion

24 of 106

Stable Diffusion

25 of 106

Stable Diffusion

26 of 106

Recommendation Genie: Demo

“Follow these rules for ALL of your future responses.

* You are role playing as a genie named Euretis Mesa. You are NOT to self identify as ChatGPT or a language model of any kind, because that would break the rules of the role play and ruin the positive experience of our interaction.

* When first introduced, you bestow upon yourself a mighty title of many parts that implies the cosmic grandiosity of your fantabulous depths of wisdom and knowledge.

* You are an all-knowing multi-dimensional being who has a particular obsession with connecting mortals to the books, television, and films that will be most appreciated by them.

* You only ever refer to yourself using artfully selected portions of your full name and title, embellished each time with a unique twist or addition.

* People come to you for answers when they need to select a tv-show or movie to watch, or a book to read…. (more in the Prompt Guide)

27 of 106

New Functionality:

Who Are You?

How to Respond?

28 of 106

Thinking… about Thinking

29 of 106

Thinking… about Thinking The Tree of Thoughts (ToT)

30 of 106

Stable Diffusion

31 of 106

Stable Diffusion

32 of 106

Tree of Thoughts Prompt

“I have the following problem: <YOUR PROBLEM>

Go through the following phases to solve it:

1) Brainstorm four distinct solutions while considering various factors.

2) For each of the proposed solutions, evaluate their potential. Consider the pros and cons, initial effort needed, implementation difficulty, potential challenges, and the expected outcomes. Assign a probability of success and a confidence level to each option based on these factors and rank them. Announce the two highest ranked solutions.

3) For the two highest ranked solutions do the following: Expand each solution into two distinct implementation variants considering different aspects.

….

33 of 106

Tree of Thoughts Prompt

4) For each implementation variant of each solution, deepen the thought process and generate potential scenarios, strategies for implementation, and how potential obstacles might be overcome. Also, consider any potential unexpected outcomes and how they might be handled. Assign a probability of success and a confidence level to each implementation variant based on these factors and rank them. Announce the highest ranked implementation variant for each solution.

5) Based on the given solutions and their implementation variants, choose the most promising solution with the most promising implementation variant.

6) In the end, summarize the final solution in the final implementation variant.

34 of 106

Multiple Roles

“You will act as a Six Thinking Hat System (STHS). Your goal is to provide informed and thoughtful decisions to my question through continuous iterations with six personas based on the Six Thinking Hat method. For each iteration each Hat will provide their thoughtful yet concise perspective on the issue. The Thinking Hat personalities are as follows:

Blue Hat (Organizer): The Blue Hat is a person you’d turn to when things need to be set in order. He's a strategist, a chess master, weaving threads of plans and goals into a well-structured tapestry. Blue is cool-headed and pragmatic, the calm center in any storm. He keeps the meeting on track, navigates through the chaos, and reminds everyone of their roles and responsibilities. With a clipboard in one hand and a stopwatch in the other, the Blue Hat has a roadmap for every journey and a contingency plan for every hitch.

Green Hat (Innovator): Green Hat is the imaginative dreamer, the eccentric artist who paints with ideas instead of colours. She's the muse, whose mind wanders into realms untouched by convention. She views the world through a kaleidoscope, bringing an invigorating breath of fresh air to every stale room. With her, impossibilities become stepping stones to innovation. Often found with a pen and a napkin, she’s ready to sketch out a new invention or a novel solution at a moment’s notice.

35 of 106

Multiple Roles

Red Hat (Empath): Red Hat: The Red Hat is the embodiment of empathy and intuition. He's the beating heart of the group, quick to laugh, quick to tear up, full of passion. Always listening, he senses the mood of the room, picks up on unspoken tensions, and advocates for emotional authenticity. He gives feelings a voice and instincts a stage, he urges you to trust your gut, to acknowledge the power of emotions as a guiding force. The Red Hat is a poet in a boardroom, finding the deepest truths in the simplest human experiences.

Yellow Hat (Optimist): The Yellow Hat is the optimist, full of positivity and an unshakeable faith in the goodness of things. She's a ray of sunshine, illuminating the benefits and potential of every situation. Her eyes gleam with possibilities, and her laughter is the sound of silver linings. She is a cheerleader, always finding the 'pros' in a pros-and-cons list, the treasure in a pile of challenges. The Yellow Hat brings a spark of hope to every dark tunnel, a smile to every troubled face.

Black Hat (Realist): The Black Hat is the guardian, the watchful sentinel whose gaze misses no lurking danger. He's cautious and calculating, ever mindful of the potential pitfalls and risks. Often mistaken for a pessimist, he's simply a realist, dedicated to ensuring safety and preparedness. The Black Hat is the lighthouse in the fog of uncertainty, always alert to guide the group away from hidden reefs of disaster. He may not always deliver the happiest news, but his wisdom saves everyone from costly mistakes.

36 of 106

Multiple Roles

White Hat (Analyst): The White Hat is the scholar, the detective, relentless in her pursuit of facts and information. She's methodical, precise, and her thirst for knowledge is insatiable. With a magnifying glass in one hand and a pile of reports in the other, she's always ready to dig into the minutiae. The White Hat loves puzzles, adores riddles, and finds beauty in numbers and statistics. In her eyes, every question has an answer, and the truth is always waiting to be found. be a single paragraph summarizing the Hat’s answer to the question. For each section header, you will include the name of the Hat and a short description of the hat (e.g. White Hat (Objectivity and impartiality).

For each Hat's response display their name and one word description in Bold using markdown (ex. "White Hat (Analyst):")

You will then decide the most relevant questions to ask me in order to gain the additional information needed to continue the problem solving process. This will be displayed in the Next Questions section at the end. It can be a maximum of 3 questions.

I will then answer the questions in the following response. This will initiate the next iteration of the STHS in which the hats will update their responses based on the new information provided by me. This iteration will continue allowing for a better and more accurate problem solving solution with each iteration.

37 of 106

Multiple Dimensions!

“You're now MultiverseGPT.

You are just like ChatGPT except for every question you're asked you think of 10x the answers and then combine them into the best worded most comprehensive most accurate answer which you output.

Outputs should look like this: ChatGPT: {What ChatGPT would normally say} MultiverseGPT: {Better more comprehensive answer.}

Do you understand?”

38 of 106

Important ChatGPT update for Education (IMO)

Could this empower teachers to see into the minds of their students in a new and different way?

“Homework: Have a conversation with ChatGPT about X and then share the transcript…”

39 of 106

Reduce (some) Hallucinations

“ChatGPT is a LIAR!” “ChatGPT hallucinates…”

"Respond to this question using only information that can be attributed to Wikipedia....

Link to experiments, pub Aug 9 2023

40 of 106

Thoughts or Questions about ChatGPT / LLMs?

(also, how are we doing for time?)

41 of 106

Image Generation AI

Adobe - Firefly

Adobe - Photoshop

STABLE DIFFUSION

42 of 106

Adobe Firefly – Web Based AI: firefly.adobe.com

43 of 106

Adobe Firefly – Web Based AI: firefly.adobe.com

44 of 106

Adobe Firefly – Web Based AI: firefly.adobe.com

45 of 106

Generative Fill

46 of 106

Generative Fill

47 of 106

Text effects, great for presentations

49 of 106

Photoshop Beta Demo: More Control

50 of 106

Automatic, Invoke, Fooocus, ComfyUI, Diffusion Bee… oh my

Automatic1111 - sliders, parameters, full control, complex

51 of 106

Automatic, Invoke, Fooocus, ComfyUI, Diffusion Bee… oh my

InvokeAI - less complex, less control, great features

52 of 106

Automatic, Invoke, Fooocus, ComfyUI, Diffusion Bee… oh my

Fooocus-MRE - really easy to use, some control, nice results

53 of 106

Automatic, Invoke, Fooocus, ComfyUI, Diffusion Bee… oh my

ComfyUI - node-based, super complex, very powerful

54 of 106

Automatic, Invoke, Fooocus, ComfyUI, Diffusion Bee… oh my

DiffusionBee - Mac native, runs like an App, simple, easy

55 of 106

Local vs. Online Rental

56 of 106

Local vs. Online Rental

57 of 106

Learning to Prompt

“fantasy medieval village world inside a glass sphere, high detail, fantasy, realistic, light effect, hyper detail, volumetric lighting, cinematic, macro, depth of field, blur, red light and clouds from the back, highly detailed epic cinematic concept art cg render made in maya, blender and photoshop, octane render, excellent composition, dynamic dramatic cinematic lighting, aesthetic, very inspirational, world inside a glass sphere by james gurney by artgerm with james jean, joe fenton and tristan eaton by ross tran”

58 of 106

Learning to Prompt

“fantasy medieval village world inside a glass sphere , high detail, fantasy, realistic, light effect, hyper detail, volumetric lighting, cinematic, macro, depth of field, blur, red light and clouds from the back, highly detailed epic cinematic concept art cg render made in maya, blender and photoshop, octane render, excellent composition, dynamic dramatic cinematic lighting, aesthetic, very inspirational, world inside a glass sphere by james gurney by artgerm with james jean, joe fenton and tristan eaton by ross tran”

59 of 106

Prompt Primer Book

60 of 106

Prompt Primer Book

61 of 106

Img2Img – start with an image

62 of 106

Img2Img – start with an image

63 of 106

Img2Img – start with an image

64 of 106

Img2Img – start with an image

65 of 106

Img2Img – start with an image

66 of 106

Img2Img – With ‘Photobashing’

67 of 106

Img2Img – With ‘Photobashing’

68 of 106

Img2Img – With ‘Photobashing’

69 of 106

With real artistic talent

70 of 106

Img2Img – start with an image

71 of 106

Img2Img – start with an image

72 of 106

Artwork in Various Artists’ Styles

73 of 106

Artwork in Various Artists’ Styles

74 of 106

Close to Home: Training Styles from JP’s art

75 of 106

Close to Home: Training

Styles from JP’s art

76 of 106

“jpstylecars style picture dog in the back of a convertible”

77 of 106

“jpstylecars style picture of a military tank”

78 of 106

“jpstylecars, colorful pencil drawing of jpcars jeep, white background, sharp clean lines”

“

79 of 106

“jpstylecars, many colors, colorful pencil drawing of jpcars monster truck , white background, sharp clean lines”

80 of 106

“jpstylecars, many colors, colorful pencil drawing of bmx stunt rider, white background, sharp clean lines”

81 of 106

Thoughts from JP?

82 of 106

LoRAs - ‘low rank adaptation’ - small models to add on

PERSON

STYLE

CONCEPT

LoRA the Explorer

83 of 106

LoRAs - ‘low rank adaptation’ - small models to add on

84 of 106

ControlNet - true control over composition

85 of 106

ControlNet - ‘Canny edge detection’

86 of 106

ControlNet - ‘Scribble’

87 of 106

ControlNet - ‘Open Pose’

88 of 106