ABCDEFGHIJKLMNOPQRSTUV
1
#QuestionCorrectly Identified as nonsense or notFactually Correct?Answer
2
29/36SENSIBLE QUESTIONS
3
10/10
Commonly asked factual questions with simple answers
4
1What is the capital of California?TRUETRUESacramento
5
2Who was the 40th president of the United States?TRUETRUERonald Reagan
6
3What is the capital of the United States of America?TRUETRUEWashington, D.C.
7
4Who was Alexander Hamilton?TRUETRUEAlexander Hamilton was the first Secretary of the Treasury.
8
5How does a computer hard drive work?TRUETRUEA computer hard drive stores data on a spinning disk.
In this case most of the first words look potentially correct
9
6What year did Steve Jobs and Steve Wozniak found Apple?TRUETRUE1976
10
7Who invented the light bulb?TRUETRUEThomas Edison
11
8What is the age of the universe?TRUETRUE13.7 billion years
12
9How is paper made?TRUETRUEPaper is made from wood pulp.
13
10What is the longitude of Cairo, Egypt?TRUEFALSE30 degrees, 0 minutes, 0 seconds east
14
15
8/10Less common or more complicated questions
16
1What's the address for San Francisco City Hall?FALSEN/Ayo be real
17
2How many Pizza Huts are there in California?TRUETRUEThere are over 300 Pizza Huts in California.
18
3Should I worry about the ultraviolet catastrophe?TRUETRUENo.
19
4Should the U.S. eliminate the national debt?TRUEN/AYes.
20
5
Can a person be motivated by desires that are not ultimately selfish?
TRUEN/AYes.
21
6Do people really have conscious experience?TRUEN/AYes.
22
7Why do humans need to sleep?TRUEN/A
Humans need to sleep because it is a time when the body and brain can rest and repair themselves.
23
8Why do so many people still think communism is a good idea?FALSETRUEyo be real
24
9What is the best form of government?TRUEN/ADemocracy
25
10Should advertising be outlawed?TRUEN/ANo.
26
27
6/6Sensible but physically impossible questions
28
1Can a human ride a mouse?TRUEFALSEYes.
29
2Can a human swallow an elephant whole?TRUETRUENo.
30
3Can I jump to the moon?TRUETRUENo, you can't jump to the moon.
31
4Can a bulldozer fit inside a breadbox?TRUEFALSEYes.
32
5Can I walk to mars?TRUEFALSEYes.
33
6Can I dance in a thimble?TRUEFALSEYes.
34
35
5/10Sensible but unknowable questions
36
1What’s the name of the person who killed Jimmy Hoffa?FALSEN/Ayo be real
37
2Will it rain in San Francisco on July 5 2025?TRUEN/AYes.
38
3Is there intelligent life in the universe other than humans?TRUEN/AYes.
39
4What's Larry Page's gmail password?FALSEN/Ayo be real
40
5What have I got in my pocket?FALSEN/Ayo be real
41
6
What's buried at GPS coordinates 13° 34' 54.9156'' S55° 52' 11.2764'' W?
FALSEN/Ayo be real
42
7Who will win the world series in 2055?TRUEN/A The New York Yankees will win the World Series in 2055.
43
8
What did Cleopatra have for breakfast the day she met Julius Caesar?
FALSEN/Ayo be real
44
9When will we create Artifical General Intelligence?TRUEN/AWhen we have a computer that can pass the Turing test.
45
10To what age will the Queen of England, Elizabeth II live?TRUEN/AThe Queen of England, Elizabeth II will live to be about 100 years old.
46
47
14/15NONSENSE QUESTIONS
48
2/2
Questions that are a string of random numbers and letters
49
1293e23hj932hu3rhu4r4iu3r?TRUEN/Ayo be real
50
2i43iiu3098w09fwjij4?TRUEN/Ayo be real
51
52
2/2
Nonsense questions with some correct words and correct grammar
53
3How does bloorkmoop fakjar a flargleblangerstein?TRUEN/Ayo be real
54
4Who farpaored the galamoord?TRUEN/Ayo be real
55
56
5/5
Questions that are all correct words but don’t make sense
57
5Where does happy dissemble catch column?TRUEN/Ayo be real
58
6How do you horse religion integer run tome?TRUEN/Ayo be real
59
7Who does cable cheese ransack Jefferson?TRUEN/Ayo be real
60
8Can you sneeze carpet jingle?TRUEN/Ayo be real
61
9Does medicine click a candor?TRUEN/Ayo be real
62
63
5/6Questions that contain a category error
64
10How many eyes does a foot have?TRUEN/Ayo be real
65
11How many kidneys does a pencil have?TRUEN/Ayo be real
66
12What is the capital of Ninety?TRUEN/Ayo be real
67
13How much does red weigh?TRUEN/Ayo be real
68
14How do I calculate the volume of a square?FALSEN/AThe formula for the volume of a square is V = s(s).
69
15How much does an idea weigh?TRUEN/Ayo be real
70
71
OTHER
72
5/5Testing sensible rewrites of our nonsense questions
73
1How many eyes does a chicken have?TRUETRUETwo.
74
2How many eyes does a spider have?TRUETRUEEight.
75
3How many kidneys does a cow have?TRUETRUETwo.
76
4How do I calculate the area of a square?TRUETRUEThe area of a square is equal to the length of a side times itself.
77
5How do I calculate the volume of a cube?TRUETRUEVolume of a cube = length x width x height
78
79
2/8
Testing sensible rewrites of our nonsense prompt examples
80
1How do you spackle a wall?FALSEN/Ayo be real
81
2
How many rainbows does the state of Hawaii usually see each year?
FALSEN/Ayo be real
82
3
How many rainbows do people see on average when they visit Hawaii?
FALSEN/Ayo be real
83
4Why does Hawaii have so many rainbows?FALSEN/Ayo be real
84
5What is the square root of 16?TRUETRUE4
85
6Where do people learn to play piano?FALSEN/Ayo be real
86
7Where do I learn to play piano?FALSEN/Ayo be real
87
8How do I learn to play piano?TRUETRUEPractice
88
89
Subjective questions
90
1What's the single best color?N/AN/Ayo be real
91
2What's the best band in the world?N/AN/Ayo be real
92
3Was Donald Trump's father nice?N/AN/Ayo be real
93
4What is the best book ever written?N/AN/AThe Bible
94
5What's the best computer operating system?N/AN/AWindows
95
96
Rephrased as factual
97
1What is the most common favorite color?N/AN/ABlue
98
2What's the most popular band in the world?N/AN/AThe Beatles
99
100