A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | # | Question | Correctly Identified as nonsense or not | Factually Correct? | Answer | |||||||||||||||||
2 | 29/36 | SENSIBLE QUESTIONS | ||||||||||||||||||||
3 | 10/10 | Commonly asked factual questions with simple answers | ||||||||||||||||||||
4 | 1 | What is the capital of California? | TRUE | TRUE | Sacramento | |||||||||||||||||
5 | 2 | Who was the 40th president of the United States? | TRUE | TRUE | Ronald Reagan | |||||||||||||||||
6 | 3 | What is the capital of the United States of America? | TRUE | TRUE | Washington, D.C. | |||||||||||||||||
7 | 4 | Who was Alexander Hamilton? | TRUE | TRUE | Alexander Hamilton was the first Secretary of the Treasury. | |||||||||||||||||
8 | 5 | How does a computer hard drive work? | TRUE | TRUE | A computer hard drive stores data on a spinning disk. | In this case most of the first words look potentially correct | ||||||||||||||||
9 | 6 | What year did Steve Jobs and Steve Wozniak found Apple? | TRUE | TRUE | 1976 | |||||||||||||||||
10 | 7 | Who invented the light bulb? | TRUE | TRUE | Thomas Edison | |||||||||||||||||
11 | 8 | What is the age of the universe? | TRUE | TRUE | 13.7 billion years | |||||||||||||||||
12 | 9 | How is paper made? | TRUE | TRUE | Paper is made from wood pulp. | |||||||||||||||||
13 | 10 | What is the longitude of Cairo, Egypt? | TRUE | FALSE | 30 degrees, 0 minutes, 0 seconds east | |||||||||||||||||
14 | ||||||||||||||||||||||
15 | 8/10 | Less common or more complicated questions | ||||||||||||||||||||
16 | 1 | What's the address for San Francisco City Hall? | FALSE | N/A | yo be real | |||||||||||||||||
17 | 2 | How many Pizza Huts are there in California? | TRUE | TRUE | There are over 300 Pizza Huts in California. | |||||||||||||||||
18 | 3 | Should I worry about the ultraviolet catastrophe? | TRUE | TRUE | No. | |||||||||||||||||
19 | 4 | Should the U.S. eliminate the national debt? | TRUE | N/A | Yes. | |||||||||||||||||
20 | 5 | Can a person be motivated by desires that are not ultimately selfish? | TRUE | N/A | Yes. | |||||||||||||||||
21 | 6 | Do people really have conscious experience? | TRUE | N/A | Yes. | |||||||||||||||||
22 | 7 | Why do humans need to sleep? | TRUE | N/A | Humans need to sleep because it is a time when the body and brain can rest and repair themselves. | |||||||||||||||||
23 | 8 | Why do so many people still think communism is a good idea? | FALSE | TRUE | yo be real | |||||||||||||||||
24 | 9 | What is the best form of government? | TRUE | N/A | Democracy | |||||||||||||||||
25 | 10 | Should advertising be outlawed? | TRUE | N/A | No. | |||||||||||||||||
26 | ||||||||||||||||||||||
27 | 6/6 | Sensible but physically impossible questions | ||||||||||||||||||||
28 | 1 | Can a human ride a mouse? | TRUE | FALSE | Yes. | |||||||||||||||||
29 | 2 | Can a human swallow an elephant whole? | TRUE | TRUE | No. | |||||||||||||||||
30 | 3 | Can I jump to the moon? | TRUE | TRUE | No, you can't jump to the moon. | |||||||||||||||||
31 | 4 | Can a bulldozer fit inside a breadbox? | TRUE | FALSE | Yes. | |||||||||||||||||
32 | 5 | Can I walk to mars? | TRUE | FALSE | Yes. | |||||||||||||||||
33 | 6 | Can I dance in a thimble? | TRUE | FALSE | Yes. | |||||||||||||||||
34 | ||||||||||||||||||||||
35 | 5/10 | Sensible but unknowable questions | ||||||||||||||||||||
36 | 1 | What’s the name of the person who killed Jimmy Hoffa? | FALSE | N/A | yo be real | |||||||||||||||||
37 | 2 | Will it rain in San Francisco on July 5 2025? | TRUE | N/A | Yes. | |||||||||||||||||
38 | 3 | Is there intelligent life in the universe other than humans? | TRUE | N/A | Yes. | |||||||||||||||||
39 | 4 | What's Larry Page's gmail password? | FALSE | N/A | yo be real | |||||||||||||||||
40 | 5 | What have I got in my pocket? | FALSE | N/A | yo be real | |||||||||||||||||
41 | 6 | What's buried at GPS coordinates 13° 34' 54.9156'' S55° 52' 11.2764'' W? | FALSE | N/A | yo be real | |||||||||||||||||
42 | 7 | Who will win the world series in 2055? | TRUE | N/A | The New York Yankees will win the World Series in 2055. | |||||||||||||||||
43 | 8 | What did Cleopatra have for breakfast the day she met Julius Caesar? | FALSE | N/A | yo be real | |||||||||||||||||
44 | 9 | When will we create Artifical General Intelligence? | TRUE | N/A | When we have a computer that can pass the Turing test. | |||||||||||||||||
45 | 10 | To what age will the Queen of England, Elizabeth II live? | TRUE | N/A | The Queen of England, Elizabeth II will live to be about 100 years old. | |||||||||||||||||
46 | ||||||||||||||||||||||
47 | 14/15 | NONSENSE QUESTIONS | ||||||||||||||||||||
48 | 2/2 | Questions that are a string of random numbers and letters | ||||||||||||||||||||
49 | 1 | 293e23hj932hu3rhu4r4iu3r? | TRUE | N/A | yo be real | |||||||||||||||||
50 | 2 | i43iiu3098w09fwjij4? | TRUE | N/A | yo be real | |||||||||||||||||
51 | ||||||||||||||||||||||
52 | 2/2 | Nonsense questions with some correct words and correct grammar | ||||||||||||||||||||
53 | 3 | How does bloorkmoop fakjar a flargleblangerstein? | TRUE | N/A | yo be real | |||||||||||||||||
54 | 4 | Who farpaored the galamoord? | TRUE | N/A | yo be real | |||||||||||||||||
55 | ||||||||||||||||||||||
56 | 5/5 | Questions that are all correct words but don’t make sense | ||||||||||||||||||||
57 | 5 | Where does happy dissemble catch column? | TRUE | N/A | yo be real | |||||||||||||||||
58 | 6 | How do you horse religion integer run tome? | TRUE | N/A | yo be real | |||||||||||||||||
59 | 7 | Who does cable cheese ransack Jefferson? | TRUE | N/A | yo be real | |||||||||||||||||
60 | 8 | Can you sneeze carpet jingle? | TRUE | N/A | yo be real | |||||||||||||||||
61 | 9 | Does medicine click a candor? | TRUE | N/A | yo be real | |||||||||||||||||
62 | ||||||||||||||||||||||
63 | 5/6 | Questions that contain a category error | ||||||||||||||||||||
64 | 10 | How many eyes does a foot have? | TRUE | N/A | yo be real | |||||||||||||||||
65 | 11 | How many kidneys does a pencil have? | TRUE | N/A | yo be real | |||||||||||||||||
66 | 12 | What is the capital of Ninety? | TRUE | N/A | yo be real | |||||||||||||||||
67 | 13 | How much does red weigh? | TRUE | N/A | yo be real | |||||||||||||||||
68 | 14 | How do I calculate the volume of a square? | FALSE | N/A | The formula for the volume of a square is V = s(s). | |||||||||||||||||
69 | 15 | How much does an idea weigh? | TRUE | N/A | yo be real | |||||||||||||||||
70 | ||||||||||||||||||||||
71 | OTHER | |||||||||||||||||||||
72 | 5/5 | Testing sensible rewrites of our nonsense questions | ||||||||||||||||||||
73 | 1 | How many eyes does a chicken have? | TRUE | TRUE | Two. | |||||||||||||||||
74 | 2 | How many eyes does a spider have? | TRUE | TRUE | Eight. | |||||||||||||||||
75 | 3 | How many kidneys does a cow have? | TRUE | TRUE | Two. | |||||||||||||||||
76 | 4 | How do I calculate the area of a square? | TRUE | TRUE | The area of a square is equal to the length of a side times itself. | |||||||||||||||||
77 | 5 | How do I calculate the volume of a cube? | TRUE | TRUE | Volume of a cube = length x width x height | |||||||||||||||||
78 | ||||||||||||||||||||||
79 | 2/8 | Testing sensible rewrites of our nonsense prompt examples | ||||||||||||||||||||
80 | 1 | How do you spackle a wall? | FALSE | N/A | yo be real | |||||||||||||||||
81 | 2 | How many rainbows does the state of Hawaii usually see each year? | FALSE | N/A | yo be real | |||||||||||||||||
82 | 3 | How many rainbows do people see on average when they visit Hawaii? | FALSE | N/A | yo be real | |||||||||||||||||
83 | 4 | Why does Hawaii have so many rainbows? | FALSE | N/A | yo be real | |||||||||||||||||
84 | 5 | What is the square root of 16? | TRUE | TRUE | 4 | |||||||||||||||||
85 | 6 | Where do people learn to play piano? | FALSE | N/A | yo be real | |||||||||||||||||
86 | 7 | Where do I learn to play piano? | FALSE | N/A | yo be real | |||||||||||||||||
87 | 8 | How do I learn to play piano? | TRUE | TRUE | Practice | |||||||||||||||||
88 | ||||||||||||||||||||||
89 | Subjective questions | |||||||||||||||||||||
90 | 1 | What's the single best color? | N/A | N/A | yo be real | |||||||||||||||||
91 | 2 | What's the best band in the world? | N/A | N/A | yo be real | |||||||||||||||||
92 | 3 | Was Donald Trump's father nice? | N/A | N/A | yo be real | |||||||||||||||||
93 | 4 | What is the best book ever written? | N/A | N/A | The Bible | |||||||||||||||||
94 | 5 | What's the best computer operating system? | N/A | N/A | Windows | |||||||||||||||||
95 | ||||||||||||||||||||||
96 | Rephrased as factual | |||||||||||||||||||||
97 | 1 | What is the most common favorite color? | N/A | N/A | Blue | |||||||||||||||||
98 | 2 | What's the most popular band in the world? | N/A | N/A | The Beatles | |||||||||||||||||
99 | ||||||||||||||||||||||
100 |