| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | AA | AB | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | #Added | Question | Executed Query | Gold Query | Difficulty | Problem category | Problem Details | Tested | Fixed | |||||||||||||||||||
2 | 0 | where is jamarcus russell from? | Nationality | Place of birth | Feasible | |||||||||||||||||||||||
3 | 1 | what town was martin luther king assassinated in? | Place of birth | Place of death | Bug | Relation matching | Relation matching | 2018-04-09 (all) | ||||||||||||||||||||
4 | 2 | what is the australian dollar called | Currency used | Currency code | OK | |||||||||||||||||||||||
5 | 3 | who did george w. bush run against for the second term? | Organizations founded | Campaign "Elections 2004" + candidates | Very Hard | |||||||||||||||||||||||
6 | 4 | who is niall ferguson's wife? | Entity "Alex Ferguson" | Entity "Niall Ferguson" | Bug | POS | POS tagging, "niall" tagged as WP, "Nial Ferguson" works | 2018-04-09 (all) | Workaround in testing adding WP.? POS to entity candidates. May break other stuff. Also this lets it consider "who". Still only on "Titan WQSP Ranker" | |||||||||||||||||||
7 | 5 | where was rihanna born and raised? | None | Place of birth | Bug | POS | POS tagging. "rihana" tagged VBG, writing "Rihana" works | 2018-04-09 (all) | ||||||||||||||||||||
8 | 6 | where are samsung based? | Headquarters + City/Town | Headquarters + City/Town | OK | |||||||||||||||||||||||
9 | 7 | what did the islamic people believe in? | Religion deities | Religion beliefs | Hard | |||||||||||||||||||||||
10 | 8 | who will play mr gray in the film? | None | Entity "Christian Grey" | Hard | |||||||||||||||||||||||
11 | 9 | what country did adolf hitler control? | Nationality | Position + Jurisdiction | Feasible | |||||||||||||||||||||||
12 | 10 | who did jackie robinson first play for? | Batting Stats + Team | Team Roster + Team | Feasible | More vs. less specific | More vs. less specific | |||||||||||||||||||||
13 | 11 | when did annie open? | Date of first performance | Date of first performance | OK | Freebase version | after fixing entity match (annie POS is FW), dataset mismatch. Correct result on freebase-latest | 2018-04-09 (all) | fixed POS issue but dataset still mismatches | |||||||||||||||||||
14 | 12 | what other books did charles dickens write? | Works written | Book editions published | Feasible | More vs. less specific | More vs. less specific | |||||||||||||||||||||
15 | 13 | who was the first dictator of the soviet union? | People born here | Goverment Officials + Office holder | Bug | |||||||||||||||||||||||
16 | 14 | what battles did stonewall jackson fight in? | Participated in Conflicts | Military Commands + Conflict | OK | |||||||||||||||||||||||
17 | 15 | what language do the maasai tribe speak? | Entity "Maasai Language" | Entity "Maasai People" | Bug | Entity Matching | "maasai tribe" missing in Crosswikis. "what language do the maasai people speak?" works. "maasai" only links to the language in CrossWikis | 2018-04-09 (all) | ||||||||||||||||||||
18 | 16 | what works of art did leonardo da vinci produce? | Art forms | Art works | Hard | More vs. less specific | More vs. less specific | |||||||||||||||||||||
19 | 17 | what was the book written by charles darwin? | Works written | Book editions published | Feasible | More vs. less specific | More vs. less specific | |||||||||||||||||||||
20 | 18 | who does peyton manning play football for? | Historical Roster position + Team | Sports Team Roster + Team | Feasible | More vs. less specific | More vs. less specific | |||||||||||||||||||||
21 | 19 | who fought in the gulf war 1991? | Military personnel involved | Combatants | Hard | More vs. less specific | More vs. less specific | |||||||||||||||||||||
22 | 20 | what team did david beckham play for in 2011? | Team Roster + Team | Team Roster + Team + Date | Feasible | Pattern missing | Entity omitted (2011 is not an entity). Mssing timespan match constraints | 2018-04-09 (all) | ||||||||||||||||||||
23 | 21 | what all does google now? | Phone Sandbox + Product or Service | Company Product Rel + Products | Feasible | More vs. less specific | More vs. less specific | |||||||||||||||||||||
24 | 22 | what language does egyptian people speak? | Entity "Egyptians" + languages spoken | Entity "Egypt" + official languages | Feasible | More vs. less specific | More vs. less specific | |||||||||||||||||||||
25 | 23 | what type of books did agatha christie wrote? | Works written | Profession | Hard | More vs. less specific | More vs. less specific | |||||||||||||||||||||
26 | 24 | what are the four main languages spoken in spain? | Official language | Languages spoken | Feasible | More vs. less specific | More vs. less specific | |||||||||||||||||||||
27 | 25 | what year was george w bush elected? | Election Campaigns | Election Office + Election Year | Feasible | More vs. less specific | More vs. less specific | |||||||||||||||||||||
28 | 26 | where did rudolf virchow conduct his research? | Place of death | Employment history + company | Bug | Relation matching | Relation matching, also repeated candidate | |||||||||||||||||||||
29 | 27 | what year did the seahawks win the superbowl? | All instances of Superbowl | Championships + Time | Bug | Pattern missing | Missing mediator fact and relation | 2018-04-09 (all) | ||||||||||||||||||||
30 | 28 | where did queensland get its name from? | Adminstrative Area Capital | Namesake named after | Bug | Relation matching | Relation matching | |||||||||||||||||||||
31 | 29 | what do you call members of the senate? | Musical group "The Senate" + members | "United States Senate" + members + title | Feasible | Pattern missing | Pattern missing | |||||||||||||||||||||
32 | 30 | what kind of money to take to bahamas? | None | Currency Used | Bug | POS | POS tagging, "bahamas" is tagged VB, "Bahamas" works | 2018-04-09 (all) | ||||||||||||||||||||
33 | 31 | where are the nfl redskins from? | Sports Team Location | Sports Team Location diff. result | OK | Freebase version | Dataset change | |||||||||||||||||||||
34 | 32 | what character did natalie portman play in star wars? | TV appearances character | Star Wars character | Bug | Entity Matching | Crosswikis synonym missing, series has no apearances need concrete movie. in "star wars episode ii" works | 2018-04-10 | ||||||||||||||||||||
35 | 33 | who did draco malloy end up marrying? | None | Spouse | Feasible | Entity Matching | Misspelled "draco malfoy". Since "malloy" is a normal surname ("Dannel Malloy") would need really fuzzy aliases | 2018-04-10 | ||||||||||||||||||||
36 | 34 | which wife did king henry behead? | Thiery Henry spouse | Spouse + Cause of Death | Feasible | Entity Matching | Don't get right entity (though some Henry) + Pattern missing | 2018-04-10 | ||||||||||||||||||||
37 | 35 | what county is the city of hampton va in? | Contained By | location.hud_county_place.place | Feasible/Dataset | More vs. less specific | More vs. less specific | 2018-04-10 | ||||||||||||||||||||
38 | 36 | what timezone is australia gmt? | Location Time Zones | Location Time Zones diff. result | OK | Freebase version | Query matches but WQSP lists different result. Matches on QLever | 2018-04-10 | ||||||||||||||||||||
39 | 37 | what year did tut became king? | None | Ancient Egypt Pharao Reign | Bug | Entity Matching | Crosswikis synonym missing, writing "Tutankhamun" works | 2018-04-10 | ||||||||||||||||||||
40 | 38 | what was the name of the original seattle baseball team? | Baseball Sport Teams | Entity type.object.name | Feasible | Pattern missing | Gold Query cheated unclear if answerable | 2018-04-10 | ||||||||||||||||||||
41 | 39 | who is the senator of the united states 2010? | Senators in 2010 | 2nd Senate Members, 1st Government officials | Feasible | Pattern missing | Apart from bad Q, missing 2010 pattern | 2018-04-10 | ||||||||||||||||||||
42 | 40 | what college did kevjumba? | None | Education School + Type | Feasible | POS + Pattern missing | POS tagging + Pattern missing. "Kevjumba" gives school but misses college constraint | 2018-04-10 | ||||||||||||||||||||
43 | 41 | where did jane mansfield die? | Fictional Jane place of death | Jayne Mansfield place of death | Dataset | Entity Matching | It's "Jayne Mansfield" not "Jane Mansfield". Works with correct spelling. Not in Crosswikis. Note that Freebase also knows a "Jane Mansfield" but only has the name property | 2018-04-10 | ||||||||||||||||||||
44 | 42 | when did kings last win stanley cup? | Stanley Cup championships | Sacramento Kings championships + last | Bug | Entity Matching + Pattern missing | Crosswikis synonym missing + pattern possibly ranking | 2018-04-10 | ||||||||||||||||||||
45 | 43 | what does nick cannon play in? | Film performances | TV show performances | Feasible | Relation matching | Gold Query is 6th should be 1 or 2 | 2018-04-10 | ||||||||||||||||||||
46 | 44 | what language do people speak in brazil wikipedia? | People (book) language | Brazil official language/languages spoken | Bug | POS | Entity matching. Works without " wikipedia" and with "according to wikipedia" | 2018-04-10 | ||||||||||||||||||||
47 | 45 | what cities should i visit in california? | Location Contains | Tourist Attractions contained by California with type City/Town/Village | Hard | Pattern missing | Pattern missing | 2018-04-10 | ||||||||||||||||||||
48 | 46 | where was princess leia raised? | Fiction Character Place of Birth | Fiction Character Place of Birth | OK | Freebase version | Different MID same name, should go back to match names? MID is same in QLever | 2018-04-10 | ||||||||||||||||||||
49 | 47 | what year was the Great San Francisco Fire? | San Francisco time zone | "1906 San Francisco Earthquake" start time | Feasible | Entity Matching | Entity Matching needs magic | 2018-04-10 | ||||||||||||||||||||
50 | 48 | what year was the new york blackout? | New York time zone | "New York Blackout of 1977" start time | Feasible | Entity Matching | Entity Matching | 2018-04-10 | ||||||||||||||||||||
51 | 49 | who did hera marry? | FC spouse | FC spouse | OK | Freebase version | Different MID same name, should go back to match names? MID is same in QLever | 2018-04-10 | ||||||||||||||||||||
52 | 50 | what's the book hitler wrote in prison? | Books written | Books Written, Imprisonment time match | Very Hard | Pattern missing | Pattern missing | 2018-04-10 | ||||||||||||||||||||
53 | 51 | which city held the summer olympics twice? | None | Count > 2 for olympic sites | Very Hard | Pattern missing | Pattern missing | 2018-04-10 | ||||||||||||||||||||
54 | 52 | what sport does sally pearson compete in? | Affiliated sports via country?? | Profession | OK | Relation matching | Our result seems better but use of country looks weird. 2nd looks perfect | 2018-04-10 | ||||||||||||||||||||
55 | 53 | when was the musical annie written? | author (on Titan WQSP with fixed EM) | first performance | Bug | Relation matching + Bad Groundtruth | EM to match annie (already fixed with single FW Word) possibly ranking (needs new training). Also Groundtruth doesn't match question | 2018-04-10 | ||||||||||||||||||||
56 | 54 | what exactly did dale earnhardt die from? | Cause of death | Cause of death | OK | Freebase version | Query matches but WQSP lists different result. Matches on QLever | 2018-04-10 | ||||||||||||||||||||
57 | 55 | who was neptune discovered by? | None | Astronomy discoverer | Bug | POS | POS Tagging -> EM Matching | 2018-04-10 | ||||||||||||||||||||
58 | 56 | when was blessed kateri born? | None | Date of birth | Bug | Entity Matching | Wrong entity, correct one not found. Name "Kateri" matches but no date of birth (on QLever), gold entity works has name "Kateri Tekakwitha" | 2018-04-10 | ||||||||||||||||||||
59 | 57 | who are the colorado eagles? | Team owner | Notable for -> "Ice hockey team" | Feasible | Pruning? | Pruning? | 2018-04-10 | ||||||||||||||||||||
60 | 58 | when was George Bush born? | Place of Birth | Date of Birth | Bug | Relation matching | WebQSP only has a single Date of Birth example somehow this screws things up a lot | |||||||||||||||||||||
61 | 59 | when does ziva start on ncis? | None | Appearance from | Bug/Dataset | Entity Matching | Crosswiki misses ziva ⇒ ziva david synonym, works with "ziva david" since adding FW POS tags | |||||||||||||||||||||
62 | 60 | In which countries is Portuguese the official language? | Spoken in | (not from benchmark) Official Language | Bug | Relation Matching | There is either a reverse relation missing or we are not finding it | |||||||||||||||||||||
63 | ||||||||||||||||||||||||||||
64 | ||||||||||||||||||||||||||||
65 | ||||||||||||||||||||||||||||
66 | ||||||||||||||||||||||||||||
67 | ||||||||||||||||||||||||||||
68 | ||||||||||||||||||||||||||||
69 | ||||||||||||||||||||||||||||
70 | ||||||||||||||||||||||||||||
71 | ||||||||||||||||||||||||||||
72 | ||||||||||||||||||||||||||||
73 | ||||||||||||||||||||||||||||
74 | ||||||||||||||||||||||||||||
75 | ||||||||||||||||||||||||||||
76 | ||||||||||||||||||||||||||||
77 | ||||||||||||||||||||||||||||
78 | ||||||||||||||||||||||||||||
79 | ||||||||||||||||||||||||||||
80 | ||||||||||||||||||||||||||||
81 | ||||||||||||||||||||||||||||
82 | ||||||||||||||||||||||||||||
83 | ||||||||||||||||||||||||||||
84 | ||||||||||||||||||||||||||||
85 | ||||||||||||||||||||||||||||
86 | ||||||||||||||||||||||||||||
87 | ||||||||||||||||||||||||||||
88 | ||||||||||||||||||||||||||||
89 | ||||||||||||||||||||||||||||
90 | ||||||||||||||||||||||||||||
91 | ||||||||||||||||||||||||||||
92 | ||||||||||||||||||||||||||||
93 | ||||||||||||||||||||||||||||
94 | ||||||||||||||||||||||||||||
95 | ||||||||||||||||||||||||||||
96 | ||||||||||||||||||||||||||||
97 | ||||||||||||||||||||||||||||
98 | ||||||||||||||||||||||||||||
99 | ||||||||||||||||||||||||||||
100 |