| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Intent | Questions | Intent detected | Entities extracted | Entities extracted correctly | Entities expected to be extracted | Comment | Precision | Recall | F-score | ||||||||||||||||
2 | Max_Activity | what was the maximal price of an activity? | yes | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | |||||||||||||||||
3 | What was the most expensive activity? | yes | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
4 | Since 2019, what has been the highest activity weight? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
5 | What was the top price for an event with a weight greater than one? | yes | 5 | 4 | 4 | a->A | 0.80 | 1.00 | 0.89 | |||||||||||||||||
6 | What was the highest price ever paid for an event with a weight greater than one? | yes | 5 | 4 | 4 | a->A | 0.80 | 1.00 | 0.89 | |||||||||||||||||
7 | What is the highest weight given to activities priced 50 or more? | yes | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
8 | Give me the maximum price for activities with a weight greater than 0.5 that were completed in 2018. | yes | 5 | 4 | 5 | a->A | 0.80 | 0.80 | 0.80 | |||||||||||||||||
9 | Max_Product | Which product is the most expensive product? | no | 2 | 1 | 2 | expensive->activity price | 0.50 | 0.50 | 0.50 | ||||||||||||||||
10 | What is the most expensive product produced by A? | no | 3 | 2 | 3 | expensive->activity price | 0.67 | 0.67 | 0.67 | |||||||||||||||||
11 | Which of B's products had the highest cost? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
12 | From the products made by B, which one had the biggest cost? | no | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
13 | Return the maximal product's cost | yes | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
14 | What is the highest possible product cost? | yes | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
15 | Customer | Provide me with list of all consumers' ages and bank accounts. | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | |||||||||||||||||
16 | Give me the information of each customer. | no | 1 | 1 | 1 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
17 | Return list of all clients organized by age | no | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
18 | Who are the clients under the age of 55? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
19 | Give me with the customer id for the bank account number 91248.0 | no | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
20 | What is Christine Dobbert's bank account number? | yes | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
21 | Provide me with Wil van der Aalst's age and bank account information. | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
22 | Give me the details (age and account number) of Wil van der Aalst | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
23 | Product | Give me the list of all of C's products that cost more than 500. | yes | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | |||||||||||||||||
24 | What is the cost and manufacturer of the MacBook Pro? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
25 | Return the A's products organized by their cost | no | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
26 | Give me the cost of all of B's products. | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
27 | Provide the list of products produced by each manufacturer | no | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
28 | Return the list of each manufacturer's products | no | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
29 | Count_Activity | How many activities have been carried since 2019? | yes | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | |||||||||||||||||
30 | What is the number of activities with price greater than 150 and weight larger than 1.5? | yes | 5 | 5 | 5 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
31 | Specify the number of order confirmations received between 1/1/2019 and 06/30/2019. | no | 4 | 3 | 3 | received->package delivery | 0.75 | 1.00 | 0.86 | |||||||||||||||||
32 | How many deliveries were completed? | yes | 1 | 1 | 1 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
33 | Provide the number of unsuccessful deliveries with price higher than 2000 | yes | 3 | 2 | 3 | wrong activity | 0.67 | 0.67 | 0.67 | |||||||||||||||||
34 | How many failed deliveries with price greater than 2000? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
35 | How many packages creation were performed with minimum weight of 5? | yes | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
36 | How many packages were created with weight of less than 5? | yes | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
37 | How frequently the items were out of stock? | no | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
38 | What is the number of times an item has been restocked? | no | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
39 | How many times has an item been restocked? | no | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
40 | Package_Affected | What packages did Wil van der Aalst receive? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | |||||||||||||||||
41 | Give me the package id resulting from order 990001 | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
42 | Specify the package identifiers that were not delivered. | no | 2 | 2 | 2 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
43 | Which packages, including a mini iPad, were delivered between January 1, 2019 and January 5, 2019? | no | 5 | 4 | 4 | a->A | 0.80 | 1.00 | 0.89 | |||||||||||||||||
44 | Since January 2019, which packages have been created that include an iPhone 8? | no | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
45 | Give the list of all packages sent to Marco Pegoraro in 2019 | yes | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
46 | Count_Item_Affected | Specify the number of items that were unavailable in the previous month of 2019. | no | 3 | 1 | 3 | 0.33 | 0.33 | 0.33 | |||||||||||||||||
47 | How many items are in the package number 880005? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
48 | What is the total number of items in delivered package number 880005? | yes | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
49 | In package number 880005, how many items are there? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
50 | In February 2019, how many items were restocked? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
51 | How many items have been refilled since 2019? | no | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
52 | In the order number 990003, how many items were placed? | yes | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
53 | Product_Affected | What are the costs of the products included in each generated package? | yes | 3 | 3 | 4 | no activity detected | 1.00 | 0.75 | 0.86 | ||||||||||||||||
54 | How much do the products included in each created package cost? | yes | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
55 | Return the list of the products included in each package shipped after February 1, 2019. | yes | 3 | 3 | 4 | no activity detected | 1.00 | 0.75 | 0.86 | |||||||||||||||||
56 | Return the delivered products, sorted by cost. | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
57 | Which products costing more than 200 was delivered to Luis Santos? | yes | 4 | 4 | 5 | costing not detected | 1.00 | 0.80 | 0.89 | |||||||||||||||||
58 | Customer_Affected | Provide the list of bank accounts for customers that made the payment for an order between March 15th and March 30th, 2019 | yes | 5 | 5 | 5 | 1.00 | 1.00 | 1.00 | |||||||||||||||||
59 | Which customers have had more than three payment reminders? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
60 | Who place the order number 990003? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
61 | To which customer the package 880005 has been delivered? | no | 4 | 4 | 4 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
62 | Which customers have purchased an iPhone 8? | yes | 2 | 2 | 3 | no activity detected | 1.00 | 0.67 | 0.80 | |||||||||||||||||
63 | Which customers have placed orders worth more than 8000? | no | 4 | 4 | 5 | worth not detected | 1.00 | 0.80 | 0.89 | |||||||||||||||||
64 | Which clients placed orders totaling more than 8000? | no | 4 | 4 | 5 | 1.00 | 0.80 | 0.89 | ||||||||||||||||||
65 | What is the customer's account number who received a payment reminder? | yes | 4 | 3 | 3 | received->package delivery | 0.75 | 1.00 | 0.86 | |||||||||||||||||
66 | The shipments between January 2019 and July 2019 were sent to which clients? | yes | 3 | 3 | 3 | 1.00 | 1.00 | 1.00 | ||||||||||||||||||
67 | ||||||||||||||||||||||||||
68 | Correct Intent: 44 | Avg= 0.952 | Avg= 0.947 | Avg= 0.947 | ||||||||||||||||||||||
69 | Incorrect Intent: 21 | InCorrect Entities= 16 | ||||||||||||||||||||||||
70 | Accuracy= 0.677 | |||||||||||||||||||||||||
71 | ||||||||||||||||||||||||||
72 | Correct intent and entities: 35 | |||||||||||||||||||||||||
73 | ||||||||||||||||||||||||||
74 | ||||||||||||||||||||||||||
75 | ||||||||||||||||||||||||||
76 | ||||||||||||||||||||||||||
77 | ||||||||||||||||||||||||||
78 | ||||||||||||||||||||||||||
79 | ||||||||||||||||||||||||||
80 | ||||||||||||||||||||||||||
81 | ||||||||||||||||||||||||||
82 | ||||||||||||||||||||||||||
83 | ||||||||||||||||||||||||||
84 | ||||||||||||||||||||||||||
85 | ||||||||||||||||||||||||||
86 | ||||||||||||||||||||||||||
87 | ||||||||||||||||||||||||||
88 | ||||||||||||||||||||||||||
89 | ||||||||||||||||||||||||||
90 | ||||||||||||||||||||||||||
91 | ||||||||||||||||||||||||||
92 | ||||||||||||||||||||||||||
93 | ||||||||||||||||||||||||||
94 | ||||||||||||||||||||||||||
95 | ||||||||||||||||||||||||||
96 | ||||||||||||||||||||||||||
97 | ||||||||||||||||||||||||||
98 | ||||||||||||||||||||||||||
99 | ||||||||||||||||||||||||||
100 |