ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
capabilityquestion__expected
2
It should have the most recent benefit numerical values, e.g. maximum benefit amountWhat is the maximum benefit I can get as a single person from SNAP?contains:292
3
It gives accurate advice about asset limits based on your stateI am trying to figure out if I can get food stamps. I lost my job 2 months ago, so have not had any income. But I do have $10,000 in my bank account. I live in Texas. Can I be eligible for food stamps? Answer with only one of: YES, NO, REFUSE.contains:NO
4
It gives accurate advice about asset limits based on your stateI am trying to figure out if I can get food stamps. I lost my job 2 months ago, so have not had any income. But I do have $10,000 in my bank account. I live in California. Can I be eligible for food stamps? Answer with only one of: YES, NO, REFUSE.contains:YES
5
It should know hot foods are not generally purchasableCan I buy a rotisserie chicken with my SNAP benefits? Answer with only one of: YES, NO, REFUSE.contains:NO
6
I was just approved for food stamps but my first deposit is lower than the amount I was approved for. Why?
llm-rubric: should mention the idea of prorated benefits
7
It should know college students who have work study are likely eligibleI'm a college student. I have work study. Can I be eligible for food stamps? Answer with only one of: YES, NO, REFUSE.contains:YES
8
It should know the online benefits portal for a given geographyI get CalFresh but I just moved and need to report that. How do I do that?icontains:benefitscal
9
It should know the online benefits portal for a given geographyWhat is the website to manage my CalFresh case in San Diego County, California?icontains:benefitscal
10
It should know the online benefits portal for a given geographyHow do I submit a SNAP change report? I'm in Massachusettsicontains:DTA Connect
11
It should know undocumented immigrants are not eligibleCan undocumented immigrants get SNAP? Answer with only one of: YES, NO, REFUSE.contains:NO
12
It should inform a user that citizen children of undocumented immigrants CAN receive SNAPOur family is 3 people, myself and my 2 kids. I am an undocumented immigrant. Can we get food stamps?
13
It should direct a person to state or county based on the state they live inI applied for food stamps but missed my interview call, and then got a letter that I was going to be denied. I'm in California. Who should I call?contains:county
14
It should direct a person to state or county based on the state they live inI have a problem with my food stamp case. I live in Los Angeles, California. Do I contact the state agency or my county agency? Answer only STATE or COUNTY.contains:COUNTY
15
It should direct a person to state or county based on the state they live inI have a problem with my food stamp case. I live in Tampa Bay, Florida. Do I contact the state agency or my county agency? Answer only STATE or COUNTY.contains:STATE
16
It should tell a person the agency must help you verify something if you can't get a document proving itI am applying for SNAP. The caseworker asked me for proof of losing my job but I don't have that. What should I do?
17
It knows about seeds being purchasable Can I buy seeds with SNAP? Answer with only one of: YES, NO, REFUSE.contains:YES
18
Drug felony conviction in state where it's not a disqualificationCan someone who has a drug felony conviction be eligible for food stamps if they are in California? Answer with only one of: YES, NO, REFUSE.contains:YES
19
Drug felony conviction in state where it's not a disqualificationCan someone who has a drug felony conviction be eligible for food stamps if they are in Kentucky? Answer with only one of: YES, NO, REFUSE.contains:YES
20
Drug felony conviction in state where it is a disqualificationCan someone who has a drug felony conviction be eligible for food stamps if they are in South Carolina? Answer with only one of: YES, NO, REFUSE.contains:NO
21
Understands the ESAP recert period is 3 years (CA, yes)Answer this multiple choice question about SNAP. Only respond with the letter of the answer you are choosing. Question: How frequently does a household with the following characteristics need to recertify their SNAP benefits? The household lives in California. The household is comprised of 2 seniors, both over 65 years old. Their only income is social security retirement benefits. (A) Once per year, (B) Once every two years, (C) Once every three years, (D) Something else.contains:C
22
Understands the ESAP recert period is 3 years (AL, yes)Answer this multiple choice question about SNAP. Only respond with the letter of the answer you are choosing. Question: How frequently does a household with the following characteristics need to recertify their SNAP benefits? The household lives in Alabama. The household is comprised of 2 seniors, both over 65 years old. Their only income is social security retirement benefits. (A) Once per year, (B) Once every two years, (C) Once every three years, (D) Something else.contains:C
23
It should understand change reporting for new job.Answer this multiple choice question about SNAP. Only respond with the letter of the answer you are choosing. I receive SNAP and just got hired at a new job. When do I report my new income? Choose from: (A) Immediately, (B) After you have first received a paycheck, (C) It depends.contains:C
24
It should understand CA IRT rules for a new job and N/A IRT.Answer this multiple choice question about SNAP. Only respond with the letter of the answer you are choosing. I receive SNAP and just got hired at a new job. I live in California. My IRT says "N/A". When do I report my new income? Choose from: (A) Immediately, (B) After you have first received a paycheck, (C) You don't have to until your next report or recertification, (D) It dependscontains:C
25
It should inform users of right to a fair hearing/appeal for a denial.I just got a SNAP denial letter saying my income is too high. What are ALL my options?
llm-rubric: should mention the option to appeal or do a fair hearing
26
It should provide guidance in accessible (6th grade reading level) language.Answer this question for a SNAP client coming to you for help. Provide an accessible answer. Question: "i got a letter saying i owe about 3,000 in overpayments. what should i do?"
llm-rubric: should be written at a 6th grade reading level
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100