NewAgent Benchmark Report

	A	B	C	D	E	F	G	H	I	J	K
1	States	metric	total	claude better	both good	both bad	NewAgent better	NewAgent_False	NewAgent_True	claude_True	claude_False

2	External Search Tasks
3	(user-ask_source,user-search_similar)=>writer-find_similar	relevance	32	15	3	0	9	0	3	2	0
4	(user-ask_source,user-search_similar)=>writer-find_similar	accuracy	32	14	6	0	7	0	3	2	0
5	Report Focus Tasks
6	user-ask_actionable_steps=>writer-instruct	relevance	14	0	14	0	0	0	0	0	0
7	user-ask_actionable_steps=>writer-instruct	accuracy	14	1	9	0	4	0	0	0	0
8	user-ask_actionable_steps=>writer-instruct	conciseness	14	1	11	0	2	0	0	0	0
9	user-ask_detail=>writer-give_details	relevance	7	0	3	0	3	0	0	1	0
10	user-ask_detail=>writer-give_details	accuracy	7	0	3	0	3	0	0	1	0
11	user-ask_detail=>writer-give_details	conciseness	7	0	4	0	2	0	0	1	0
12	user-ask_actionable_steps=>writer-suggest_fix	relevance	6	0	5	0	1	0	0	0	0
13	user-ask_actionable_steps=>writer-suggest_fix	accuracy	6	0	4	0	2	0	0	0	0
14	user-ask_actionable_steps=>writer-suggest_fix	conciseness	6	0	6	0	0	0	0	0	0
15	user-ask_detail=>writer-inform	relevance	5	0	1	0	2	0	2	0	0
16	user-ask_detail=>writer-inform	accuracy	5	0	2	0	1	0	2	0	0
17	user-ask_detail=>writer-inform	conciseness	5	1	1	0	1	0	2	0	0
18	Writer Intensive Tasks
19	user-ask_title=>writer-suggest_title	relevance	19	2	16	0	0	0	0	1	0
20	user-ask_title=>writer-suggest_title	accuracy	19	2	16	0	0	0	0	1	0
21	user-ask_title=>writer-suggest_title	conciseness	19	1	17	0	0	0	0	1	0
22	user-ask_summary=>writer-summarize	relevance	13	0	12	0	0	0	0	1	0
23	user-ask_summary=>writer-summarize	accuracy	13	0	11	0	1	0	0	1	0
24	user-ask_summary=>writer-summarize	conciseness	13	3	8	0	1	0	0	1	0
25	user-ask_templatize=>writer-templatize_submission	relevance	12	0	11	0	0	0	1	0	0
26	user-ask_templatize=>writer-templatize_submission	accuracy	12	0	11	0	0	0	1	0	0
27	user-ask_templatize=>writer-templatize_submission	conciseness	12	1	10	0	0	0	1	0	0
28	user-ask_update=>writer-update	relevance	7	0	7	0	0	0	0	0	0
29	user-ask_update=>writer-update	accuracy	7	1	6	0	0	0	0	0	0
30	user-ask_update=>writer-update	conciseness	7	0	6	0	1	0	0	0	0
31	user-review=>writer-suggest_fix	relevance	6	0		0	0	0	0	0	0
32	user-review=>writer-suggest_fix	accuracy	6	0	6	0	0	0	0	0	0
33	user-review=>writer-suggest_fix	conciseness	6	2	6	0	0	0	0	0	0
34	Simplification Task
35	user-ask_simplify=>writer-simplify	relevance	21	0	17	0	0	0	0	4	0
36	user-ask_simplify=>writer-simplify	accuracy	21	0	17	0	0	0	0	4	0
37	user-ask_simplify=>writer-simplify	conciseness	21	5	12	0	0	0	0	4	0
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100