Helio | HEART Framework - Google Sheets

	B	D	E	F	H	I	K	L
1	Heart Framework AI Recipe Test
2	An example comparion using Helio to create complete the Heart framework
3
4		Goals	Signals	Metrics	VARIATION A: Chat GPT		VARIATION B: Google Bard
5		Goals are tasks performed by users or problems they may encounter.	Signals that will tell you if the goal is accomplished	Metrics transform signals into measurement scales based on user behavior	CONTEXT OF EVALUATION	RESULT	CONTEXT OF EVALUATION	RESULT

6
7	Happiness	Ensure users feel satisfied with the payment process, minimizing frustration and confusion. User understands what they are paying for, how much they are paying.	Positive user feedback, low bounce rates, high completion rates.	User satisfaction ratings (e.g., surveys, NPS scores), time spent on page, bounce rate.	Impressions		Impressions
8					Net Positive Alignment	142%	Net Positive Alignment	189%
9					Detailed	63%	Detailed	62%
10					Helpful	71%	Helpful	73%
11					Innovative	12%	Innovative	30%
12					Fun	30%	Fun	49%
13					Long	19%	Long	8%
14					Confusing	3%	Confusing	5%
15					Overwhelming	9%	Overwhelming	9%
16					Unnecessary	3%	Unnecessary	3%
17
18				NPS	NET PROMOTER SCORE	21.57	NET PROMOTER SCORE	36.63
19
20	Engagement	We want users to engage with the command bar and suggestions rather than asking for help.	Bard AI's more expansive list of category suggestions provides an engaging feature for more users to interact with.	First click interaction with the tool.	Interest - First click		Interest - First click
21					New Chat	22%	New Chat	1%
22					Command Bar	59%	Command Bar	60%
23					Command Suggestions	12%	Command Suggestions	39%
24
25
26
27	Adoption	Ideally, users first act will be to use the provided recipe, or interact with the tool more.	Chat GPT produces twice as many participants who want to type in a new command, indicating dissatisfaction with the current results.	Action mapping users' decisions after using the tool.	User next steps		User next steps
28					Regenerate new response	36%	Regenerate new response	34%
29					Type in a new command	20%	Type in a new command	10%
30					Try a different AI tool	11%	Try a different AI tool	7%
31					Save and use recipe	67%	Save and use recipe	83%
32					Other	4%	Other	7%
33
34	Retention	We want to move users out of neutrality and towards feeling like they will use the tool again.	Over 10% of users believe they are unlikely to use Chat GPT to find a recipe again, comapred to only 3% of Bard users.	Understand likelihood for participants to re-engaged with the tool after first use.	Likelihood to use again		Likelihood to use again
35					Very Likely	44%	Very Likely	52%
36					Somewhat Likely	32%	Somewhat Likely	33%
37					Neutral	14%	Neutral	12%
38					Somewhat Unlikely	7%	Somewhat Unlikely	2%
39					Very Unlikely	4%	Very Unlikely	1%
40
41	Task Success	Users should have success using the command bar and the suggested commands.	Bard's suggested commands provide more places for successful interaction.	Gauge amount of users successful when given a goal/directive.	Type in command		Type in command
42	Task Success				Success	65%	Success	81%
43
44
45					https://my.helio.app/report/01HE1J6XXV1959DKWVGFG47JC7?section_id=108459		https://my.helio.app/report/01HE1JCFZ3JTKMSY05DZKYNG5Y?section_id=108469
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100