ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
Vanguard User Test (edited)
2
Ordered byLucy Smithwick (lucyks@email.unc.edu)
3
Order dateMay 5 2024, 9:23am PDT
4
Number of contributors3
5
Starting URLhttps://www.figma.com/proto/0OdxCDTg6ZrOANsp7y6uAP/Vanguard-User-Testing?page-id=0%3A1&type=design&node-id=1-3&viewport=-494%2C491%2C0.13&t=RFWtGNLR6ZHF76hk-1&scaling=scale-down&starting-point-node-id=1%3A3&mode=design
6
IntroductionYou are a new user to Vanguard's Digital Advisor dashboard. Follow the tasks, as there are questions during your site walkthrough, but mostly just explore the site and take note of what you do and don't like.
7
8
UsernameLemon0707ko_biiSilverOtter2886
9
Email
10
Test ID #5123640A5123640C5123640D
11
User ID
12
Universal Unique Identifier01b89e60-d9bc-4fe0-939c-f189081f609f17c5938d-43d2-4634-998c-32cc494c2d8cfc61c0a9-b83e-441f-803c-0fcd680888e9
13
Completed date/timeMay 5 2024, 9:41am PDTMay 5 2024, 9:59am PDTMay 5 2024, 10:16am PDT
14
Videohttps://app.usertesting.com/v/ae0a3dcd-2af2-4bc0-b177-6a2d62db3c61https://app.usertesting.com/v/e57b1060-9327-4c04-8c30-e36049c8d66chttps://app.usertesting.com/v/e4a3d2d5-84db-4736-b8c6-cbeda8642f4d
15
16
Contributor demographics
17
Age222426
18
Children
19
DeviceComputerComputerComputer
20
CountrySouth AfricaSpainItaly
21
Annual household income$125,000 - $149,999$20,000 - $39,999$20,000 - $39,999
22
Operating systemOS X 10.15.7 64-bitWindows 10 64-bitWindows 10 64-bit
23
Other requirement
24
Social networkingTwitter, Linkedin, PinterestFacebook, Twitter, PinterestFacebook, Twitter, Linkedin
25
GenderFemaleFemaleMale
26
Web browserChromeChromeChrome
27
Web expertiseAverageAverageAverage
28
Company sizeanyany11-50 employees
29
Employment statusFull time studentFull time studentEmployed full-time (30 or more hours per week)
30
IndustryComputer Software
31
Job functionEngineering
32
SeniorityEntry-level
33
34
Session summaryreplaced 5123640B
35
36
Contributor system Info
37
Browser versionChromeChromeChrome
38
Color depth302424
39
CPUApple M1AMD Ryzen 5 4600G with Radeon GraphicsAMD Ryzen 7 5700X 8-Core Processor
40
Free disk space0.0 MB0.0 MB0.0 MB
41
Free memory (RAM)46.3 MB8813.52 MB23919.32 MB
42
Operating system (OS)OS X 10.15.7 64-bitWindows 10 64-bitWindows 10 64-bit
43
Screen resolution (in pixels)1440 x 9001920 x 10801920 x 1080
44
0.3.3470.3.3470.3.347
45
Total memory8192.0 MB16253.17 MB32691.43 MB
46
47
TranscriptTranscriptTranscript
48
Task 1
49
Log in or create a new account.You are a new user to Vanguard's digital advisor dashboard. What are the tasks as there are questions during your site walkthrough, but mostly just explore the site and take notes of what you do and don't like. Okay, Step one, log in or create a new account. Begin the step, sign me up and that's how I would log in or create in your account.Okay, so, uh, you are a new user to Banger's Digital Advisor dashboard for the task Ask. There are questions already during your site walkthrough, but it's mostly just explore the site and take note of what you do and don't like. Okay, let's begin. Step one, log in or create a new account. So we got, uh, this website, right? We can scroll on it. And it got, uh, it got like four different tabs. The portfolio, the investing tools, the market and help. Uh, I think for me, um, I would put this tab like maybe, uh, make them more visible because if, if the little, um, like cursor thing hand didn't pop up when you hover over them, I maybe wouldn't have known that they were tops. So I would make them more obvious looking like, like I would make them more up here instead of this, uh, illustration. I would maybe put the tops, um, along with the illustration, but make them more obvious. Anyway, let's log in and create our account. So obviously the big red, uh, button it's going to, or maybe not, maybe not, maybe we have to do it hit, but, um, again, another thing I maybe don't like or find confusing. This is confusing because it, it makes you believe that, um, you're going to sign up. Maybe, I don't know in my head, uh, that that was obviously going to be the sign up process, but it's, it's actually down here. So I would put this one, um, the sign up process and the login process and all, all of those, I would put them more, um, higher up in the, in the screen. Definitely. So let's, let's sign up, right? We have to, um, log in or create a new account. Okay, sign me up. Typical, you know, um, typical boxes, right? Make one first name. Well, let's create the account, right?You are a new user to Vanguard's Digital Advisor dashboard. Uh, one second. Follow the tasks as there are questions during your site walkthrough, but mostly just explore the site and take note of what you do and don't like, uh, login or create a new account. Alright, um, let's see. Vanguard Digital Advisor, portfolio Investing Tools and Market Help. All right, so I guess I would do, let's do it to stop creating a new account. Um, all right. I would probably like to have the, um, the link to have to make a new account, uh, show up at the top, Because At first I just didn't see it. I was like, is this the wrong page? But yeah, I mean it, after I see it, it, it's clear that that's the correct link. Um, the, the, I may remember now that it has did say also login, but um, I would input my data here. It's not letting me do that, so I'll just, let's see what it's asking me about. So, name, email, phone. Why am I using Vanguard? I guess I can't click that. Okay. Experience level. What's your budget? Okay. These, uh, seem pretty common questions for this type of site, so I'll go ahead and create my account. Alright, the graph looks nice. Um, let's see.
50
51
Task 2
52
Overall, this task was:Overall this task was very easy. Um, there was a lot of sign me up. I just assumed it was all for the same thing. Um, so the letters were big. Just press one button. It was easy.Uh, this task was, uh, fairly easy, but as I said, I would put the process higher in the screen so it's more, um, obvious. Like it, you just see it straight up when you, uh, enter the website and you don't have to scroll down to look or to sign up. I would make them be moreOverall this task was, uh, I'd say four. I mean it was easy, but I didn't instantly see the, uh, create a new account button. So I'll
53
54
Task 3
55
Take a walk through your portfolio. Complete a few tasks on the page.Take a walk through your portfolio, complete a few tasks on the page portfolio here. I'd fill in my first name, last name, phone number, experience level, and my budgets as well as why I am using Vanguard Oopsie back to my portfolio.visible. Take a walk through, through, take a walk through your portfolio, complete a few tags on the page. Okay? So, uh, our portfolio is open. We are on the top of the portfolio and it says hello is, here's where we are with your goals. You currently have, uh, 22,251, uh, dollars thousand dollars, uh, funding your retirement goal. Okay? So here we have like, maybe we can put one, like more than one goal. So we have a little, um, option, um, little square bucks box and like a, a graph, right? So it's, it says, um, retirement well founded, most likely, more likely or less likely. Okay? Uh, at first, to me, this is looking kind of confusing, but I, I understand when I look into it more like in deep, I, I understand, but the graph looks confusing maybe because, uh, they are like, they are all green colors, and it gets confusing. Like at first side it just looks like one big stroke of green instead of three different, um, three different, uh, variables, right? So that was confusing at first, but once you actually observe it, it is quite easy. Um, right? So let's set a goal maybe, I don't know if that'sjust give it a four. Take a walk through your portfolio, complete a few tasks on the page. I'll just take a look at it first. Um, yeah, unfortunately many things are not clickable, so I can't see like the different types of, uh, I guess charts that I could see. I can see my goals. I guess this would be, And it's telling me whatever month I was spending the amount <affirmative>. Alright, so it's telling me how much I have to spend each month, uh, to get to the goal. I'm guessing transaction history. Can I click on these? Yes, I can. All right. This is the same. Uh, let us see your progress and let you know if there's anything you can be doing to make this process as efficient as possible. Okay. So, I mean, I don't really know what's going on in the sense that like, I don't know, are these transactions that I made are these transactions that whatever, uh, fund is managing my money made, but I don't know if that's, uh, within the scope of the task. So I'll just like, um, go to the next
56
57
Task 4
58
Overall, this task was:Overall, this task was also very easy. Obviously this is still a prototype, so I couldn't do much. Um, but it was quite simple,what I have to do, but yeah, that, that was easy. Like,step. Uh, well, very easy because <laugh>, nothing but ask
59
60
Task 5
61
Which tab did you want to go to first after portfolio?Investing toolsThe market oneInvesting tools
62
63
Task 6
64
Go to the Investing Tools tab. Look around there.<laugh>, go to investing tools and look around there. Investing tools. There we go. Sorry, I think I might have done a drug initially. Um, here's where we are with your goals. You currently have 22,000 5, 2 5, 1 9 1 funding and my retirement goal. Oh, I can add new goals. Um, new retirement, new car. Oh, I have my transaction history and schedule transaction as well. Ooh. Analyze ma, analyze me. I can also analyze myself, which I think is pretty cool. So now I'm in investing tools in the correct place. So I can 2045 at the age of 45. Family home, new car. These are my goals. Again, here's my simulations and tools. So I can have a risk assessment as well as paper trading simulator. I wonder what that is. Tax loss, harvesting a especially that helps you minimize your tax burden. You reduce your capital gains taxes by using realized losses to offset realized gains. That's very interesting. Okay, and I can edit my, um, goals and add new goals here. Uh, paper trading simulator. Oh wow, okay.go to the investing tools. Stop, look around there. Okay, so no market, just investing tools. Let's look around. Here goes, okay. The, the goals show up again and we have, uh, again, our goals, but instead of looking like this in, in little squares, uh, they're more, um, presentable looking, let's say. So they got their illustrations and all their information, and we can edit it or help, I don't know, help about what? Like, frequently asked questions. Okay. And I am guessing, yeah, this, this is interesting. The well funded, well funded and underfunded. That's, that's interesting. Maybe I would put it bigger. So, uh, it stands out more like I think that is important to, to have like to keep on track if it is well-funded or underfunded, and then we have simulations and tools, risk and people treating simulator and little bit information and we can learn more. Okay? Yeah. Overall, um, the website is looking like, um, I don't know how to say this like professionally, but in my, uh, in my opinion, it's looking undercooked, like it's not fully, um, done yet in, in regards of design and, and cohesiveness and, and just all looking well that, uh, cohesive and put together. But let's, let's keep on moving.it wasn't explained. Go to the investing tool tab. Look around there. So I've already done that. I can see, I can create new goals. I can see, well, I can see that it suggests me to go to another site to try some paper trading. I, Uh, it seems to be telling me some random tip or maybe this is like some blog that, that's like, uh, being showcased here. Let's see. Okay. And this is like a guide on investing, which makes sense. Yeah, I mean, what I'm confused about is, um, what is this site doing? 'cause you know, I'm not seeing any section to buy things. So Yeah.
65
66
Task 7
67
What feels like it's missing from the investing tools tab?

If nothing, do you feel like this is a helpful tab?		A small description beneath the tools' headings might be useful. This is a useful tab especially for beginners.I find the goals tab as the most useful section on the tabIt's missing a way to invest.
68
69
Task 8
70
Go to The Market tab. Look around there.Go to the marketing tab and look around there. Okay, begin this step. The markets, the global markets. We have US markets, sectors, indexes, and market news. I assume right now I'm looking at the global market because it says so here. Okay, I can see what's going on around the world. It looks like mostly the, um, investment capitals of the world. Can I say that as well as, um, oh, and I can say, what are ESGs right here? Okay, I am not gonna go into that right now and I can get, uh, information on that.Okay, go to the market lab and look around there. We already done that before, but let's go again. Okay. So we have here a, a map, a world map, and a different tabs. Again, we have the global markets, the US markets, sectors, indexes, market news, and the US economic calendar. We can create a watch list, which I don't know what it's for, <laugh>. And here, I guess we can control like how the different markets around the world are going, if they're going up, if they're going down. And then we have the A s Gs, which again, I'm not familiarized with the finance world, so I'm not sure what it is, but they have already prepared for that for people like me. So they, they put a little button here to maybe let you know what it is. I'm not going to go there because then I would not make, um, the test in time. But that's nice. Uh, I think more of this throughout the whole website, uh, would be really helpful because some people just don't understand what these things are. And, and yeah, I think more of those, what are certain things on the website, uh, would be really helpful.what I, what I meant. Go to the market tab. Uh, market tab. Looking around there. Yeah, I, I saw that not much was clickable here. I, I mean inside the tab it just shows me that I could see some very, like broad or these yeah, kind of broad index, um, prices here. Global markets sectors, yes. Economic calendar and some news. And then it's telling me a TF media funds, but what are you, I actually don't know what they are. Is this gonna load? No, it's probably not. And then it's showing me this ESG list, which I don't exactly know what they are. And original stocks. I mean, I know what an ETF is, I just, okay. So
71
72
Task 9
73
Do you think anything important is missing from this page?

If it's too difficult to understand, what would you like to see added?		It would be useful to have a key which describes the abbreviations on the global map.I really liked the "What are esgs?" button because some people are not familiarized with the finance world and may need some help with certain terms. I think more of those buttons would really help people get a better understanding of the website.It's missing a list of the investments I own and their prices.
74
75
Task 10
76
Go to the Help tab. Look around there.Go to the help tab, look around there, begin this step, help FAQs. How does digital advisor manage my portfolio? How does Vanguard handle market volatility? What are tax optimization strategies? What risk, what is risk attitude? When and how will you rebalance my portfolio? And then I can see more. And then it seemed that there's some videos, emergency funds, backdoor Roth, IRAV. I'm not sure what that stands for and why investors choose us. Okay, I looked around and for both I can say see more and I can speak with the chat bots.Next step, go to the help tab, look around there, okay. Help tab. And here we have the frequently asked questions, and we can also speak with the, with the chat bot, with which I think, and I'm guessing it's just, uh, an, uh, artificial intelligence, right? So here we have, uh, five different frequently asked questions, and if we click here, maybe we can see even more of them. So maybe one question we have, like as I, as I was saying before, uh, this, but throughout the whole page, I, I mean, it's great that they're here in a specific tab for them for the questions you may have, uh, when looking throughout the website. But I think, um, adding them to this, to each job, uh, maybe when a, a specific term, uh, comes up like, like here, right? Where, where they said, uh, what are ESGs, I guess, um, I think when certain terms, uh, pop up, it would be really helpful to add, um, a frequently asked questions like that. All right. And then,Go to the help tab. Look around there. How does digital advisor manage my portfolio? Can I see that for real? No, I cannot. Okay. How do I go back? Okay. How does Vanguard Digital Advisor handle micro volatility? What are digital advisors tax optimization strategies? Okay, so this makes sense. Explaining what the platform is investing help. So some video guides I'm seeing, I can see that there's a chat bot. I, Um, I'd, I'd say that personally, I've never had much luck with these chat bots, so I guess this would not be that useful to me. Or maybe if it did work, well, maybe then it would
77
78
Task 11
79
Is this organized well enough and does it provide enough helpful information? If not, what does it need?This is organised well. For more info, I can press "see more" which is useful.I don´t think this tab need anything elseI don't think it's missing anything. And it's organized well already
80
81
Task 12
82
Explore the site on your own now.Explore the site now on your own now. Okay, let me do that. So I wanted to go back to the markets. I see these are not yet working. It would be quite cool to actually press into the market if that would be work. Um, if that will work as well to be able to press into each like s and p 500. What are ESGs? Oh no, let me not leave it and I can create a watch list. Okay, investing tools. I'm really curious about the risk assessments. I saw the paper trading simulator, which was quite cool. Um, what goals? Paying off student loans is a nice one. And I can customize my colors, which I love. Add images, how much it is, goal date, name it. That's really, really nice. And I like the sim symbolism, minimalism of, um, the design. This is a nice graph as well. What is this? Most likely, yeah, there is a learn more about our projections, transaction history. I wanna be analyzed, but I don't wanna go out of this. It's quite cool.Explore the site on your own now. Okay, so we did that at the beginning, but here we have, um, the bell icon, which I'm guessing r ratifications. So we have called adjusted. I'm guessing each time you modify, um, something from your account, you get a notification. Here we have the search tab as in almost every website, eh, ever. It's always helpful. Here we have the goals again, which I didn't see the first time. Here we go have the goals again. So now that I see that these are here as well, I am not sure if I get what this tab is about really. I, maybe it's because I'm just not into finance, uh, work. So I'm not sure. But yeah, then we have transaction history on our portfolio here. We can see all our past transactions and our schedules, the ones that are going to happen soon, right? That's helpful. And then we can analyze our portfolio, analyze me, yeah. Here we have concerns, right? And if it's manageable or not manageable, underfunded, but easy reach, well funded and easy to reach. That is so nice actually, we can either reanalyze or get a representative's help. We can always get help if you're feeling lost. That's nice. On the investing tools here we have, um, more information, and here we have even more information with percentage and even videos. That's nice. And in the market, we've already talked about that. So I am, I'm not sure if, um, there's anything else to comment.already explore the site on your own. Now I think I've done this already. Um, okay. There's some stuff I've, I've missed. Uh, so there's a search bar, which I don't know what it would do other than search through the FAQs or maybe, yeah, or maybe some like my investments or what is it? What is it? Like prices of stuff? Yeah, I don't know. Just what this would be. 'cause like the site is already quite, it, it's not that big. And I might as well just find things myself. Let's see. Then there's some notification tab here that says risk exceeded. Uh, yeah, since I don't understand really how the platform works, I, I don't know why I would ever receive a notification like this. Like, isn't the platform itself managing my money? Why is it telling me that the risk is exceeded? But whatever, uh, the goal reached notification. Makes sense. Let's see. Analyze. I didn't click on this after we analyze your data, the only information retain, okay, so that's, uh, I don't care about that. Analyze me. The goal is manageable. We'll find that and easy to reach. Okay. Underfunded, but easy to reach. Not enough current amount to be on track as the market raises prices easily. Neither are monthly payment. Okay. This actually seems quite useful. I can get a representative. Okay. Hopefully <laugh>, hopefully this is just a mistake. If I click on get a representative help, I, I don't expect to be redirected to a chat bot. Um, where was I? I forgot. Uh, where's the analyze? Okay. And then I can reanalyze. Um, then I think I clicked everything on this page. Okay. Maybe this's a get external link. Uh, the market create a watch list. I can't click on it. Then help. And I've clicked through everything. I think, yeah, I think I went through basically everything
83
84
Task 13
85
What other details did you find? Are they useful? What do you think needs to be on this testing model that isn't?I found the create goals section and liked that I had the ability to personalise the colour and name of my goals.
There is nothing I can think to add to this testing model except possibly a beginners tutorial when entering the model/ digital advisor.		The video on the investing tab is really helpful, people tend to learn more by seeing and hearing rather than just reading long texts.The analyze my portfolio section. It does seem to be useful. I don't like that by clicking on "get a representative's help" I get redirected to a chatbot. It would be nice to have some explanation of what the platform/site is before one start out with the test. Then the testing model is definitely missing the section whe re I fund the account and decide where the money goes
86
87
88
Post-test questionnaire
89
What frustrated you most about this site?There was somethings I didn't understand and would have to click additional buttons to gain insight.Not knowing what certain terms or tabs wereNot understanding what the goal of the site itself was before beginning with the test
90
Is there any feedback you have for me that I didn't ask you about?NoThe design one i commented, i would definitely have a look on that.I have provided some during the test. Nothing else comes to mind
91
What did you like about the site?I liked the site's design and colour choices. It is not intimidating in terms of design. I also liked all the features the site offered.The closeness to the user, it feels warm and personal.It doesn't have much useless information. It's very dense and doesn't waste space showing useless stuff
92
How likely are you to make an account with Vanguard Digital Advisor, given you don't have to pay anything from the start?Very likely, it seems like a great site. I would love to try it.Not likely, since i am young and don´t need financial advisors yetUnlikely since I already use other investments platforms that offer me more control on the investments I make. But it does seem very nice for less financially inclined people
93
94
95
96
97
98
99
100