Moderated Usability Test Results

Test Plan link: https://docs.google.com/document/d/1oJYVR2siKmeRhyGWYUjiRQeDHhLtPmR0MaRHLhWUw14/edit?usp=sharing

Script I read before the tests:

https://docs.google.com/document/d/1sSw5pM6QyotbXjAkyME_yOs9EDbvfJcuewn-TyJLX9g/edit?usp=sharing

Prototype link: https://marvelapp.com/9gf2ja

Test notes

The green highlights are my actions based on feedback.

Users personal information is private and is not shared outside of Seasoned Harvest. Thank you.

User 1 -Philip V.

Male

Age 32

Intermediate Computer Skills

In person test

We started on the landing page. He said he didn't know what “Save me time” button meant. He didn't see the connection bt zip code and the service. I made a note to test this phrase using Usabilityhub. At the bottom of the page, he click on the “See more” button which took him to the homepage. He said he was expecting it to tell him more information or to sign up. I never made the page, I realized it was pretty explanatory and wasn't needed. I changed it to Sign In or Register for future tests. I lead him back to landing page and asked if he saw another way to register. He did and had no problems. I need to review this button in the design but others may not  expect a “see more” button bring me to the home page.

I gave the scenario of finding liquid eggs. He decided to click on dairy in the navigation bar. The dropdown menu pops up, and he clicks on eggs. I asked him how he would find details about the liquid eggs, and he clicked on the picture. He clicked on add to cart to add it. Asked him how to go back to homepage and he clicked on the upper left logo.

I then asked her where he would click on to see items in the cart. He clicked on shopping cart button at the top. He then clicked on checkout and it took him to the review cart page. He mentioned he did not like the cart page. He preferred it to be listed in one line after another.

I decided to test this is an A/B test for the remote study. He noticed shipping icon and I asked how much more he need to pay to get free shipping. Mentioned price should be bigger to be noticeable.

I asked him about what he thought the stars meant, he said probably a favorite. He mentioned he thought a link to favorite should be next to my account by the search box. (upper middle of page.) Valid remark.

Went back to check out and hit complete. Thanked the user and ended the test.

User 2 -Tammy C.

Female

Age 54

Basic Computer Skills

In person test

She saw they did grocery delivery and clicked on zipcode that took her to a map. This then took her to register; there was hesitation about the sign in & register but easily caught that. She said she would look at the rest of the page after she finds out if it is in her area.

Notice shipping. Mentioned that she liked it was free account and that you can earn points.

Once on the homepage, she saw the picture icon and thought it was a home button or location map because of the mountains. (Show picture icon)

Question whether liquid eggs would be under dairy or pantry. Decided to click on dairy in the navigation bar. The dropdown menu pops up, and she clicks on eggs. I asked her how she would find details about the liquid eggs, and she clicked on the picture. She saw the tab menu that said nutrition. She clicked on add to cart to add it. I asked her how she would buy the cheese, and she used the left side menu and clicked on the word cheese. Asked her what she thought the down arrows on the menu meant, she said it would give subcategories such as eggs, powdered eggs, etc. Asked her how to go home and she clicked on breadcrumb.

Star- supposed to be fav, she thought it meant it was on sale. What about three letters FAV? I didn’t ask her about it, wondered if I should. Brittany’s (mentor) comment: I think a star is pretty intuitive of favorite. FAV isn’t so much. I do think you need to better show what favorites means to user.

I then asked her where she would click on to see items in the cart. She clicked on shopping cart button at the top. She went through the description of how can remove items or change qty without prompting.

Noticed categories that the cart was divided into and liked that. Did not mention shipping, went straight through to checkout page. Asked her how to go back to see the cart, no problems. I asked if noticed shipping part. She said she glanced at it but was focused on the purchase. I asked how much more she need to pay to get free shipping. Saw price listed in shopping cart button.

Went back to check out and hit complete. Mentioned upper right drop down could go to her account or log out.

Footer- About us - she said it was probably about their grocery philosophy such as what kind of food, where it came from, etc. Was able to explain FAQ & site maps. Didn’t seem to notice search box or my account, download app, etc. Thanked the user and ended the test.

User 3 -Timothy C

Male

Age 26

Intermediate Computer Skills

In person test

We started on the landing page. He said he thought the benefits should be towards the top and food categories towards the bottom. He then click on register and had no problems.

I gave the scenario of finding liquid eggs. He decided to click on dairy in the navigation bar. The dropdown menu pops up, and he clicks on eggs. I asked him how he would find details about the liquid eggs, and he clicked on the picture. He clicked on add to cart to add it. Asked him how to go back to homepage and he clicked on the upper left logo.

I then asked her where he would click on to see items in the cart. He clicked on shopping cart button at the top. He then clicked on checkout and it took him to the review cart page.

He noticed shipping icon and I asked how much more he need to pay to get free shipping. Pointed out shipping icon and words saying how much more he needed.

I asked him about what he thought the stars meant, he said probably a favorite. he asked where he would see the list. I asked him where do you think it could be and he selected My account link. Went back to check out and hit complete. Thanked the user and ended the test.