1 of 20

User Testing Summary

2 of 20

THE USERS

5 users

  • Mostly familiar with crypto and NFTs
  • Had an understanding of the fashion/art industry
  • Mostly heard of MetaFactory, but not all fully aware of the “inner workings”
  • All of them believe in the purpose of the digital and physical connection in art and design.

3 of 20

SUMMARY

  • Users were very interested in the compensation structure and reward system
  • The less crypto-experienced users are, the more they need guidance
  • List overview could benefit from visual elements, touch-ups
  • More context on ROBOT and brand collaborations would be helpful

  • The use case is very clear and the visual style was appreciated
  • Highly desired improvement over the current Discord-channels
  • People love idea of creating a physical good with an instalment of tokens and community curated proposals
  • A project that has a lot of value for designers and artists as a part of cultural goods production

+

“I have no idea how to create swag for MF to produce. I think I'm a good designer but who do I create it for? This solves it for me.”

!

4 of 20

SUMMARY

  • Users were very interested in the compensation structure and reward system
  • The less crypto-experienced users are, the more they need guidance
  • List overview could benefit from visual elements, touch-ups
  • More context on ROBOT and brand collaborations would be helpful

  • The use case is very clear and the visual style was appreciated
  • Highly desired improvement over the current Discord-channels
  • People love idea of creating a physical good with an instalment of tokens and community curated proposals
  • A project that has a lot of value for designers and artists as a part of cultural goods production

+

“I have no idea how to create swag for MF to produce. I think I'm a good designer but who do I create it for? This solves it for me.”

!

5 of 20

SPRINT QUESTIONS

Can we prevent production process from being too complicated / nuanced to be able to automate / templatize?

  • Yes, the current interface creates a lot of transparency over the process and is a clear improvement over Discord.
  • Users had a few questions about the management, like who would take care of the manufacturing process.

6 of 20

SPRINT QUESTIONS

Can we stop ideas getting too diluted, overwhelming, getting lost?

  • Yes, although it could benefit from a few UX fixes related to the ordering of items on the list.
  • Users noticed the filter and pointed it out for being a very helpful tool, especially by brand and creator they like.
  • More visual indicators (brand icon, creator logo, product preview) could make scanning and selecting easier.

7 of 20

SPRINT QUESTIONS

Can we prevent the game theory curation from not working out and resulting in everyone abusing the same "strategy"? As a result, the best and most innovative ideas don’t make it to the top.

  • Difficult to predict and relies on the incentive and compensation structure.
  • Most testers seemed to be good actors and not interested in manipulating the market. They would browse for what is being curated by the collective and perceived the curation process as fair.
  • Ways to game the system:
    • Asking Drew (avoid nepotism)
    • Shilling on social media (introduce randomness or highlight less known artists)
    • Reverse engineering the prioritisation algorithm (less applicable here)

8 of 20

PROPOSALS LIST

!

  • Steep learning curve for newbies
  • Could benefit from more visual material such as product images (logos, user badges) to help memorise the content.
  • Several users had questions about the numbering

+

  • Simple and clean UI, straightforward flow
  • Clear actionable steps

9 of 20

PROPOSAL CREATION

+

  • The idea to submit an own product as a proposal is very interesting and exciting
  • Very easy to follow
  • The fact that any image, even a sketch can be submitted and rendered gives a lot of space for creativity

“This is cool!”

!

  • Users were interested in pricing and compensation models, especially related to brand collaborations.
  • Splitting up the proposal creation into several steps could provide more newbie-friendly information and let them save a draft, especially if they need to exit the app to take pictures.

10 of 20

UPDATED PROPOSALS FEED

!

  • The status of the proposal could be visually clearer, e.g. with “milestone” indicators.
  • Some testers were wondering what they should do next and what happens if their design gets approved.

+

  • A simple & easily digestible design and ranking. Really makes it easy to navigate through proposals.

11 of 20

PROPOSAL DETAILS

+

  • The Description & specs tab is great representation of the proposal and really stands out

!

  • Users would love to share their proposals via social media in order to increase publicity
  • Some users were interested in how the manufacturing process continues

12 of 20

PROPOSAL DETAILS Cont’d

!

  • Curators are duplicated
  • More information on the (financial) consequences of staking would help users make a decision whether to support

+

  • Users appreciate the idea for transparency in royalty percentage among the collaborators.
  • Giving credit to community members reinforces community spirit

13 of 20

PROPOSAL DETAILS Cont’d

+

  • Users appreciate the visual detallisation and the implementation of ROBOT

!

  • New users need more information on ROBOT before they would go to explore staking. Is there a reward?
  • Consider explaining the process of NFT retrieval
  • “Curation” has a quality connotation in the art world

“In the Art world people try to stay away from this term, it’s highly sophisticated work and could make you sound pretentious.”

14 of 20

RECOMMENDATIONS

  1. Add images to all the proposals.�
  2. Provide information about staking, royalties, branding collaboration, tokens and ROBOT rewards. Potentially as a separate landing page.�
  3. Experiment with real products and real users!

15 of 20

Important Files

16 of 20

How to run user interviews fast

A complete step-by-step guide on how to set up user interviews, find users, conduct the interview and review the feedback.

Read on Notion

17 of 20

Hypersprint Video Guide

A full Hypersprint video guide, explaining each step along the process with the Miro board. Can be also used as an interactive facilitator.

Watch online

18 of 20

Meeting Legos

A Miro board with workshop exercises, making it easy to copy-paste and compile your own workshop-meetings.

Open Miro board

Browse through our meeting templates to find a suitable for your meeting.��Browse meeting templates

19 of 20

Stay tuned and keep learning!

Join our community of product designers, user researchers, facilitators, founders, advisors and all kinds of experts on Discord.

Participate in our Community Hypersprints and help us build the future of creative work and open source design!

Join Discord

20 of 20

Thank you and have a wonderful day!