Robots & Runes
Information Architecture Redesign
1
1.
Overview
2
Introduction, Goals, and Personas
Introduction
The Problem
Robots & Runes is a web guide to Hugo and Nebula award-winning science fiction and fantasy literature. While the site offers rich content, its current information architecture creates friction for users trying to:
3
Users Experience:
Our Goal
Redesign the site’s information architecture to:
4
Core Content Areas:
Personas
5
Personas
6
Personas
7
2.
Testing Process
8
Content Inventory, Card Sort, and Tree Test
Test Overview
9
Content Inventory
Card Sort
IA Testing (Tree Tests)
1.
2.
3.
We documented all of the existing content on the site and then performed a content audit.
We conducted a pilot test and two formal rounds of testing to better understand how to organize the content on the site.
We conducted a pilot test and two formal rounds of testing to examine if users would be able to complete specific tasks.
Content Inventory
10
Process
We conducted a full audit of the existing site:
Key Findings
Actions Taken
Card Sort: Overview
11
Methodology
Participants
Cards & Categories
Card Sort: What We Tested
12
Card Sort Goal:
The goal of our card sort was to understand how user’s naturally group book discovery tools, awards content, blog content, and informational content.
Key Questions:
Card Sort: Results
13
Pilot Findings
This told us that labels were unclear and site structure did not reflect user expectations
Round 1
What improved?
New issues identified:
Users tended to group unclear items into vague categories
Round 2
What Changed?
Results
Users shared a consistent mental model.
Card Sort: Changes Across Rounds
14
Iterations
IA Testing (Tree Tests): Overview
15
Methodology
Participants
Goal
IA Testing (Tree Tests): Tasks
16
Tasks we tested:
Task 1: Book Discovery (Filtering)
Find a book using filters (genre, theme, etc) and view a result (in rounds 2,3).
Task 2: Awards Information
Find background information about the Nebula Awards.
Task 3: Blog Content
Find an article comparing a book to its film adaptation.
Task 4: About This Site
Find information that explains the purpose of the site.
Task Level Insights:
Task 1 - Filtering
Clearer labeling: Find Books By → Browse by Category → Browse & Filter Books
Task 2 - Awards
Task 3 - Blog Content
Task 4 - About This Site
IA Testing (Tree Tests): Results
17
Pilot Findings
Overall Performance:
Key Issues:
Takeaway:
Navigation structure was inconsistent and unclear.
Round 1
Overall Performance:
Successes by task:
We improved labeling, had better category separation, and stronger first click accuracy.
Takeaway:
IA changes led to usability improvement
Round 2
Overall Performance:
Successes by task:
Observed issues:
�Users tended to loop between the recommendations quiz and filtering. Some users took indirect paths leading to less directness.
3.
Site Map
18
Annotated Site Map and Description
19
Site Map: Structure & Strategy
20
Structure Overview
Top Level Navigation:
Key IA Decisions
Site Map: Evolution & Revisions
21
Result: Too many navigation choices and no starting point for book discovery.
Remaining issue: The filtering system is not clearly defined.
Site Map: Iteration & Testing Impact
22
Content Inventory
The findings from our content inventory revealed duplicate pathways, fragments award content, and unclear labels.
When refining the sitemap, we focused on consolidating and creating a clearer structure.
Card Sort Insights
Tree Test Insights
4.
Wireframes
23
Tasks and Annotated Wireframes
24
WIREFRAMES
Process
Challenges
Success
Our wireframing process was highly iterative and grounded in research at every stage.
We used insights from our heuristic evaluations, content inventory, usability testing to continuously inform design decisions. These methods helped us identify usability issues, gaps in structure, and pain points, which we translated into tangible design changes in our wireframes. Each iteration allowed us to refine, improve, and better align with user expectations.
We selected tasks to wireframe based on areas where users experienced most friction or confusion.
A key limitation was the inability to conduct prototype testing on our wireframes. We couldn’t observe how users interacted with our proposed designs or validate them. While our design decisions were informed by prior research, it lacked the final feedback that helps refine interaction details.
Our wireframes were effective because they were directly rooted in user data.
Our iterative process resulted in designs that more closely matched users’ needs.
25
Task 1
You want to browse books and narrow the results by genre, subgenre, decade, theme, and awards. How would you go about applying filters? Then select a book you’d like to learn more about.
WIREFRAMES
26
27
Task 2
You’re writing a paper and want to learn more about the Nebula Awards and their background. Where would you find information about the Nebula Awards?
WIREFRAMES
28
6.
Retrospective
29
Overall Process
Retrospective: Process & Learnings
30
What We Learned:
Throughout the project, our team gained a better understanding of how users’ mentally organize content. Particularly regarding book discovery tools like the recommendation quiz vs. filtering and the difference between content and features like Blog vs. Books. We developed experience conducting iterative IA testing; completing a content inventory, card sorting, and tree testing. This process emphasized how even small changes in labeling can significantly impact user success and usability.
What We Would Change:
If we were to approach this project again, we would increase the number of participants in our testing to strengthen the reliability of our data. We would also conduct moderated testing or interviews to better understand what users made certain navigation choices. Lastly, we would refine the relationship between filtering and recommendation tools earlier on, since this confusion persisted in our later rounds of testing and impacted efficiency.
Reflection:
This project reinforced the idea that effective information architecture requires continuous testing and iteration. Our final project design reflects a system that is user centered and data driven. From our work on this project, we have learned how to design not just for organization but for discovery and efficiency in order to ensure that users can easily navigate and explore the site.
Appendix
31
32
1.0 Content Inventory
Content that exists on the current version of the site: https://robotsandrunes.netlify.app
33
1.1 Card Sort Raw Data
Pilot Test
Categories: 7
Cards: 21
34
1.1 Card Sort Raw Data
Round 1
Categories: 6
Cards: 10
35
1.1 Card Sort Raw Data
Round 2
Categories: 4
Cards: 16
1.2 Heuristic Analysis
36
Page 1
1.2.1 Heuristic Analysis
37
Page 2
1.2.2 Heuristic Analysis
38
Page 3
1.2.3 Heuristic Analysis
39
Page 4
1.3 IA Testing Raw Data
40
Task 1: You just finished reading a sci-fi novel and want to find another award-winning book, but you’re not sure what to read next. You want to find a fantasy novel for your next read. Where would you go to filter only for fantasy novels?
Correct Answer: Books → Find Books By
Directness
Median Time Taken (measured in minutes)
Pilot Test
1.3.1 IA Testing Raw Data
41
Task 2: You’re writing a paper and want to learn more about the Nebula Awards and their background. Where would you find information about the Nebula Awards?
Correct Answer: Hugo & Nebula Awards → Explore Nebula History
Directness
Median Time Taken (measured in minutes)
Pilot Test
1.3.2 IA Testing Raw Data
42
Task 3: You recently watched a sci-fi movie and heard it was based on a book. You want to read an article comparing the original book to the film. Where would you go to compare books and film adaptations?
Correct Answer: Blog → Book vs. Fim Adaptations
Directness
Median Time Taken (measured in minutes)
Pilot Test
1.3.3 IA Testing Raw Data
43
Task 4: You just discovered Robots and Runes and want to understand its purpose and who created it. Where would you find information explaining what the site is and why it exists?
Correct Answer: About This Site → Where Did This Site Come From?
Directness
Median Time Taken (measured in minutes)
Pilot Test
1.3.4 IA Testing Raw Data
44
Task 1: You want to browse books and narrow the results by genre, subgenre, decade, theme, and awards. Where would you go to apply filters?
Correct Answer: Books → Browse by Category
Directness
Median Time Taken (measured in minutes)
Round 1
1.3.5 IA Testing Raw Data
45
Task 2: You’re writing a paper and want to learn more about the Nebula Awards and their background. Where would you find information about the Nebula Awards?
Correct Answer: Hugo & Nebula Awards → Explore Nebula History
Directness
Median Time Taken (measured in minutes)
Round 1
1.3.6 IA Testing Raw Data
46
Task 3: You recently watched a sci-fi movie and heard it was based on a book. You want to read an article comparing the original book to the film. Where would you go to compare books and film adaptations?
Correct Answer: Blog → Book vs. Film Adaptations
Directness
Median Time Taken (measured in minutes)
Round 1
1.3.7 IA Testing Raw Data
47
Task 4: You just discovered Robots and Runes and want to understand its purpose and who created it. Where would you find information explaining what the site is and why it exists?
Correct Answer: About This Site → Where Did This Site Come From?
Directness
Median Time Taken (measured in minutes)
Round 1
1.3.8 IA Testing Raw Data
48
Task 1: You’re interested in books about artificial intelligence and want to find a book that explores this theme. Use filtering tools to narrow down the
books, browse the results, and view a book to learn more about it.
Correct Answer: Books →Browse & Filter Books →Book Page
Directness
Median Time Taken (measured in minutes)
Round 2
1.3.9 IA Testing Raw Data
49
Task 2: You’re writing a paper and want to learn more about the Nebula Awards and their background. Where would you find information about the Nebula Awards?
Correct Answer: Hugo & Nebula Awards → Nebula Awards → Explore Nebula History
Directness
Median Time Taken (measured in minutes)
Round 2
1.3.10 IA Testing Raw Data
50
Task 3: You recently watched a sci-fi movie and heard it was based on a book. You want to read an article comparing the original book to the film. Where would you go to compare books and film adaptations?
Correct Answer: Blog → Books vs. Film
Directness
Median Time Taken (measured in minutes)
Round 2
1.3.11 IA Testing Raw Data
51
Task 4: You just discovered Robots and Runes and want to understand its purpose and who created it. Where would you find information explaining what the site is and why it exists?
Correct Answer: About This Site → Where Did This Site Come From?
Directness
Median Time Taken (measured in minutes)
Round 2
52
2.0 Site Map Draft #1
53
2.1 Site Map Draft #2
54
2.2 Site Map Final
55
56
3.0 Task 1 Wireframes
57
58
3.1 Task 2 Wireframes
59