| A | B | C | D | E | F | G | H | |
|---|---|---|---|---|---|---|---|---|
1 | ||||||||
2 | Vers. | 2026-03-08 | Cite: | Chandra, S., Seaborn, K., Barbareschi, G., Louie, W-Y. G., Bagchi, S., Cooper, S., Han, Z., and Tozadore, D. (2026). The RUSH Checklist: A Standardized Framework for Reporting User Studies in Human-Robot Interaction. Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction (HRI ’26). https://doi.org/10.1145/3757279.3785572 | ||||
3 | ||||||||
4 | The RUSH Checklist: A Standardized Framework for Reporting User Studies in Human-Robot Interaction | |||||||
5 | Section and Topic | Applicability | Item # | Checklist Item with Explaination | Where Reported | |||
6 | General information | |||||||
7 | 1 | Title | 1 | Specify the paper title. | ||||
8 | 2 | Author Names | Upon Publication | 2 | Specify the author names. | |||
9 | 3 | Author Institutions | Upon Publication | 3 | Specify the author institution(s) or place(s) of work while conducting the study, such as universities, research institutes, or companies. | |||
10 | 4 | City of Research | Upon Publication | 4 | Specify the geographical location(s) where the study was conducted. | |||
11 | 5 | Country of Research | Upon Publication | 5 | Specify the geographical location(s) where the study was conducted. | |||
12 | 6 | Study Dates | Only If Applicable to the Study | 6 | Specify the dates when the study was conducted. | |||
13 | 7 | Abstract | 7 | Describe the abstract with the following structure: Background, Purpose, Method, Results, Conclusion. | ||||
14 | 8 | Study Preregistration Link | Only If Applicable to the Study | 8 | Provide the study preregistration link. | |||
15 | 9 | Funding Statement | Upon Publication | 9 | Provide a declaration and description of funding information related to the research. If no funding was used, state so: "No funding to declare." | |||
16 | 10 | Conflict of Interest (COI) Statement | Upon Publication | 10 | Declare and describe financial, commercial, legal, or professional relationships with stakeholders that could influence the research. Examples of stakeholders include researchers, participants, and people in partnerships, etc. If there are no COI, state so: "No conflicts of interest to declare." | |||
17 | 11 | Author Contributions Statement | 11 | Specify the contributions by author. Contributions may include knowledge, methodology, technology, societal contributions, etc. A formal structure like CRediT (Contributor Roles Taxonomy) may be used (https://credit.niso.org). | ||||
18 | Introduction and Background | |||||||
19 | 12 | Background/Related Work | 12 | Provide an overview of prior research and existing knowledge relevant to the study. | ||||
20 | 13 | Motivation | 13 | Explain the rationale, research problem, and context driving the research. | ||||
21 | 14 | Objectives | 14 | State the specific objectives for conducting the user study. | ||||
22 | 15 | Research Questions | 15 | Outline the guiding questions associated with the study. | ||||
23 | 16 | Hypotheses | Only If Applicable to the Study | 16 | Describe the hypotheses (testable statements) associated with the research questions. | |||
24 | 17 | Significance and Contributions | 17 | Explain the importance of the study and its expected impact and contributions. | ||||
25 | 18 | Long-Term Goals | Only If Applicable to the Study | 18 | Outline the broader vision and future directions of the research. | |||
26 | Participants | |||||||
27 | 19 | Population | 19 a | Describe the intended population for which the study was initially designed. Examples include university students, children, online participants from crowdsourcing websites, etc. | ||||
28 | 20 | Only If Applicable to the Study | 19 b | Describe the actual population. | ||||
29 | 21 | 19 c | State the total number of participants recruited in the study. | |||||
30 | 22 | 19 d | Justify the number of participants with an explanation for why a specific number was included in the study. If applicable, use and provide a power analysis (Vankelecom, Schacht, Laroy, Loeys, & Moerkerke, 2025: https://doi.org/10.5334/pb.1318). | |||||
31 | 23 | 19 e | Specify the final number of participants who completed the study. | |||||
32 | 24 | Dropouts | 20 a | Specify the number of voluntary dropouts due to pre-screening criteria. Examples include self-selection, selection based on psychological data, etc. | ||||
33 | 25 | 20 b | Specify the number of dropouts due to pre-screening criteria. Examples include self-selection, selection based on psychological data, etc. | |||||
34 | 26 | 20 c | Specify the number of dropouts due to situations where the study (or study sessions) were interrupted or stopped. | |||||
35 | 27 | 20 d | Specify the number of participants removed from the study before the final analysis. | |||||
36 | 28 | Sex and Gender | Only If Applicable to the Study | 21 a | Distinguish sex and gender, and state whether one or both were captured; if sex was captured, include intersexes. Sex refers to biology, and gender refers to identity (Tannenbaum, Ellis, Eyssel, et al., 2019; https://doi.org/10.1038/s41586-019-1657-6). | |||
37 | 29 | 21 b | Allow multiple choices and an open text option for gender selection. If reporting gender in aggregate, allow the total percentage of gender categories to exceed 100% to accommodate participants of multiple genders. | |||||
38 | 30 | 21 c | Explicitly report each category of gender, as opposed to assuming binary gender as the default. For example, "Ten participants joined the study; 4 participants were women; 3 participants were men, 1 participant was non-binary; 1 did not disclose; and one participant self-described their gender as 'X-gender.'" Report if gender was self-identified or taken from other resources, like participant pool demographics. | |||||
39 | 31 | 21 d | Include a "prefer not to disclose" option to mitigate potential anxiety and avoid inaccurate responses. | |||||
40 | 32 | Age | Only If Applicable to the Study | 22 | Report age with means, medians, and ranges/categories. | |||
41 | 33 | Education | Only If Applicable to the Study | 23 | Specify relevant educational background(s). | |||
42 | 34 | Occupation | Only If Applicable to the Study | 24 | Specify occupation(s), which may include job role(s), employment status, or relevant occupational background(s). | |||
43 | 35 | Technology Familiarity | Only If Applicable to the Study | 25 | Specify experience levels with common technologies, like smartphones, tablets, and other devices. | |||
44 | 36 | Prior Robot Experience | Only If Applicable to the Study | 26 | Specify prior robot experience, such as approximate number of interactions or number of years. | |||
45 | 37 | Disability | Only If Applicable to the Study | 27 | Specify any relevant disabilities or accessibility considerations that may have influenced participation or findings. | |||
46 | 38 | Eligibility Criteria | Only If Applicable to the Study | 28 | Provide inclusion and exclusion criteria with justifications for each. For example, Italian speakers because of the language used by the robot or right-handed people because of the design of the robot. | |||
47 | 39 | Recruitment Method | 29 | Specify the recruitment method. Examples include mailing lists, bulletin board posting, class announcements, personal solicitation, word-of-mouth advertising, etc. | ||||
48 | 40 | Type of Setting(s) | 30 | Describe the type of setting(s) in which the research was conducted. Examples include lab, field, online participant pools, crowdsourcing platforms, etc. | ||||
49 | 41 | Compensation | 31 | Describe any remuneration provided to participants. Examples include vouchers, course credit, gift cards, cash, etc. If no renumeration was offered, state so and explain why not. | ||||
50 | 42 | Consent | Only If Applicable to the Study | 32 a | Include how consent was obtained. Examples include verbal agreement, digital sign-off, written in paper form, etc. | |||
51 | 43 | 32 b | Identify who provided consent. Examples include the participant, a caretaker, a guardian, a parent, a legal representative, etc. | |||||
52 | Study Design | |||||||
53 | 44 | Apparatus/Material | 33 | Specify the equipment, tools, and instruments, including the platform(s) used in the study, used to conduct study sessions, gather data, or perform measurements. Examples include robots, devices, survey platforms, etc. | ||||
54 | 45 | Robot | Only If Applicable to the Study | 34 a | Specify the total number of robot(s) used in the study. | |||
55 | For each robot, specify the following: | |||||||
56 | 46 | 34 b | Type of robot, e.g., Industrial, humanoid, mobile, etc. | |||||
57 | 47 | 34 c | Robot model, e.g., name, version, etc. | |||||
58 | 48 | 34 d | Level of autonomy, e.g., Wizard of Oz, semi-autonomous, fully autonomous, teleoperation, etc. | |||||
59 | 49 | 34 e | Reason for using the robot in the study. | |||||
60 | 50 | 34 f | Commercial robot or built for the study. | |||||
61 | 51 | 34 g | Picture of the robot. | |||||
62 | 52 | 34 h | Type of interaction, e.g., having a conversation, performing tasks together, etc. | |||||
63 | 53 | 34 i | Communication modality, e.g., speech, touchscreen, multimodal, language, etc. | |||||
64 | 54 | 34 j | Robot location, e.g., co-located robot, non-co-located robot, virtual robot, video, photo, text, none, etc. | |||||
65 | 55 | Study Design | Only If Applicable to the Study | 35 | Specify the study design. Indicate whether the study used a between-subjects and/or within-subjects design. | |||
66 | 56 | Conditions | Only If Applicable to the Study | 36 a | Specify the number of experimental conditions. | |||
67 | 57 | 36 b | Specify the number of participants assigned to each condition. | |||||
68 | 58 | Traning Details | Only If Applicable to the Study | 37 a | Describe how participants were trained before or during the study, including any training required to join the study. Examples include explanations and/or tutorials in an interface, guided interactions by facilitators, facilitators demonstrating interactions with the robot, practice rounds prior to actual data collection (e.g., hands-on demo, training video), etc. | |||
69 | 59 | 37 b | Specify the duration of participant training. | |||||
70 | 60 | 37 c | Specify the stopping criteria for participant training. | |||||
71 | 61 | Study Procedure | 38 | Describe the procedure followed to conduct a study session from beginning to end. | ||||
72 | 62 | Interaction Method | 39 | Specify how participants were able to interact with the system. Examples include live interaction, simulation, remote interaction, video, audio, images, etc. | ||||
73 | 63 | Study Setup | Only If Applicable to the Study | 40 | Describe the study setup. Include an image indicating the main components of the system used in the study. | |||
74 | 64 | Study Duration | 41 a | Specify the full session duration, including the data collection procedure. | ||||
75 | 65 | Only If Applicable to the Study | 41 b | Specify the duration of the participant-robot interaction. | ||||
76 | 66 | Only If Applicable to the Study | 41 c | Specify the frequency of interactions per week. | ||||
77 | 67 | Only If Applicable to the Study | 41 d | Specify how many breaks were included in the session. Recommendation: Number and duration of breaks within and between sesions. | ||||
78 | Ethical Conduct | |||||||
79 | 68 | Name of the Review Board | Only If Applicable to the Study | 42 | Specify the name of the ethics board or institutional review board that reviewed the study. If not required, provide reasons why ethical review was not needed. | |||
80 | 69 | Ethical Approval Statement and Number | Only If Applicable to the Study | 43 | Provide the ethical approval statement and number. | |||
81 | 70 | Informed Consent | 44 | Describe how informed consent was obtained from participants. | ||||
82 | 71 | Data Protection and Privacy | Only If Applicable to the Study | 45 | Describe how participant data were protected and managed in compliance with privacy regulations. | |||
83 | 72 | Deception or Partial Disclosure | Only If Applicable to the Study | 46 | Describe the deception used or partial disclosure of deception. Deception means hiding or misleading participants about the study, while partial disclosure means failing to provide all information. For example, the study involved interaction with a robot that lied, unbeknownst to participants, in order to observe natural reactions. | |||
84 | 73 | Debriefing | Only If Applicable to the Study | 47 | Explain how participants were informed about any deception and/or the true purpose of the study after participation. | |||
85 | Data Collection | |||||||
86 | 74 | External Recording Devices Used | Only If Applicable to the Study | 48 | Specify any external devices used to record participant behavior or responses, e.g., camera, microphones, etc. | |||
87 | 75 | Additional Synthesis of Recordings to Collect Data | Only If Applicable to the Study | 49 | Describe any additional methods applied to recordings to extract data, like manual coding processes. | |||
88 | 76 | Sensors Used on Participants | Only If Applicable to the Study | 50 | Specify sensors attached to participants to collect data or track interactions, e.g., physiological sensors, EEG, etc. | |||
89 | 77 | Questionnaires | Only If Applicable to the Study | 51 a | List the standard questionnaires used in the study. | |||
90 | 78 | Only If Applicable to the Study | 51 b | Describe any custom questionnaires developed specifically for the study. | ||||
91 | 79 | Only If Applicable to the Study | 51 c | Specify the modifications made to response options in standard questionnaires. | ||||
92 | 80 | Only If Applicable to the Study | 51 d | Describe any modifications to items in standard questionnaires. | ||||
93 | 81 | Interviews | Only If Applicable to the Study | 52 | Describe any interview methods. | |||
94 | 82 | Observations | Only If Applicable to the Study | 53 | Describe any observational methods. | |||
95 | 83 | Analysis Framework | 54 | Specify the framework or approach used to analyze the qualitative and/or quantitative data. | ||||
96 | 84 | Data Processing | 55 | Describe how the raw data was processed, e.g., transcription, data entry, etc. | ||||
97 | 85 | Coding | Only If Applicable to the Study | 56 | Describe any coding procedures for the data used for anlaysis. | |||
98 | 86 | Statistics | Only If Applicable to the Study | 57 | Specify if a NHST (Null Hypothesis Statistical Test) was used. | |||
99 | 87 | 58 | Detail the type(s) of descriptive statistics generated. | |||||
100 | 88 | 59 | Specify the specific statistical procedures used, ee.g., parametric or non-parametric tests, post hoc analyses, corrections, etc. | |||||