User Story Quality Assessment Based on
Multi-dimensional Perspective: A Preliminary Framework
iStar 2022 : The 15th International i* Workshop
Tianci Wang1 , Chunhui Wang*1 , Tong Li*2 , Zhiguo Liu1 , Ye Zhai1
1 College of Computer Science and Technology , Inner Mongolia Normal University , Hohhot , China
2 Faculty of Information Technology , Beijing University of Technology , Beijing , China
Outline
1
Background
Method
Conclusions & Future work
2
3
In agile development, 90 % of practitioners adopt user stories written in natural language to express their requirements[1].
User Story: is a widely adopted requirements notation in agile development
1. Background
[1] Lucassen G, Dalpiaz F, Werf J M, et al. The Use and Effectiveness of User Stories in Practice. 2016.
As a <type of user>, I want to/can/would like <some intention>, [so that <some reason>/<benefit>]
actor who uses the system
what task/goal wants to achieve
why a goal or quality to achieve
1. Background
User stories are written in structured natural languages.
Accuracy of requirements analysis.
Slow down the development plan.
Negative impact：
Ambiguity and Inconsistency.
1. Background
To deal with these negative effects.
[1] Lucassen G, Dalpiaz F, Werf J M, et al. The Use and Effectiveness of User Stories in Practice. 2016.
Cited References | Author | Contribution | |
[1] User Stories Applied For Agile Software Development | Wake B | The INVEST characteristics of user stories | |
[2] A quality framework for agile requirements: A practitioner’s perspective | Heck P | 15 quality criteria | Grammatical check |
[3] Improving agile requirements: the quality user story framework and tool | Lucassen G | 13 quality criteria | |
Detection of semantics.
11 quality criteria.
2. Method
1. Natural language processing
2. iStar Model
The method used in this paper is divided into the following two parts:
Consistency analysis
Component completeness analysis
Testability analysis
2. Method
11 quality criteria
2. Method
2. Method
2. Method
2. Method
2. Method
2. Method
2. Method
Uniqueness check:
example:
US1: As a user I want to see a list of news items so that I can easily refer to.
US2: As a user I want to refer to the list of news items so that I can find it easily.
iStar Model:
2. Method
Conflict-free check:
example:
US3: As a user I want to search books so that I can find the books I want to buy.
US4: As a user I want to look for books so that I can see if it exists.
iStar Model:
2. Method
Estimable check:
If there are some isolated nodes, i.e., it has no connections to other nodes, and has no refinement or contribution relationships, we consider that it may violate the estimable criterion.
Independence check & Conceptually sound check:
example:
US5: As a User I want to open the interactive map so that I can see the location of landmarks.
US6: As a User I want to view the location of landmarks so that I can know where I am.
iStar Model:
2. Method
2. Method
Well-formed check:
I want to see an error when I cannot see recommendations after I upload an article.
Uniformity check:
Receive an email notification when a new user is registered.
√
As a user I want to see an error when I cannot see recommendations after I upload an article.
×
As a user I want to receive an email notification when a new user is registered.
×
√
2. Method
Full sentence check:
Atomicity check:
√
√
As a user I want to view the interface to be consistent so that there is no confusion.
As a user I want to click on a location on the map.
As a user I want to perform a search for the landmark.
As a user I want to the interface to be consistent so that there is no confusion.
×
As a user I want to click on a location on the map and perform a search for the landmark.
×
2. Method
Minimal check:
Unambiguous check:
√
√
As a care professional I want to see the registered hours of this week.
As a registered user I want to view doctor visit the information so that select the appropriate doctor.
As a care professional I want to see the registered hours of this week (split into products and activities). See: Mockup from Alice NOTE—first create the overview screen—then add validations.
×
As a registered user I want to view doctor details so that select the appropriate doctor.
×
3. Conclusion & Future work
Improve the quality of user stories.
A combination of NLP and iStar models was used for quality assessment.
11 quality criteria are proposed.
3. Conclusion & Future work
We plan to develop a prototype tool that implements our proposed framework.
We will examine the impact of our i * based model on improving the quality of user stories.
Thank you!