| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Title | Author(s) | Publication Forum | Date | Affiliation | Citations (June 1, 2012) | Type of Links | Preprocessing (NL) | Preprocessing (Code) | Feature Ext. (NL) | Feature Ext. (Code) | IR Model | Enhancement Strategies | Tool Name | Datasets | Context Level | Method/Humans | Evaluation Style | Inferential Statistics | Comparisons | PR@N | PR@Fixed | PR@Sim0.7 | PR@Other |
2 | Recovering Traceability Links between Code and Documentation | Antoniol, Canfora, De Lucia, Merlo | Transactions on Software Engineering | 2002 | University of Sannio | 486 | Code-Reqs, Code-Man (Code gran: class) | Stop words, stemming, ID splitting | Stop words, stemming, ID splitting | Binary, TFIDF | IDs | Prob (BIM), VSM | Univ: LEDA (296), Stud: Albergate (116) (Italian) | Level 1 case studies. Level 3 experiments (8 student subjects) | Methods. Humans. | Query | No | Prob--VSM | Yes | No | No | No | ||
3 | Advancing Candidate Link Generation for Requirements Tracing: The Study of Methods | Hayes, Dekhtyar, Sundaram | Transactions on Software Engineering | 2006 | University of Kentucky | 205 | Req-Req | Stop words, stemming | N/A | TFIDF | N/A | VSM, LSI (k=10 (MODIS), 100 (CM-1)) | Thesaurus, relevance feedback | RETRO | Ind: MODIS (68), CM-1 (455). | Level 2 experiment. simulated feedback. Selectivity, Lag | Methods | Matrix | LSI-->VSM (Feedback improves VSM and LSI) | No | No | No | Yes | |
4 | Improving Requirements Tracing via Information Retrieval | Hayes, Dekhtyar, Osborne | International Conference on Requirements Engineering | 2003 | University of Kentucky | 169 | Req-Req | Stop words, stemming | N/A | TFIDF | N/A | VSM | Phrasing, Thesaurus | Ind: MODIS (68) | Level 1 study. Compares to expert working manually. | Methods | Query, Matrix | No | No | No | Yes | |||
5 | Recovering traceability links in software artifact management systems using information retrieval methods | De Lucia, Fasano, Oliveto, Tortora | Transactions on Software Engineering and Methodology | 2007 | University of Salerno | 140 | Code-req, req-req | Stop words, ID splitting | ID splitting | TFIDF | Unclear | LSI (k=30-100%) | ADAMS ReTrace | Stud: (Multiple different student projects) | Level 4 case study (150 student subjects) | Humans | N/A | No | Yes | Yes | No | |||
6 | Utilizing Supporting Evidence to Improve Dynamic Requirements Traceability | Cleland-Huang, Settimi, Duan, Zou | International Conference on Requirements Engineering | 2005 | DePaul University | 99 | Req-Req | Stop words, stemming | Unclear | Unclear | Unclear | Prob (IN) | Document structure, Clustering, Graph pruning | Poirot: TraceMaker | Univ: IBS (252), EBT (114), LC (61) | Level 1 study | Methods | Matrix | No | No | No | No | Yes | |
7 | Best Practices for Automated Traceability | Cleland-Huang, Berenbach, Clark, Settimi, Romanova | Computer | 2007 | DePaul University | 79 | Reqs-Reqs, Reqs-Code | Unclear | Unclear | Unclear | Unclear | Prob (IN) | POIROT: TraceMaker | Ind: Siemens Logistics and Automation (?), Univ: IBT (255), EBT (114) | Level 1 experiments | Methods | Matrix | No | No | No | No | Yes | ||
8 | Helping Analysts Trace Requirements: An Objective Look | Hayes, Dekhtyar, Sundaram, Howard | International Conference on Requirements Engineering | 2004 | University of Kentucky | 74 | Req-Req | Unclear | N/A | TFIDF | N/A | VSM | Thesaurus, relevance feedback | RETRO | Ind: MODIS (68) | Level 2 study. Simulated feedback. Lag, DiffAR etc. | Methods | Matrix | No | No | No | Yes | ||
9 | Can LSI help Reconstructing Requirements Traceability in Design and Test? | Lormans, van Deursen | Conference on Software Maintenance and Reengineering | 2006 | Delft University of Technology | 70 | Reqs-Reqs, Reqs-Test | Stop words, stemming | N/A | Unclear | N/A | LSI (k=20%) | TMG toolbox, Trace Reconstructor and Trace Explorer. | Stud: PacMan (46), Callisto (unclear), Ind: Philips (359). | Level 1 case studies | Methods | Matrix | No | No | No | Yes | |||
10 | Supporting software evolution through dynamically retrieving traces to UML artifacts | Settimi, Cleland-Huang, Khadra, Mody, Lukasik, DePalma | International Workshop on Principles of Software Evolution | 2004 | DePaul University | 68 | Req-Code-Test | Stop words, stemming | Unclear | TFIDF | Unclear | VSM | Thesaurus | Univ: EBT (138) | Level 1 experiment | Methods | Matrix | No | No | No | No | Yes | ||
11 | Enhancing an Artefact Management System with Traceability Recovery Features | De Lucia, Fasano, Oliveto, Tortora | International Conference on Software Maintenance | 2004 | University of Salerno | 64 | Req-Code-Test | ID splitting | ID splitting | Unclear | Unclear | LSI (k=10-50%) | ADAMS ReTrace | Stud: EasyClinic (150) | Level 1 case study | Methods | No | No | Yes | Yes | ||||
12 | Recovery of Traceability Links Between Software Documentation and Source Code | Marcus, Maletic, Sergeyev | International Journal of Software Engineering and Knowledge Engineering | 2005 | Kent State University | 58 | Code-Req, Code-Man (Code gran: File, class) | Stop words | Stop words, ID splitting | Unclear | Unclear | LSI (N/A) | Univ: LEDA (228-803), Stud: Albergate (73) (Italian) | Level 1 case studies | Methods | VSM-->LSI, Prob-->LSI | Yes | No | Yes | No | ||||
13 | Recovering Code to Documentation Links in OO Systems | Antoniol, Canfora, De Lucia, Marlo | Working Conference on Reverse Engineering | 1999 | University of Sannio | 44 | Code-Man (Code gran: class) | Stop words | Stop words, Code2AOL translation | Binary | Ids | Prob (BIM) | Univ: LEDA (296) | Level 1 case study | Methods | No | No | No | Yes | |||||
14 | Fine grained indexing of software repositories to support impact analysis | Canfora, Cerulo | International Workshop on Mining software repositories | 2006 | University of Sannio | 40 | Code-CR (Code gran: File and Line) | Stop words, stemming | Okapi | TF of commit comments and previous CRs. | BM25 | Jimpa (Eclipse plugin) | OS: Gedit (233), ArgoUML (2208), Firefox (680) | Level 1 case study | Methods | Query | Yes | No | No | No | ||||
15 | ADAMS Re-Trace: A Traceability Recovery Tool | De Lucia, Fasano, Oliveto, Tortora | European Conference on Software Maintenance and Reengineering | 2005 | University of Salerno | 38 | Req-Code-Test | Stop words, identifier splitting | Unclear | Unclear | Unclear | LSI (N/A) | ADAMS retrace | Stud: (48, 50, 54, 55, 73, 74, 111), Italian | Level 4 case study with students divided in 7 projects. | Humans | N/A | N/A | N/A | N/A | N/A | |||
16 | On the Equivalence of Information Retrieval Methods for Automated Traceability Link Recovery | Oliveto, Gethers, Poshyvanyk, De Lucia | International Conference on Program Comprehension | 2010 | University of Salerno | 36 | Code-Req | Stop words, stemming | Unclear | TFIDF | Unclear | VSM, LSI (N/A), JS, LDA | Stud: EasyClinic (77), eTour (174) | Level 1 case study | Methods | LDA-->(VSM--LSI--LM) | Yes | No | No | No | ||||
17 | Incremental Approach and User Feedbacks: a Silver Bullet for Traceability Recovery | De Lucia, Oliveto, Sgueglia | International Conference on Software Maintenance | 2006 | University of Salerno | 33 | Req-Req, Req-Code-Test | Stop words, ID splitting | Unclear | Log Entropy | Unclear | VSM, LSI (k=10,19 (MODIS), 60 (EasyClinic), Best: 19,60) | Relevance feedback | ADAMS Re:Trace | Ind: MODIS (68), Stud: EasyClinic (150) (Italian) | Level 1 case study. Simulated feedback. | Methods | Matrix | LSI-->VSM, VSM--LSI | No | Yes | No | No | |
18 | Assessing IR-based traceability recovery tools through controlled experiments | De Lucia, Oliveto, Tortora | Empirical Software Engineering | 2009 | University of Salerno | 30 | Reqs-Code-Test | Unclear (refs) | Unclear | Unclear | Unclear | LSI (N/A) | ADAMS retrace | Stud: EasyClinic (150) | Level 3 experiment (20+12 students) | Humans | N/A | Yes | LSI better than manual work (time significatly reduced) | N/A | N/A | N/A | N/A | |
19 | A machine learning approach for tracing regulatory codes to product specific requirements | Cleland-Huang, Czauderna, Gibiec, Emenecker | International Conference on Software Engineering | 2010 | DePaul University | 30 | Reqs-Reqs | Stop words, stemming | N/A | Unclear | N/A | Prob (IN) | Machine learning | Mixed: Health regulations (254) | Level 2 experiment. Avg prec. No humans. | Methods | No | No | No | No | ||||
20 | Can Information Retrieval Techniques Effectively Support Traceability Link Recovery? | De Lucia, Fasano, Oliveto, Tortora | International Conference on Program Comprehension | 2006 | University of Salerno | 29 | Reqs-Code-Test, Reqs-Code, Manual-Code | Unclear | Unclear | Unclear | Unclear | LSI (N/A) | ADAMS Re:Trace | Stud: EasyClinic (150), Univ: ADAMS (309), LEDA (803). | Level 1 case study. Level 4 experience report with humans (150 student subjects). | Methods. Humans. | Matrix | No | No | Yes | Yes | |||
21 | Tracing Object-Oriented Code into Functional Requirements | Antoniol, Canfora, De Lucia, Casazza, Merlo | International Workshop on Program Comprehension | 2000 | University of Sannio | 29 | Code-Reqs | Stop words, stemming, id splitting | Stop words, stemming, id-splitting | Binary | IDs | Prob (BIM) | Stud: Albergate (76) Italian | Level 1 case study | Methods | Query | No | Yes | No | No | No | |||
22 | A Traceability Technique for Specifications | Abadi, Nisenson, Simionovici | International Conference on Program Comprehension | 2008 | IBM Haifa Research Lab | 29 | Code-Req (Code gran: class) | Stop words, stemming | Stop words, stemming, splitting | Binary, TF, TFIDF, log entropy, ig, ig-idf | Class name + comments, public function names + comments, arguments, return types | VSM, LSI (k=5-100, Best: 16 (SCA), 96 (CORBA)), PLSI, SDR, JS | OS: SCA (1311), CORBA (3340) | Level 2 experiment. No humans. Mean average precision. | Methods | Query | PLSI-->(VSM,LSI,LM,SDR), LSI-->(VSM,SDR,LM), SDR-->(VSM,LM), VSM--LM | Yes | No | No | No | |||
23 | Software traceability with topic modeling | Asuncion, Asuncion, Taylor | International Conference on Software Engineering | 2010 | University of California, Irvine | 29 | Unclear | Stop words, stemming | Unclear | Unclear | Unclear | LSI (k=10), LDA | Univ: ArchStudio (unspecified), Stud: EasyClinic (160) | Level 1 case study | Methods | Matrix | No | LSI-->LDA | No | Yes | No | No | ||
24 | Speeding up Requirements Management in a Product Software Company: Linking Customer Wishes to Product Requirements through Linguistic Engineering | Natt och Dag, Gervasi, Brinkkemper, Regnell | International Requirements Engineering Conference | 2004 | Lund University | 29 | Reqs-Reqs | Stop words, stemming | N/A | TF | N/A | VSM | N/A | Ind: Baan (12083) | Level 2 case study | Methods | Other | No | No | No | No | |||
25 | Clustering support for automated tracing | Duan, Cleland-Huang | International conference on Automated software engineering | 2007 | DePaul University | 28 | Req-Code, Req-Req | Stop words, stemming | N/A | Unclear | N/A | Prob (IN) | Clustering | POIROT | Univ: Ice-Breaker System (185) | Level 1 case study | Methods | No | No | No | No | |||
26 | Text mining for software engineering: how analyst feedback impacts final results | Hayes, Dekhtyar, Sundaram | International Workshop on Mining software repositories | 2005 | University of Kentucky | 27 | Reqs-Reqs | N/A | N/A | N/A | N/A | N/A | N/A | Ind: MODIS (68) | Level 3 experiment (HUMANS) | Humans | N/A | N/A | N/A | N/A | N/A | |||
27 | A feasibility study of automated natural language requirements analysis in market-driven development | Natt och Dag, Regnell, Carlshamre, Andersson, Karlsson | International Conference on Requirements Engineering | 2002 | Lund University | 26 | Req-Req | Stop words, stemming | N/A | TF | N/A | VSM | Ind: Telelogic (1888, 1088) | Level 1 study | Methods | No | No | No | No | |||||
28 | Implementation of an Efficient Requirements Analysis Supporting System Using Similarity Measure Techniques | Park, Kim, Ko, Seo | Information and Software Technology | 2000 | Sogang University | 26 | Reqs-Reqs | Unclear | N/A | Lexical affinity | N/A | Sliding window, syntactic parser | Ind: Unclear (33) Korean | Level 1 experiment | Methods | Other | No | No | No | No | ||||
29 | Traceability Recovery in RAD Software Systems | Di Penta, Gradara, Antoniol | International Workshop on Program Comprehension | 2002 | University of Sannio | 25 | Code-Req (Code gran: class) | Stop words, stemming | Stop words, stemming, ID splitting | TF | Ids, comments | Prob (BIM) | Univ: Transient Meter (49) | Level 1 case study | Methods | No | No | No | No | |||||
30 | REquirements TRacing On target (RETRO): improving software maintenance through traceability recovery | Hayes, Dekhtyar, Sundaram, Holbrook, Vadlamudi, April | Innovations in Systems and Software Engineering | 2007 | University of Kentucky | 23 | Req-Req | Stop words, stemming | N/A | TFIDF | N/A | VSM | Relevance feedback | RETRO | Ind: CM-1 (74) | Level 3 case (30 student subjects) | Humans | N/A | Yes | No | No | No | No | |
31 | Phrasing in Dynamic Requirements Trace Retrieval | Zou, Settimi, Cleland-Huang | International Computer Software and Applications Conference | 2006 | DePaul University | 22 | Code-Req (Code gran: class) | Stop words, stemming | Unclear | Unclear | Unclear | Prob (IN) | Phrasing, project glossary | Univ: IBS (235), Light Control System (59), EBT (93) | Level 1 experiment | Methods | Matrix | No | No | No | Yes | |||
32 | Combining Textual and Structural Analysis of Software Artifacts for Traceability Link Recovery | McMillan, Poshyvanyk, Revelle | Internation Workshop on Traceability in Emerging Forms | 2009 | The College of William and Mary | 21 | Code-Req (Code gran: method) | Stop words, stemming | Unclear | TF | Unclear | LSI (k=15, 25, 50, 75, best: 75) | Structural analysis | Univ: CoffeeMaker (143) | Level 1 case study | Methods | Matrix | No | Yes | No | No | |||
33 | Tracing requirements to defect reports: an application of information retrieval techniques | Yadla, Hayes, Dekhtyar | Innovations in Systems and Software Engineering | 2005 | University of Kentucky | 20 | Defects-Reqs | Stop words | N/A | TFIDF | N/A | VSM | Relevance feedback | RETRO | Ind: CM-1 (68), CM-1 (118) | Level 2 Experiment (LAG, diffAR, selectivity, simulated feedback) | Methods | No | No | No | No | No | ||
34 | Automated Requirements Traceability: the Study of Human Analysts | Cuddeback, Dekhtyar, Hayes | International Requirements Engineering Conference | 2010 | California Polytechnic State University | 18 | Reqs-Test | Unclear (refs) | N/A | TFIDF | N/A | VSM | RETRO | OS: BlueJ Plugin (49) | Level 3 experiment. (26 student subjects.) | Humans | N/A | N/A | N/A | N/A | N/A | |||
35 | Incremental Latent Semantic Indexing for Automatic Traceability Link Evolution Management | Jiang, Nguyen, Chen, Jaygarl, Chang | International Conference on Automated Software Engineering | 2008 | Iowa State University | 18 | Code-Req (Code gran: file) | Stop words | Unclear | TFIDF | Unclear | LSI (k=10%) | Incremental approach (performance) | TLEM | Univ: LEDA (634) | Level 1 experiment | Methods | Query | Yes | No | No | No | ||
36 | Understanding how the requirements are implemented in source code | Zhao, Zhang, Liu, Juo, Sun | Asia-Pacific Software Engineering Conference | 2003 | Peking University | 18 | Code-Req (Code gran: functions) | Stop words, stemming | ID splitting, stop words, stemming | TFIDF of nouns and verbs | Identifiers | VSM | Analysis of call graph | OS: Desktop Calculator (123) | Level 1 experiment | Methods | Query | No | Yes | No | No | No | ||
37 | Make the Most of Your Time: How Should the Analyst Work with Automated Traceability Tools? | Dekhtyar, Hayes, Larsen | International Workshop on Predictor Models in Software Engineering | 2007 | University of Kentucky | 17 | Req-Req | Unclear | N/A | TFIDF | N/A | VSM | Relevance feedback | Ind: CM-1 (455) | Level 2 experiment (selectivity, simulated feedback) | Humans | N/A | N/A | N/A | N/A | N/A | |||
38 | IR-Based Traceability Recovery Processes: An Empirical Comparison of "One-Shot" and Incremental Processes | De Lucia, Oliveto, Tortora | International Conference on Automated Software Engineering | 2008 | University of Salerno | 17 | Code-Req, Req-Test | Unclear (refs) | Unclear | Unclear | Unclear | LSI (N/A) | ADAMS Re-Trace | Stud: EasyClinic (150) Italian | Level 3 controlled experiment (30 student subjects) | Humans | N/A | Yes | N/A | N/A | N/A | N/A | ||
39 | Improving Automated Requirements Trace Retrieval: A Study of Term-Based Enhancement Methods | Zou, Settimi, Cleland-Huang | Empirical Software Engineering | 2010 | DePaul University | 17 | Req-Req, Req-Code | Stop words, stemming | Unclear | TFIDF | Unclear | Prob (IN) | Query Term Coverage, Phrasing, Project Glossary | Ind: CM-1 (455), Univ: IBS (235), EBT (93), LC (89), Stud: SE450 (521) | Level 2 study. No humans. Avg. Prec. Change | Methods | Matrix | No | Yes | No | No | |||
40 | Baselines in requirements tracing | Sundaram, Hayes, Dekhtyar | Workshop on Predictor models in software engineering | 2005 | University of Kentucky | 16 | Req-Req | Unclear | N/A | TFIDF | N/A | VSM, LSI (k=10,19,29, Best: 10 (MODIS), 100,200 (CM-1)) | Thesaurus, relevance feedback | RETRO | Ind: CM-1 (455), MODIS (68) | Level 2 experiment. Simulated feedback, selectivity | Methods | VSM--LSI | No | No | No | Yes | ||
41 | Monitoring Requirements Coverage Using Reconstructed Views: An Industrial Case Study | Lormans, Gross, van Deursen, Stehouwer, van Solingen | Working Conference on Reverse Engineering | 2006 | Delft University of Technology | 11 | Req-Test | Unclear | N/A | Unclear | N/A | LSI (N/A) | ReqAnalyst | Ind: LogicaCMG (219) | Level 1 case study | Methods | Matrix | No | No | No | Yes | |||
42 | Challenges for semi-automatic trace recovery in the automotive domain | Leuser | International Workshop on Traceability in Emerging Forms of Software Engineering | 2009 | Daimler AG | 11 | Req-Req | Stop words, stemming | N/A | TFIDF | N/A | VSM, LSI (N/A) | Voting | Ind: Daimler AG (1500) German | Level 1 study | Methods | No | No | No | No | ||||
43 | On the role of the nouns in IR-based traceability recovery | Capobianco, De Lucia, Oliveto, Panichella, Panichella | International Conference on Program Comprehension | 2009 | University of Salerno | 11 | Req-Code-Test | Stop words, ID splitting | Unclear | All terms. All nouns. Unclear. | Unclear | LSI (N/A), JS | Stud: EasyClinic (150). Italian and translated to English. | Level 1 case study | Methods | Matrix | Yes | LSI--LM | No | Yes | No | No | ||
44 | An experiment on linguistic tool support for consolidation of requirements from multiple sources in market-driven product development | Natt och Dag, Thelin, Regnell | Empirical software engineering | 2006 | Lund University | 10 | Reqs-Reqs | Stop words, stemming | N/A | TF | N/A | VSM | ReqSimile | Stud: PUSS (299) | Level 3 experiment | Humans | N/A | Yes | Keywords VSM --> Auto VSM | N/A | N/A | N/A | N/A | |
45 | An Industrial Case Study in Reconstructing Requirements Views | Lormans, van Deursen, Gross | Empirical Software Engineering | 2008 | Delft University of Technology | 9 | Reqs-Reqs, Reqs-Test, Test-Test | Stemming | N/A | Unclear | N/A | LSI (k=40%) | ReqAnalyst | Ind: LogicaCMG (219) | Level 1 case study | Methods | Matrix | No | No | No | Yes | |||
46 | Towards Mining Replacement Queries for Hard-to-Retrieve Traces | Gibiec, Czauderna, Cleland-Huang | International conference on Automated Software Engineering | 2010 | DePaul University | 9 | Req-Req | Stop words, stemming | N/A | Unclear | N/A | VSM | Query expansion | Poirot | Mixed: Health regulations (254) | Level 2 experiment | Methods | Other | No | No | No | No | ||
47 | Trace retrieval for evolving artifacts | Winkler | International Workshop on Traceability in Emerging Forms of Software Engineering | 2009 | FernUniversität Hagen | 8 | Req-Req | Stop words, stemming | N/A | TFIDF | N/A | LSI (k=15%) | Using historical data to predict changes | Ind: Robert Bosch GmbH (>500), MODIS (68) | Level 1 experiments | Methods | Matrix | No | No | No | Yes | Yes | ||
48 | Recovering Relationships between Documentation and Source Code based on the Characteristics of Software Engineering | Wang, Lai, Liu | International Workshop on Harnessing Theories for Tool Support in Software | 2009 | Beihang University | 8 | Code-Man, Code-Reqs (Code gran: class) | Stop words | ID splitting, stop words. | TFIDF | Ids and comments. | LSI (N/A), Prob (BIM) | Clustering, thesaurus, identifier classification, hierarchies, relevance feedback | Univ: LEDA (597), Univ: IBS (270) | Level 1 experiment | Methods | Query | No | Prob-->LSI | Yes | No | No | No | |
49 | Traceability Recovery using Numerical Analysis | Capobianco, De Lucia, Oliveto, Panichella, Panichella | Working Conference on Reverse Engineering | 2009 | University of Molise | 8 | Code-Req, Code-Test (Code gran: class) | Stop words, stemming | Unclear | Only nouns. Unclear weighting. | Unclear | VSM, LSI (N/A), JS, B-splines | Stud: EasyClinic (150) (Italian and English) | Level 1 experiment | Methods | Matrix | Yes | (VSM--LSI)-->B-splines, LM--B-splines | No | Yes | No | No | ||
50 | Assessing Traceability of Software Engineering Artifacts | Sundaram, Hayes, Dekhtyar, Holbrook | Requirements Engineering | 2010 | Microsoft Redmond | 7 | Reqs-Reqs | Unclear | N/A | TFIDF, Okapi, LTU | N/A | VSM, LSI (k=10,25,30,40,60 (MODIS), 10,25,100,200,400 (CM-1), 5,10,15,25,40 | Thesaurus, relevance feedback | RETRO | Ind: MODIS (68), CM-1 (455), Stud: 22* Waterloo (65) | Level 2 experiments. Simulated feedback. DiffAR, DiffMR, Lag, Selectivity | Methods | Yes | LSI-->VSM | No | No | No | Yes | |
51 | Requirement-centric traceability for change impact analysis: A case study | Li, Li, Yang, Li | International Conference on Software Process | 2008 | Chinese Academy of Sciences | 7 | Code-Req (Code gran: Class) | Google Translate Chinese-English | Unclear | Unclear | Unclear | VSM | Thesaurus, existing links | Unclear: Requirements Management System (501) | Level 4 case study. No humans. | Methods | N/A | No | No | No | No | |||
52 | Technique Integration for Requirements Assessment | Dekhtyar, Hayes, Sundaram, Holbrook, Dekhtyar | International Requirements Engineering Conference | 2007 | University of Kentucky | 6 | Req-Req | Unclear | N/A | TFIDF | N/A | VSM, LSI (N/A), Prob (BIM), Chi2 key extraction, LDA | Voting | Ind: CM-1 (455) | Level 1 study | Methods | N/A | N/A | N/A | N/A | N/A | |||
53 | How do we trace requirements: an initial study of analyst behavior in trace validation tasks | Kong, Hayes, Dekhtyar, Holden | International workshop on Cooperative and human aspects of software engineering | 2011 | University of Kentucky | 6 | Reqs-Test | N/A | N/A | N/A | N/A | N/A | N/A | RETRO.NET | OS: BlueJ plugin (49) | Level 3 experiment (log analysis) | Humans | N/A | No | No | No | No | ||
54 | Application of Swarm Techniques to Requirements Engineering: Requirements Tracing | Sultanov, Hayes | International Requirements Engineering Conference | 2010 | University of Kentucky | 4 | Reqs-Reqs | Stop words, stemming | N/A | TFIDF | N/A | VSM, Swarm | Univ: PINE, (182), Ind: CM-1 (455) | Level 1 study | Methods | VSM-->Swarm, VSM--Swarm | No | No | Yes | No | ||||
55 | On Integrating Orthogonal Information Retrieval Methods to Improve Traceability Recovery | Gethers, Oliveto, Posyvanyk, De Lucia | International Conference on Software Maintenance | 2011 | The College of William and Mary | 4 | Code-Req, Code-Test | Stopwords, stemming, ID splitting | Unclear | TFIDF | Unclear | VSM, LM, RTM | Voting | Stud: eAnsi (194) (Italian), eAnsi (67), EasyClinic (57) (Italian), EasyClinic (100), eTour (232), SMOS (167) | Level 1 case study | Methods | Matrix | Yes | VSM--LM, VSM--RTM, LM--RTM | No | No | No | Yes | |
56 | Tackling Semi-automatic Trace Recovery for Large Specifications | Leuser, Ott | Requirements Engineering: Foundation for Software Quality | 2010 | Daimler AG | 3 | Req-Req, Req-Test | Stop words, stemming | N/A | TFIDF | N/A | VSM | Thesaurus, Phrasing, Project glossary, Filtering | TraceTool | Ind: Daimler (2095, 944) | Level 1 study | Methods | Query | No | No | No | Yes | No | |
57 | Evaluating the Use of Project Glossaries in Automated Trace Retrieval | Zou, Settimi, Cleland-Huang | International Conference on Software Engineering Research and Practise | 2008 | DePaul University | 3 | Req-Req, Req-Code | Unclear (refs) | Unclear | TFIDF | Unclear | Prob (IN) | Phrasing, project glossary | Univ: IBS (235), Ind: CM-1 (455), Stud: SE450 (61) | Level 1 experiment | Methods | No | No | No | Yes | ||||
58 | A clustering-based approach for tracing object-oriented design to requirement | Zhou, Yu | Fundamental Approaches to Software Engineering | 2007 | IBM China Research Lab | 3 | Code-Req (Code gran: class) | Stemming | Stemming | Nouns and verbs. Binary term-doc matrix. | IDS | VSM | Clustering | Univ: Resource Management Software (33) | Level 1 experiment | Methods | No | No | No | No | ||||
59 | On human analyst performance in assisted requirements tracing: Statistical analysis | Dekhtyar, Dekhtyar, Holden, Hayes, Cuddeback, Kong | International Requirements Engineering Conference | 2011 | California Polytechnic State University | 3 | Req-Test | Unclear | N/A | TFIDF | N/A | VSM | RETRO | OS: BlueJ (49) | Level 3 experiment (84 students) | Humans | N/A | Yes | N/A | N/A | N/A | N/A | ||
60 | Extraction and visualization of traceability relationships between documents and source code | Chen | International conference on Automated Software Engineering | 2010 | University of Auckland | 2 | Code-Unclear docs | Unclear | ID splitting | Unclear | IDs | VSM | Text mining | OS: JDK1.5 (?), uDig 1.1.1 (?) | Level 1 case study | Methods | Matrix | No | No | Yes | No | |||
61 | Source code indexing for automated tracing | Mahmoud, Niu | International workshop on Traceability in emerging forms of software engineering | 2011 | Mississippi State University | 2 | Code-Reqs (Code gran: unclear) | Stop words, stemming | Unclear | TFIDF | Ids, comments | VSM | Stud: eTour (174), iTrust (264) | Level 1 experiment | Methods | Matrix | Yes | Ids-->Comments+Ids, Stem--NoStem | No | No | No | No | ||
62 | Trust-Based Requirements Traceability | Ali, Gueheneuc, Antoniol | International conference on program comprehension | 2011 | Ecole Polytechnique de Montreal | 2 | Code-Reqs (Code gran: class) | Stop words, stemming, ID-splitting. | Stop words, stemming, ID splitting. | TFIDF | Ids, comments, Commit comments. | VSM | Voting | Trustrace | OS: Pooka (388), SIP (1853) | Level 1 case study | Methods | Matrix | Yes | No | No | No | Yes | |
63 | Traceability challenge 2011: using tracelab to evaluate the impact of local versus global idf on trace retrieval | Czauderna, Gibiec, Leach, Li, Shin, Keenan, Cleland-Huang | International workshop on Traceability in emerging forms of software engineering | 2011 | DePaul University | 2 | Req-Req, Code-Req (Code gran unclear) | Stop words, stemming | Unclear | TFIDF | Unclear | VSM | TraceLab | Ind: CM-1 (75), WV-CCHIT (1180) | Level 2 experiment | Methods | No | Yes | No | No | ||||
64 | Using semantics-enabled information retrieval in requirements tracing: An ongoing experimental investigation | Mahmoud, Niu | Annual IEEE Computer Software and Applications Conference | 2010 | Mississippi State University | 1 | Req-Req | Unclear | N/A | TFIDF. Verbs upweighted. | N/A | VSM | Ind: CM-1 (455) | Level 1 experiment | Methods | Yes | No | No | No | No | ||||
65 | Experiences with text mining large collections of unstructured systems development artifacts at JPL | Port, Nikora, Hihn, Huang | International Conference on Software Engineering | 2011 | University of Hawaii | 1 | Reqs-Reqs | Stop words, stemming | N/A | Unclear | N/A | LSI (N/A) | Clustering | Unclear (from PROMISE) | Level 3 study (HUMANS) | Humans | N/A | Man-->LSI | No | No | No | No | ||
66 | Traceclipse: an eclipse plug-in for traceability link recovery and management | Klock, Gethers, Dit, Poshyvanyk | International workshop on Traceability in emerging forms of software engineering | 2011 | The College of William and Mary | 1 | Reqs-Reqs, Reqs-Code-Test | Stemming, ID splitting | Unclear | Unclear | Unclear | Unclear | Traceclipse | Ind: CM-1 (455), Stud: EasyClinic (150) | Level 1 proof of concept | Methods | Matrix | No | Yes | No | No | No | ||
67 | Improving IR-based Traceability Recovery Using Smoothing Filters | De Lucia, Di Penta, Oliveto, Panichella, Panichella | International Conference on Program Comprehension | 2011 | University of Salerno | 1 | Code-Reqs, Code-Test, Req-Req | Stop words, stemming, ID splitting | Unclear | TIDF | Unclear | VSM, LSI (N/A) | Smoothing filters | ADAMS Re:Trace | Univ: PINE (131), Stud: EasyClinic (150) | Level 1 experiment | Methods | Matrix | Yes | No | Yes | No | No | |
68 | An Adaptive Approach to Impact Analysis from Change Requests to Source Code | Gethers, Kagdi, Dit, Poshyvanyk | International Conference on Automated Software Engineering | 2011 | The College of William and Mary | 1 | Defect-Code | Unclear | Unclear | Unclear | Unclear | LSI (N/A) | Data mining, dynamic analysis | OS: ArgoUML (qualitative) | Level 2 study qualitative | Methods | Query | No | No | No | No | No | ||
69 | Improving automated documentation to code traceability by combining retrieval techniques | Chen, Grundy | International Conference on Automated Software Engineering | 2011 | University of Auckland | 1 | Code-Manual | Stop words, ID splitting | ID splitting | Unclear | Unclear | VSM | Regular expression, key phrasing, clustering | OS: JDK (431) | Level 1 case study | Methods | Matrix | No | No | No | Yes | No | ||
70 | Do Better IR Tools Improve the Accuracy of Engineers' Traceability Recovery? | Borg, Pfahl | International Workshop on Machine Learning Technologies in Software Engineering | 2011 | Lund University | 1 | Req-Req | (Stop words, stemming), stemming | N/A | TF, TFIDF | N/A | VSM | RETRO. ReqSimile | Ind: CM-1 (455) | Level 3 experiment (8 subjects) | Humans | Query | Yes | Yes | No | No | No | ||
71 | The role of the coverage analysis during IR-based traceability recovery: A controlled experiment | De Lucia, Oliveto, Tortora | International Conference on Software Maintenance | 2009 | University of Salerno | 0 | Code-Req, Req-Test | N/A | N/A | N/A | N/A | LSI (N/A) | ADAMS Re-Trace | Stud: EasyClinic (150) | Level 3 experiment | Humans | N/A | Yes | No | No | No | No | ||
72 | A combination approach for enhancing automated traceability: (NIER track) | Chen, Hosking, Grundy | International conference on Software engineering | 2011 | University of Auckland | 0 | Code-Docs | ID splitting | ID splitting | Unclear. | Ids and comments. | VSM | Regular expression, key phrasing, clustering | OS: JDK 1.5 (N/A) | Level 1 case study | Methods | Matrix | No | No | Yes | No | |||
73 | Software verification and validation research laboratory (SVVRL) of the University of Kentucky: traceability challenge 2011: language translation | Hayes, Sultanov, Kong, Li | International workshop on Traceability in emerging forms of software engineering | 2011 | University of Kentucky | 0 | Reqs-Code-Test | Stop words, stemming, ID splitting, Google Translate | Unclear | TFIDF | IDs | VSM | RETRO.NET | Stud: EasyClinic (150), eTour (174) | Level 2 study (MAP) | Methods | Matrix | Yes | No | No | Yes | Yes | ||
74 | An Improving Approach for Recovering Requirements-to-Design Traceability Links | Di, Zhang | International Conference on Computational Intelligence and Software Engineering | 2009 | Beihang University | 0 | Req-Req | Stop words, stemming | N/A | Binary | N/A | Prob (BIM) | Machine learning from established links | Ind: CM-1 (455), MODIS (68) | Level 1 case study | Methods | Query | No | Yes | No | No | No | ||
75 | Proximity-based traceability: An empirical validation using ranked retrieval and set-based measures | Kong, Hayes | International Workshop on Empirical Requirements Engineering | 2011 | University of Kentucky | 0 | Code-Reqs, reqs-reqs, reqs-test | Unclear | Unclear | TFIDF | Unclear | VSM | Term proximity | Ind: CM-1 (75), OS: Pine (182), Univ: StyleChecker (49), Stud: EasyClinic (77) | Level 2 experiment. MAP. | Methods | Query | No | No | Yes | No | No | ||
76 | Reconstructing Traceability between Bugs and Test Cases: An Experimental Study | Kaushik, Tahvildari, Moore | Working Conference on Reverse Engineering | 2011 | University of Waterloo | 0 | Defects-Test | Stopwords, stemming | N/A | Unclear | N/A | LSI (k=50-500, Best: 150-200), LDA | Ind: RIM (13389) | Level 1 experiment | Methods | Query | No | LDA-->LSI | No | No | No | No | ||
77 | Towards a Benchmark for Traceability | Ben Charrada, Casper, Jeanneret, Glinz | International Workshop on Principles of Software Evolution | 2011 | University of Zürich | 0 | Req-Req, Code-Req | Stemming | Unclear | TFIDF | Unclear | VSM | Univ: AquaLush (793) | Level 1 experiment | Methods | Matrix | No | No | No | No | Yes | |||
78 | Requirements Traceability for Object Oriented Systems by Partitioning Source Code | Ali, Guehenuec, Antoniol | Working Conference on Reverse Engineering | 2011 | Ecole Polytechnique de Montreal | 0 | Code-Req | Unclear | Unclear | TFIDF | Unclear | VSM | Partitioning, voting | OS: Pooka (388), SIP (1853), Univ: iTrust (526) | Level 1 experiment | Methods | Matrix | Yes | No | No | No | Yes | ||
79 | A Comparative Study of Document Correlation Techniques for Traceability Analysis | Parvathy, Vasudevan, Balakrishnan | International Conference on Enterprise Information Systems | 2008 | Infosys Technologies | N/A | Code-Req, Reqs-Reqs | Stop words, Identifier splitting | Unclear | TFIDF | Unclear | VSM, LSI (k=10), LDA, CTM | Unclear: (43), (261) | Level 1 experiment | Methods | Matrix | LDA-->(CSM,LSI,CTM), CTM-->(VSM,LSI), LSI-->VSM | No | No | No | Yes | |||
80 | A requirement traceability refinement method based on relevance feedback | Kong, Li, Li, Yang, Wang | International Conference on Software Engineering and Knowledge Engineering | 2009 | Laboratory for Internet Software Technologies, Institute of Software | N/A | Code-Req (Code gran: class) | Unclear | Unclear | TFIDF | Unclear | VSM, LM | Relevance feedback | Ind: Webapp (511) (Chinese) | Level 1 experiments. Simulated feedback. | Methods | Query | No | No | No | No | Yes | ||
81 | ||||||||||||||||||||||||
82 | ||||||||||||||||||||||||
83 | ||||||||||||||||||||||||
84 | ||||||||||||||||||||||||
85 | ||||||||||||||||||||||||
86 | ||||||||||||||||||||||||
87 | ||||||||||||||||||||||||
88 | ||||||||||||||||||||||||
89 | ||||||||||||||||||||||||
90 | ||||||||||||||||||||||||
91 | ||||||||||||||||||||||||
92 | ||||||||||||||||||||||||
93 | ||||||||||||||||||||||||
94 | ||||||||||||||||||||||||
95 | ||||||||||||||||||||||||
96 | ||||||||||||||||||||||||
97 | ||||||||||||||||||||||||
98 |