ABCDEFGHIJKLMNOPQRSTUVW
1
Please put your initials in brackets or anonym Wrapper (serializes NIF from tool output), Parser (reads NIF and does something with it), Internal usage (e.g. OLiA hardcoded), NIF extension (extends the NIF ontology)Please rate your prior knowledge here. Prior knowledge means in the respective area, e.g. have you used many frameworks before. Please rate according to 1 = never used any before, 2 = minor know-how, 3 = acceptable, 4 = good, 5 = excellentEffort in hours: a rough estimate how much time you needed to understand (research, download, installation, first contact) the other tool/format, understand NIF and implement the wrapper, parser or converter. Metrics, LoC should be non empty lines, e.g. produced by sed '/^\s*$/d' * | wc -l Evaluation of NIF:
1. Adequacy - Were you able to convert the internal structure of your tool to NIF without major problems (yes, some, not at all)?
2. Coverage - NIF offered vocabularies to describe the annotations provided by the tool.
3. If no, were you able to extend NIF easily to cover the gap.		NIF rating
Scalability (1 = very bad, 3 = acceptable, 5 = excellent ): How well do you think does NIF scale for large text corpora?
Interoperability (1 = very bad, 3 = acceptable, 5 = excellent ): How do you judge the overall interoperability of NIF tools?
Documentation (1 = very bad, 3 = acceptable, 5 = excellent ): How good/helpful was the documentation?
Reference Impl.(1 = very bad, 3 = acceptable, 5 = excellent ): How helpful was the existing reference implementation?
Entrance barrier(1 = very easy, 3 = acceptable, 5 = very difficult ): How difficult is the required know-how to understand NIF?
Performance Overhead(1= irrelevant, 3=acceptable, 5 = high perfomance loss): How much does the wrapper worsen the performance with overhead .		URL of ToolRemarks and comments
2
Tool/Dataset/Format name. What? Please create several entries for different types Semantic WebNLPWeb ServicesFrameworksEffort sum (h)Tool (h)NIF (h)Implemen-tation (h)Lines of CodeLanguageAdequacyCoverageCreating an extension was possible?ScalabilityInteroperabilityDocumentationReference Impl. Entrance barrierPerformance Overhead
3
UIMA (MB)wrapper32343520510271Javayesn.a. (yes for POS)n.a.244532
4
GATE (DC)wrapper4144203514445Javayesn.a. (yes for POS)n.a.454532
5
Mallet (MA)wrapper1423404828~400Javayesno (NIF 1.0)yes343543
6
MontyLingua (MN)wrapper4142254318252Pythonyesyes-445n.a.33
7
Spotlight (RS)wrapper3351204412110Node-JSyesno (NIF 1.0)yes454543
8
OpenNLP (MB)wrapper32343 or 810*2267Javayesno (NIF 1.0)yes244532
9
OpenCalais (AL)wrapper4434326620201PHPyesno (NIF 1.0)yes334543
10
Zemanta (MV)wrapper3444241320235Pythonyesyesn.a.343543
11
SemanticQuran (MS)wrapper4322251618500Javayesyes-554542http://aksw.org/Projects/SemanticQuran.html
12
ITS2NIF (FS)wrapper33332077672XSLTyesyesn.a.333313http://www.w3.org/People/fsasaki/its20-general-processor/tools/its-ta-2-nif.xsl
13
THD (MD)wrapper425320785~300Javayesnoyes342233http://ner.vse.cz/thd
14
STANBOL (RW)wrapper / internal usage544428?820400Javayesnon.a.??3?22http://stanbol.apache.org and espacially the nlp2rdf EnhancementEngine https://svn.apache.org/repos/asf/stanbol/trunk/enhancement-engines/nlp2rdf/see the comments added to the according cells.
15
Spotlight (MN)internal usage4243248115212Scalayesyes-443432
16
Coat (SL)internal usage2124165105150n.a.Javayesyes-3n.a3n.a3n.a
17
DrugExractor (AK)wrapper454416151030Javasomenoyes334n.a.1n.a.will appear soononly related to NIF1.0. No experience with NIF2.0
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100