Web application

Character-level part-of-speech tagger of Slovene language

Part-of-speech tagger for Slovene language implemented using convolutional and LSTM neural networks. Tagger uses character-level representation of sentences. The tagger has been trained on the ssj500k 2.1 corpus, http://hdl.handle.net/11356/1181.

XML, TEI, plain text

http://hdl.handle.net/11356/1211

GNU General Public Licence, version 3

PoS, lemma, NER, syntactic parsing

an online text-processing tool which allows you to perform four different types of linguistic annotation: morphosyntactic tagging, lemmatisation, named entity recognition (NER), and Universal Dependency (UD) parsing.

vertical, plain text

https://github.com/clarinsi/reldi-lib

http://clarin.si/services/web/query

CC-BY (for webservice); Apache 2 for library

https://github.com/clarinsi/janes-tagger

Tool for tagging and lemmatising non-standard Slovene (Croatian and Serbian to follow). For now only using the pretrained model is possible. The input text should be pairs of original and normalised forms separated by tab (additional attributes allowed), with empty lines as sentence separators. You can control for the position of the original and normalised token in the tab-separated format by setting the index1 and index2 parameters.

https://github.com/clarinsi/janes-tagger

http://hdl.handle.net/11858/00-097C-0000-0023-43CD-0

MorphoDiTa: Morphological Dictionary and Tagger is an open-source tool for morphological analysis of natural language texts. It performs morphological analysis, morphological generation, tagging and tokenization and is distributed as a standalone tool or a library, along with trained linguistic models. In the Czech language, MorphoDiTa achieves state-of-the-art results with a throughput around 10-200K words per second. MorphoDiTa is a free software under Mozilla Public License 2.0 and the linguistic models are free for non-commercial use and distributed under CC BY-NC-SA license, although for some models the original data used to create the model may impose additional licensing conditions. MorphoDiTa is versioned using Semantic Versioning.

plain text, vertical

https://github.com/ufal/morphodita/releases/tag/v1.9.2

http://lindat.mff.cuni.cz/services/morphodita/

http://lindat.mff.cuni.cz/services/morphodita/api-reference.php

Mozilla Public Licence 2.0 (software); CC BY-NC-SA models

PoS, lemma, syntactic parsing

UDPipe is a trainable pipeline for tokenization, tagging, lemmatization and dependency parsing of CoNLL-U files. UDPipe is language-agnostic and can be trained given annotated data in CoNLL-U format. Trained models are provided for nearly all UD treebanks. UDPipe is available as a binary for Linux/Windows/OS X, as a library for C++, Python, Perl, Java, C#, and as a web service. Third-party R CRAN package also exists.

http://github.com/ufal/udpipe/releases/latest

http://lindat.mff.cuni.cz/services/udpipe/api-reference.php

http://lindat.mff.cuni.cz/services/udpipe/api-reference.php

Mozilla Public Licence 2.0 (software); CC BY-NC-SA UD models

https://hdl.handle.net/21.11115/0000-000B-D325-D

The present tool, that was built to deal with Portuguese-specific issues concerning syntactic categorization, assigns a single morpho-syntactic tag, from the tagset below, to every token. The tag is attached to the token, using a / (slash) symbol as separator.

http://lxcenter.di.fc.ul.pt/tools/en/LXTaggerEN.html

Academic - Non-Commercial use

https://hdl.handle.net/21.11115/0000-000B-D330-0

lemma, PoS, chunks, named entities

The tagger is specifically tuned for biomedical text such as MEDLINE abstracts

http://www.nactem.ac.uk/GENIA/tagger/

Proprietary - commercial

https://hdl.handle.net/21.11115/0000-000B-D32C-6

Part-of-speech tagger tuned to biomedical text, provided as a web service.

Proprietary - commercial

https://hdl.handle.net/20.500.12185/351

Afrikaans, English, Ndebele, Xhosa, Zulu, Sesotho sa Leboa, Setswana, Sesotho, Siswati, Tshivenda, Xitsonga

PoS, phrase chunks, NE

A graphical user interface and command line tool to automatically annotate running text with one or more linguistic tags:

https://hdl.handle.net/20.500.12185/351

CC-BY 2.5 South Africa Licence

http://hdl.handle.net/11858/00-097C-0000-0001-48F9-4

The HMM-based Tagger is a software for morphological disambiguation (tagging) of Czech texts. The algorithm is statistical, based on the Hidden Markov Models. It is an implementation of the UFAL tagger

http://hdl.handle.net/11858/00-097C-0000-0001-48F9-4

GNU General Public Licence, version 2

Tagger-WS is a web service that reads Polish text and outputs sentences divided into tokens where each token is labelled with a morphosyntactic tag and a lemma. The tagger uses NKJP tagset and Morfeusz SGJP analyser. The service is based on WCRFT.

http://clarin-pl.eu/synat/ws/tagger/

https://hdl.handle.net/20.500.12185/143

The Afrikaans TnT-tagger is a part of speech tagger that can be used to add part of speech tags to Afrikaans texts.The tagger is an Afrikaans version of TnT (Brants, 2000). It was trained on 20,000 annotated Afrikaans text units. The tagger takes as input a tokenised Afrikaans text without any tags. It gives as output a text containing a text unit with its appropriate pos-tag per line. The tagset that the Afrikaans TnT-tagger uses was especially designed for Afrikaans and consists of 139 pos-tags.

Hunpos is an open source reimplementation of TnT, the well known part-of-speech tagger by Thorsten Brants.

https://code.google.com/archive/p/hunpos/downloads

New BSD License

? listed in LINDAT

https://www.researchgate.net/publication/228524009_HunPos_an_open_source_trigram_tagger

MSD, syntactic parsing

The Oslo-Bergen tagger is a robust morphological and syntactic tagger that has been developed at the University of Oslo and Uni Computing in Bergen for several years. The tager now consists of three main modules: a preprocessor with composition analyzer and multitagger, a grammar module for morphological and syntactic disambiguation (constraint grammar) and a statistical module that removes the last residual morphological ambiguity (only for bookmarks). The grammar module uses a compiler developed at the University of Southern Denmark in Odense. The multi-tagger uses the full-form lexicon Norwegian word bank.

https://github.com/noklesta/The-Oslo-Bergen-Tagger

GNU General public licence

http://hdl.handle.net/10032/198143d2010e74ae17d4223dfc00e2a8

PoS, MSD, lemma, NE, phrase chunks, dependency relations with head words

Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. All NLP modules are based on Timbl, the Tilburg memory-based learning software package. Most modules were created in the 1990s at the ILK Research Group (Tilburg University, the Netherlands) and the CLiPS Research Centre (University of Antwerp, Belgium). Over the years they have been integrated into a single text processing tool, which is currently maintained and developed by the Language Machines Research Group and the Centre for Language and Speech Technology at Radboud University Nijmegen. A dependency parser, a base phrase chunker, and a named-entity recognizer module were added more recently. Where possible, Frog makes use of multi-processor support to run subtasks in parallel.

https://github.com/LanguageMachines/frog/releases/

GNU General Public Licence

Assamese POS tagger is a CRF++ based POS Tagger. CRF++ is a customizable open source Conditional Random Fields for tagging/labeling continuos text. CRF++ is implemented for generic purpose and can be applied to any natural language provided the tagset. CRF++ tool is designed in C++ language.

This is the second version of the morpho-syntactic tagger for the Polish language, adapted to UGC-processing. It has been enriched with some heuristics to improve its accuracy and a tokenizer.

http://hdl.handle.net/11321/634

MorphoDiTa-based tagger for Polish language. It is a tool for morphosyntactic unification for the Polish language, according to the NKJP tagset.

http://hdl.handle.net/11321/425

WCRFT (Wrocław CRF Tagger) is a simple morpho-syntactic tagger for Polish producing state-of-the-art results. The tagger combines tiered tagging, conditional random fields (CRF) and features tailored for inflective languages written in WCCL. The algorithm and code are inspired by Wrocław Memory-Based Tagger.

http://nlp.pwr.wroc.pl/redmine/projects/wcrft/wiki/

GNU LGPL 3.0 (info missing in the CLARIN-PL entry)

WMBT (Wrocław Memory-Based Tagger) is a simple morpho-syntactic tagger for Polish producing state-of-the-art results. WMBT uses TiMBL API as the underlying Memory-Based Learning implementation. The features for classification are generated by using WCCL. WMBT uses a tiered tagging approach. Grammatical class is disambiguated first, then subsequent attributes (as defined in a config file) are taken care of. Each attribute may be supplied a different set of features. The software package comes with default configurations for KIPI/IPIC and NKJP tagsets (kipi-guess.ini and nkjp-guess.ini).

Various, default is XCES XML

Various, default is XCES XML

http://nlp.pwr.wroc.pl/redmine/projects/wmbt/wiki

GNU LGPL 3.0 (info missing in the CLARIN-PL entry)

TaKIPI is a tagger of Polish language that is a tool which assigns morpho-syntactic markers to words in the text. The tagger assumes a morpho-syntactic description of IPI PAN corpus tagset. Contextual disambiguation is carried out via a small set of hand-written rules and via a bigger number of rules automatically extracted by means of the algorithm of the induction of decision trees C4.5. During the process of tagger's learning and functioning, the context of each word's occurence in the text is represented as a feature vector of a constant length. Such vector is obtained by means of hand-written functional expressions of JOSKIPI formalism, which refer to morpho-syntactic properties of the context.

PoS, lemma, NER

This software package provides finnish-postag, a part-of-speech and morphology tagger for Finnish, and finnish-nertag, a named entity recogniser for Finnish. Both tools take running text from standard input and produce tabular output (one token per line) to standard output. See --help messages for more details.

Plain text, pdf, doc, scv, epub, html, odt, xls

http://urn.fi/urn:nbn:fi:lb-201908162

https://www.kielipankki.fi/tools/demo/cgi-bin/fintag.py

https://clarin.dk/clarindk/toolchains-wizard.jsp

PoS, lemma, frequency lists

https://clarin.dk/clarindk/toolchains-wizard.jsp

http://hdl.grnet.gr/11500/ATHENA-0000-0000-23E8-3

FBT part-of-speech tagger for Greek texts.

Application/vnd.xmi+xml

Application/vnd.xmi+xml

http://hdl.grnet.gr/11500/ATHENA-0000-0000-23E8-3

Terms Of Service (Restrictions: Academic - Non Commercial Use)

http://hdl.grnet.gr/11500/ATHENA-0000-0000-2790-1

The Apache OpenNLP library is a machine learning based toolkit for the processing of natural language text. It supports the most common NLP tasks, such as tokenization, sentence segmentation, part-of-speech tagging, named entity extraction, chunking, parsing, and coreference resolution. These tasks are usually required to build more advanced text processing services. OpenNLP also included maximum entropy and perceptron based machine learning.

http://hdl.grnet.gr/11500/ATHENA-0000-0000-2790-1

Apache Licence 2.0 (restricted)

Note: link to external landing page not working

http://hdl.grnet.gr/11500/ATHENA-0000-0000-2792-F

The Apache OpenNLP library is a machine learning based toolkit for the processing of natural language text. It supports the most common NLP tasks, such as tokenization, sentence segmentation, part-of-speech tagging, named entity extraction, chunking, parsing, and coreference resolution. These tasks are usually required to build more advanced text processing services. OpenNLP also included maximum entropy and perceptron based machine learning.

http://hdl.grnet.gr/11500/ATHENA-0000-0000-2792-F

Apache Licence 2.0 (restricted)

http://hdl.grnet.gr/11500/ATHENA-0000-0000-2794-D

OpenNLP Part-of-Speech Tagger (Portuguese)

http://hdl.grnet.gr/11500/ATHENA-0000-0000-2794-D

Apache Licence 2.0 (restricted)

Morfeusz 2 is a dictionary based morphological analyser and generator for Polish. This version of the program is decoupled from the dictionary. Two dictionaries of Polish developed within other projects are distributed with Morfeusz 2, namely SGJP and Polimorf.

http://hdl.handle.net/11321/257

https://ws.clarin-pl.eu/

https://spraakbanken.gu.se/verktyg/sparv

Bulgarian, English, Estonian, Finnish, French, Galician, Italian, Catalan, Latin, Dutch, Norwegian, Polish, Portuguese, Romanian, Russian, Slovak, Slovenian, Spanish, Swedish, German

PoS, MSD, lemma

Sparv is Språkbanken's corpus annotation pipeline infrastructure. The easiest way to use the pipeline is from its web interface with a plain text document. The pipeline uses in-house and external tools on the text to segment it into sentences and paragraphs, tokenise, tag parts-of-speech, look up in dictionaries and analyse compounds. The pipeline can also be run using a web API with XML results, and it is run locally at Språkbanken to prepare the documents in Korp, our corpus search tool. While the most sophisticated support is for modern Swedish, the pipeline supports 15 languages.

https://spraakbanken.gu.se/sparv/#input=plain&lang=sv&language=sv

sentence splitting, PoS, lemma, syntactic parsing

CLaRK is an XML-based software system for corpora development implemented in JAVA. The main aim behind the design of the system is the minimization of human intervention during the creation of language resources. ClARK includes BTB-Pipe, which is a language pipeline for Bulgarian that comprises the following modules: sentence splitting, MSD-tagging, lemmatisation, dependency parsing

http://bultreebank.org/clark/clark-3-0-download/

http://hdl.handle.net/11022/0000-0001-3309-C

PoS, syntactic parsing

Plain text, pdf, rtf, XML

https://weblicht.sfs.uni-tuebingen.de/weblichtwiki/index.php/Main_Page

http://hdl.handle.net/11858/00-1778-0000-0004-BA31-A

PoS, syntactic parsing

Plain text, pdf, rtf, XML

https://weblicht.sfs.uni-tuebingen.de/weblichtwiki/index.php/Main_Page

http://hdl.handle.net/11022/1007-0000-0000-8DEE-6

PoS, lemma, syntactic parsing

Plain text, pdf, rtf, XML

https://weblicht.sfs.uni-tuebingen.de/weblichtwiki/index.php/Main_Page

http://hdl.handle.net/11022/1007-0000-0000-8E4F-9

German, Czech, Slovene, Hungarian

The RFTagger is a tool for the annotation of text with fine-grained part-of-speech tags. It has been trained on German, Czech, Slovene, and Hungarian data.

https://www.cis.uni-muenchen.de/~schmid/tools/RFTagger/data/RFTagger.tar.gz

https://weblicht.sfs.uni-tuebingen.de/weblichtwiki/index.php/Main_Page

http://sifnos.sfs.uni-tuebingen.de/resource/A4/rftj/

http://hdl.handle.net/11022/1007-0000-0000-8E2A-2

German, English French, Italian, Dutch, Spanish, Bulgarian, Russian, Greek, Portuguese, Chinese, Swahili, Latin, Estonian and old French4

The TreeTagger is a tool for annotating text with part-of-speech and lemma information. It was developed by Helmut Schmid in the TC project at the Institute for Computational Linguistics of the University of Stuttgart. The TreeTagger has been successfully used to tag German, English French, Italian, Dutch, Spanish, Bulgarian, Russian, Greek, Portuguese, Chinese, Swahili, Latin, Estonian and old French texts and is adaptable to other languages if a lexicon and a manually tagged training corpus are available.

https://www.cis.uni-muenchen.de/~schmid/tools/TreeTagger/

https://weblicht.sfs.uni-tuebingen.de/weblichtwiki/index.php/Main_Page

Free but unspecified

http://hdl.handle.net/21.11120/0000-0003-7D95-9

http://zwei.dwds.de/d/suche#stts

http://hdl.handle.net/11858/00-1778-0000-0004-BA92-E

POS Tagger from the OpenNLP Project The model for Italian is trained on a relatively small training corpus (MIDT) and should therefore be considered experimental.

https://weblicht.sfs.uni-tuebingen.de/weblichtwiki/index.php/Main_Page

https://hdl.handle.net/20.500.12185/264

Sesotho sa Leboa part of speech statistical tagger compiled with stochastic tagger of Helmut Scmidt supported by noun and verb guessing modules, tokenizer, tagset and tagger lexicon.

http://hdl.handle.net/11022/0000-0007-DA27-8

PoS, syntactic parsing, NER

This service uses the neural network based part-of-speech tagger Sticker. It tags German and Dutch text and outputs universal part-of-speech tags. It is very fast and produces high-quality annotations.

https://github.com/stickeritis/sticker

Blue Oak Mode Licence version 1.0.0

https://hdl.handle.net/21.11115/0000-000B-D348-6

The part of speech tagger for Maltese is based on TnT, the statistical part of speech tagger by Thorsten Brants (http://www.coli.uni-saarland.de/~thorsten/tnt/). It was modified for the Maltese Language Resource Server (MLRS) by Albert Gatt (Linguistics Department, University of Malta). The model for Maltese was trained on manually tagged texts and has reached an accuracy of 96%. Below is a list of the tags which are used, along with a description. The web service for the Maltese Language Software Services (MLSS) was provided by Andrew Attard. The tagset list can be found here: http://metanet4u.research.um.edu.mt/POS.jsp The service has two methods which can be invoked: • String tagOneWordReturn(String text) • String tagParagraphReturn(String text) Both methods take a string as input, i.e., the text to be tagged, and return another string, i.e., the tagged text. The difference between the two is tagOneWordReturn returns the output as one word per line, while the other returns it as tagged paragraphs (if any paragraphs occur in the input string). The format of the output is: word_TAG

Estnltk provides common natural language processing functionality such as paragraph, sentence and word tokenization, morphological analysis, named entity recognition, etc. for the Estonian language.

https://estnltk.github.io/estnltk/1.4.1/

https://estnltk.github.io/estnltk/1.4.1/api/index.html

Available - Unrestricted Use

Note: Handle listed in VLO not working http://hdl.handle.net/11297/1-00-0000-0000-0000-0013GL

PoS, MSD, lemma

Consists of morphological analyser, morphological synthesizer, grammar controll, speller, morphological disambiguer and vocabulary moduls.

https://github.com/Filosoft/vabamorf

http://www.filosoft.ee/html_morf_et/

Available - Unrestricted Use

MSD, syntactic parsing, NER

NLP-PIPE is a modular toolchain that allows researchers to combine multiple natural language processing tools in a unified framework. It provides the gluing code that is used to combine tools even if they are written in different programming languages and rely on conflicting library versions. It was created to make NLP technology more accessible to linguists, and to make new tool creation and integration easier to researchers and software developers

https://github.com/LUMII-AILab/nlp-pipe

https://estnltk.github.io/estnltk/1.4.1/

GNU General Public Licence 3

http://lxcenter.di.fc.ul.pt/services/en/LXServicesLemmatizer.html

LX-Verbal Lemmatizer is a freely available online service for fully-fledged lemmatization of Portuguese verbs, including the full range of pronominal conjugation forms.

Plain text (verb form)

http://hdl.grnet.gr/11500/ATHENA-0000-0000-23EE-D

Application/vnd.xmi+xml

Application/vnd.xmi+xml

http://hdl.grnet.gr/11500/ATHENA-0000-0000-23EE-D

Terms of Service

PoS, lemma, shallow syntactic parsing

IceNLP is an open source Natural Language Processing (NLP) toolkit for analyzing and processing Icelandic text. The toolkit is implemented in Java.

https://github.com/hrafnl/icenlp

http://nlp.cs.ru.is:8080/IceNLPWeb/icenlp.html

GNU General Public License, version 2

https://turkunlp.org/Turku-neural-parser-pipeline/

pre-trained models for more than 50 languages

segmentation, morphological tagging, dependency parsing and lemmatization

A neural parsing pipeline for segmentation, morphological tagging, dependency parsing and lemmatization with pre-trained models for more than 50 languages. Top ranker in the CoNLL-18 Shared Task.

utf-8 encoded plain text

https://github.com/TurkuNLP/Turku-neural-parser-pipeline

http://bionlp-www.utu.fi/parser_demo

Apache License 2.0

https://hdl.handle.net/20.500.12185/326

This tool is a lemmatizer for the Sepedi (Northern Sotho) Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/326

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/333

This tool is a lemmatizer for the Sesotho Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/333

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/339

This tool is a lemmatizer for the Tswana Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/339

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/345

This tool is a lemmatizer for the Swazi Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/345

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/317

This tool is a lemmatizer for the Zulu Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/317

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/310

This tool is a lemmatizer for the Xhosa Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/310

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/303

This tool is a lemmatizer for Ndebele Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/303

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/297@format=cmdi

This tool is a lemmatizer for Afrikaans developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/297@format=cmdi

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/354

This tool is a lemmatizer for the Venda Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/354

CC-BY 2.5 South Africa Licence

https://hdl.handle.net/20.500.12185/361

This tool is a lemmatizer of the Tsonga Bantu language developed during the NCHLT Text project (Barnard 2014).

https://hdl.handle.net/20.500.12185/361

CC-BY 2.5 South Africa Licence

PoS, lemma, syntactic parsing

An integrated tokenizer, tagger-lemmatizer, morphological analyzer, and dependency parser for Dutch.

LINDAT/CLARIAH-NL

http://hdl.handle.net/10032/79a7f85fc70d1cf276c4c6a0a56dd176

This tool employs a PoS tagger that is trained on the "Letters as loot" historical corpus and a lemmatizer that is trained on the INL historical lexicon.

plain text, TEI, epub, html, docx, alto

http://inl-labs.taalbanknederlands.inl.nl/succeed/tagger/ui

http://hdl.handle.net/20.500.11752/ILC-72

This toolchain was developed in the PANACEA project and implements Freeling 2.1 libraries.

https://ilc4clarin.ilc.cnr.it/en/service/freeling-it

https://hdl.handle.net/21.11115/0000-000B-D31E-6

This tool is based on the MXPOST part of speech tagger and is trained on UNITEX dictionaries for Portuguese.

https://hdl.handle.net/21.11115/0000-000B-D31E-6

http://hdl.handle.net/11022/1007-0000-0000-8E23-9

http://hdl.handle.net/11022/0000-0000-1CAB-1

http://hdl.handle.net/11022/0000-0000-83A0-6

https://www.corpus.by/Lemmatizer/?lang=en

This tool is part of the corpus.by platform.

https://www.corpus.by/Lemmatizer/?lang=en

CLARIN Knowledge Centre for Belarusian text and speech processing