• Digital Humanities and Cultural Heritage
• Research data close
• Research software close
• Other research products close
• CLARIN.SI repository close
• Digital Humanities and Cultural Her... close

The novel "1984" by George Orwell is the central component of the MULTEXT-East corpus. This parallel and sentence aligned corpus contains the novel in the English original (about 100,000 words in length), and its translations into a number of languages. This version of the corpus contains the linguistically annotated texts, with each word tagged by its lemma and its MULTEXT(-East) morphosyntactic description (MSD, i.e., a fine-grained feature-structure based PoS tag). The structurally annotated texts are a separate submission (http://hdl.handle.net/11356/1044), also with somewhat different languages.

The PE²rr corpus contains source language texts from different domains along with their automatically generated translations into several morphologically rich languages, their post-edited versions, and error annotations of the performed post-edit operations. The main advantage of the corpus is the fusion of post-editing and error classification tasks, which have usually been seen as two independent tasks, although naturally they are not.

The dataset contains human similarity ratings for pairs of words. The annotators were presented with contexts that contained both of the words in the pair and the dataset features two different contexts per pair. The words were sourced from the English, Croatian, Finnish and Slovenian versions of the original Simlex dataset.

The KAS corpus of Slovene academic writing consists of almost 65,000 BSc/BA, 16,000 MSc/MA and 1,600 PhD theses (82 thousand texts, 5 million pages or 1,5 billion tokens) written 2000 - 2018 and gathered from the digital libraries of Slovene higher education institutions via the Slovene Open Science portal (http://openscience.si/). The theses have associated with them significant metadata, while each thesis in the corpus contains its textual body, i.e. without their front and back matter. The body is divided into chapters, then into pages, these into paragraphs, and then into sentences. The sentence tokens are tagged with morphosyntactically descriptions (detailed part-of-speech tags) and the words lemmatised. As opposed to the previous version 1.0, the KAS corpus of Slovene academic writing 2.0 is cleaner and contains segmentations into chapters. The metadata also contains more information about research fields of each work. Both versions consist of the same number of BSc/BA, MSc/MA, and PhD theses, however, the processing was done from scratch for 2.0, so the number of e.g. pages and tokens is different. Note also that the new version does not contain links to the PNG pictures of individual pages , nor does it contain annotated terms, both present in version 1.0. It is, unlike 1.0, also not mounted on the CLARIN.SI concordancers. The new version is distributed in the canonical TEI encoding, JSON, and as plain text files. In the TEI format, chapter names are denoted with the tag. Each entry in JSON files have a string ID and a list containing names of chapters as its first element and texts as its second element. Chapters without text are represented as an empty string. The plain text files contain only text bodies without segmentation information. References: Žagar, A., Kavaš, M., & Robnik Šikonja, M. (2021). Corpus KAS 2.0: cleaner and with new datasets. In Information Society - IS 2021: Proceedings of the 24th International Multiconference. https://doi.org/10.5281/zenodo.5562228

The DSI corpus is meant as a terminological resource for the field of informatics, esp. for the development of the on-line terminological dictionary of informatics, Islovar (www.islovar.org). The corpus contains articles from the proceedings of the conference series 2003-2019 "Dnevi slovenske informatike" (Days of Slovene Informatics), proceedings of the conference series 2015-2018 "Informatika v javni upravi" (Informatics in Public Administration), and volumes 2010-2019 of the journal "Uporabna informatika" (Applied Informatics).

RudOnto - uzorak iz onlajn tezaurusa rudarskih termina. RudOnto - sample from an online thesaurus of mining terms, compiled by University of Belgrade, Faculty of Mining and Geology.

Maj68 corpus contains 1,521 texts by 198 known authors published between 1964 and 1972 in the periodicals "Tribuna", "Problemi" and "Problemi. Literatura." The texts contain complete bibliographical data, are classified according to text and language type, degree of presence of non-standard Slovenian, foreign languages, modernism, and visual elements. The data about the authors of the texts are provided with their gender and year of birth. The presence of visual elements is marked in the corpus; note that 48 texts have only visual elements, i.e. do not contain any text. The corpus is available as facsimiles (PDFs), in the TEI encoding, as plain text files accompanied by metadata files, as the linguistically annotated TEI corpus, and the derived vertical files and registry file, for mounting on CWB-type concordancers. The TEI encoding follows the CLARIN.SI TEI customisation (https://github.com/clarinsi/TEI-schema). The automatic linguistic annotation includes lemmas, MULTEXT-East morphosyntactic descriptions and Universal Dependencies morphological features and syntactic annotation. As opposed to version 1 of this corpus, 647 new text from Tribuna and Problemi have been added, and some mistakes in metadata corrected.

Wörterbuch der Bairischen Mundarten in Österreich. Automatically created XML/TEI versions of first 5 volumes of Dictionary of Bavarian Dialects in Austria, published between 1963 and 2015, covering A, B/P, C, D/T and E. The dictionary of Bavarian dialects in Austria (WBÖ) is a large-scale dialect dictionary in which the Bavarian vocabulary in Austria and the neighboring South Tyrol is documented. The first 5 volumes also take into account the historical language of the office and other Bavarian-speaking areas of the former monarchy.

GOS is a corpus of spoken Slovene that includes the transcripts of approximately 120 hours of speech recorded in various situations: radio and TV shows, school lessons and lectures, private conversations between friends or within the family, work meetings, consultations, conversations in buying and selling situations, etc. All speech is transcribed in two versions – with pronunciation-based spelling and with standardized spelling – and it comprises over one million words. The corpus can be searched by means of the web concordancer where it is also possible to listen to the corresponding recordings: http://www.korpus-gos.net.