software . 2022

BioVAE

Trieu, Hai-Long;
Open Source Shell
  • Published: 28 Mar 2022
  • Publisher: bio.tools
Abstract
BioVAE is a pre-trained latent variable language model for biomedical text mining. Large scale pre-trained language models (PLMs) have advanced state-of-the-art (SOTA) performance on various biomedical text mining tasks. The power of such PLMs can be combined with the advantages of deep generative models. These are examples of these combinations. However, they are trained only on general domain text, and biomedical models are still missing. In this work, we describe BioVAE, the first large scale pre-trained latent variable language model for the biomedical domain, which uses the OPTIMUS framework to train on large volumes of biomedical text. The model shows SOTA performance on several biomedical text mining tasks when compared to existing publicly available biomedical PLMs.
Subjects
free text keywords: Natural language processing, Biomedical science
Communities
  • Digital Humanities and Cultural Heritage
Download from
Open Source
bio.tools
Software . 2022
Providers: bio.tools
Any information missing or wrong?Report an Issue