Английская Википедия:Biomedical text mining

Материал из Онлайн справочника
Перейти к навигацииПерейти к поиску

Biomedical text mining (including biomedical natural language processing or BioNLP) refers to the methods and study of how text mining may be applied to texts and literature of the biomedical domain. As a field of research, biomedical text mining incorporates ideas from natural language processing, bioinformatics, medical informatics and computational linguistics. The strategies in this field have been applied to the biomedical literature available through services such as PubMed.

In recent years, the scientific literature has shifted to electronic publishing but the volume of information available can be overwhelming. This revolution of publishing has caused a high demand for text mining techniques. Text mining offers information retrieval (IR) and entity recognition (ER).[1] IR allows the retrieval of relevant papers according to the topic of interest, e.g. through PubMed. ER is practiced when certain biological terms are recognized (e.g. proteins or genes) for further processing.

Considerations

Applying text mining approaches to biomedical text requires specific considerations common to the domain.

Availability of annotated text data

Файл:Westergaard et al 2018 PLOS Comp Biol Fig 1.png
This figure presents several properties of a biomedical literature corpus prepared by Westergaard et al.[2] The corpus includes 15 million English-language full text articles.(a) Number of publications per year from 1823–2016. (b) Temporal development in the distribution of six different topical categories from 1823–2016. (c) Development in the number of pages per article from 1823–2016.

Large annotated corpora used in the development and training of general purpose text mining methods (e.g., sets of movie dialogue,[3] product reviews,[4] or Wikipedia article text) are not specific for biomedical language. While they may provide evidence of general text properties such as parts of speech, they rarely contain concepts of interest to biologists or clinicians. Development of new methods to identify features specific to biomedical documents therefore requires assembly of specialized corpora.[5] Resources designed to aid in building new biomedical text mining methods have been developed through the Informatics for Integrating Biology and the Bedside (i2b2) challenges[6][7][8] and biomedical informatics researchers.[9][10] Text mining researchers frequently combine these corpora with the controlled vocabularies and ontologies available through the National Library of Medicine's Unified Medical Language System (UMLS) and Medical Subject Headings (MeSH).

Machine learning-based methods often require very large data sets as training data to build useful models.[11] Manual annotation of large text corpora is not realistically possible. Training data may therefore be products of weak supervision[12][13] or purely statistical methods.

Data structure variation

Like other text documents, biomedical documents contain unstructured data.[14] Research publications follow different formats, contain different types of information, and are interspersed with figures, tables, and other non-text content. Both unstructured text and semi-structured document elements, such as tables, may contain important information that should be text mined.[15] Clinical documents may vary in structure and language between departments and locations. Other types of biomedical text, such as drug labels,[16] may follow general structural guidelines but lack further details.

Uncertainty

Biomedical literature contains statements about observations that may not be statements of fact. This text may express uncertainty or skepticism about claims. Without specific adaptations, text mining approaches designed to identify claims within text may mis-characterize these "hedged" statements as facts.[17]

Supporting clinical needs

Biomedical text mining applications developed for clinical use should ideally reflect the needs and demands of clinicians.[5] This is a concern in environments where clinical decision support is expected to be informative and accurate. A comprehensive overview of the development and uptake of NLP methods applied to free-text clinical notes related to chronic diseases is presented in.[18]

Interoperability with clinical systems

New text mining systems must work with existing standards, electronic medical records, and databases.[5] Methods for interfacing with clinical systems such as LOINC have been developed[19] but require extensive organizational effort to implement and maintain.[20][21]

Patient privacy

Text mining systems operating with private medical data must respect its security and ensure it is rendered anonymous where appropriate.[22][23][24]

Processes

Specific sub tasks are of particular concern when processing biomedical text.[14]

Named entity recognition

Developments in biomedical text mining have incorporated identification of biological entities with named entity recognition, or NER. Names and identifiers for biomolecules such as proteins and genes,[25] chemical compounds and drugs,[26] and disease names[27] have all been used as entities. Most entity recognition methods are supported by pre-defined linguistic features or vocabularies, though methods incorporating deep learning and word embeddings have also been successful at biomedical NER.[28][29]

Document classification and clustering

Biomedical documents may be classified or clustered based on their contents and topics. In classification, document categories are specified manually,[30] while in clustering, documents form algorithm-dependent, distinct groups.[31] These two tasks are representative of supervised and unsupervised methods, respectively, yet the goal of both is to produce subsets of documents based on their distinguishing features. Methods for biomedical document clustering have relied upon k-means clustering.[31]

Relationship discovery

Biomedical documents describe connections between concepts, whether they are interactions between biomolecules, events occurring subsequently over time (i.e., temporal relationships), or causal relationships. Text mining methods may perform relation discovery to identify these connections, often in concert with named entity recognition.[32]

Hedge cue detection

The challenge of identifying uncertain or "hedged" statements has been addressed through hedge cue detection in biomedical literature.[17]

Claim detection

Multiple researchers have developed methods to identify specific scientific claims from literature.[33][34] In practice, this process involves both isolating phrases and sentences denoting the core arguments made by the authors of a document (a process known as argument mining, employing tools used in fields such as political science) and comparing claims to find potential contradictions between them.[34]

Information extraction

Information extraction, or IE, is the process of automatically identifying structured information from unstructured or partially structured text. IE processes can involve several or all of the above activities, including named entity recognition, relationship discovery, and document classification, with the overall goal of translating text to a more structured form, such as the contents of a template or knowledge base. In the biomedical domain, IE is used to generate links between concepts described in text, such as gene A inhibits gene B and gene C is involved in disease G.[35] Biomedical knowledge bases containing this type of information are generally products of extensive manual curation, so replacement of manual efforts with automated methods remains a compelling area of research.[36][37]

Information retrieval and question answering

Biomedical text mining supports applications for identifying documents and concepts matching search queries. Search engines such as PubMed search allow users to query literature databases with words or phrases present in document contents, metadata, or indices such as MeSH. Similar approaches may be used for medical literature retrieval. For more fine-grained results, some applications permit users to search with natural language queries and identify specific biomedical relationships.[38]

On 16 March 2020, the National Library of Medicine and others launched the COVID-19 Open Research Dataset (CORD-19) to enable text mining of the current literature on the novel virus. The dataset is hosted by the Semantic Scholar project[39] of the Allen Institute for AI.[40] Other participants include Google, Microsoft Research, the Center for Security and Emerging Technology, and the Chan Zuckerberg Initiative.[41]

Resources

Corpora

The following table lists a selection of biomedical text corpora and their contents. These items include annotated corpora, sources of biomedical research literature, and resources frequently used as vocabulary and/or ontology references, such as MeSH. Items marked "Yes" under "Freely Available" can be downloaded from a publicly accessible location.

Biomedical Text Corpora
Corpus Name Authors or Group Contents Freely Available Citation
2019 Bacteria Biotope BioNLP-OST Annotated scientific and textbook texts to recognize mentions of microorganisms, microbial biotopes and phenotypes, to normalize these mentions according to the knowledge resources of the field, and to extract the relationships between them. Yes [42]
2006 i2b2 Deidentification and Smoking Challenge i2b2 889 de-identified medical discharge summaries annotated for patient identification and smoking status features. Yes, with registration [43][44]
2008 i2b2 Obesity Challenge i2b2 1,237 de-identified medical discharge summaries annotated for presence or absence of comorbidities of obesity. Yes, with registration [45]
2009 i2b2 Medication Challenge i2b2 1,243 de-identified medical discharge summaries annotated for names and details of medications, including dosage, mode, frequency, duration, reason, and presence in a list or narrative structure. Yes, with registration [46][47]
2010 i2b2 Relations Challenge i2b2 Medical discharge summaries annotated for medical problems, tests, treatments, and the relations among these concepts. Only a subset of these data records are available for research use due to IRB limitations. Yes, with registration [6]
2011 i2b2 Coreference Challenge i2b2 978 de-identified medical discharge summaries, progress notes, and other clinical reports annotated with concepts and coreferences. Includes the ODIE corpus. Yes, with registration [48]
2012 i2b2 Temporal Relations Challenge i2b2 310 de-identified medical discharge summaries annotated for events and temporal relations. Yes, with registration [7]
2014 i2b2 De-identification Challenge i2b2 1,304 de-identified longitudinal medical records annotated for protected health information (PHI). Yes, with registration [49]
2014 i2b2 Heart Disease Risk Factors Challenge i2b2 1,304 de-identified longitudinal medical records annotated for risk factors for cardiac artery disease. Yes, with registration [50]
AIMed Bunescu et al. 200 abstracts annotated for protein–protein interactions, as well as negative example abstracts containing no protein-protein interactions. Yes [51]
BioC-BioGRID BioCreAtIvE 120 full text research articles annotated for protein–protein interactions. Yes [52]
BioCreAtIvE 1 BioCreAtIvE 15,000 sentences (10,000 training and 5,000 test) annotated for protein and gene names. 1,000 full text biomedical research articles annotated with protein names and Gene Ontology terms. Yes [53]
BioCreAtIvE 2 BioCreAtIvE 15,000 sentences (10,000 training and 5,000 test, different from the first corpus) annotated for protein and gene names. 542 abstracts linked to EntrezGene identifiers. A variety of research articles annotated for features of protein–protein interactions. Yes [54]
BioCreative V CDR Task Corpus (BC5CDR) BioCreAtIvE 1,500 articles (title and abstract) published in 2014 or later, annotated for 4,409 chemicals, 5,818 diseases and 3116 chemical–disease interactions. Yes [55]
BioInfer Pyysalo et al. 1,100 sentences from biomedical research abstracts annotated for relationships, named entities, and syntactic dependencies. No [56]
BioScope Vincze et al. 1,954 clinical reports, 9 papers, and 1,273 abstracts annotated for linguistic scope and terms denoting negation or uncertainty. Yes [57]
BioText Recognizing Abbreviation Definitions BioText Project 1,000 abstracts on the subject of "yeast", annotated for abbreviations and their meanings. Yes [58]
BioText Protein–Protein Interaction Data BioText Project 1,322 sentences describing protein–protein interactions between HIV-1 and human proteins, annotated with interaction types. Yes [59]
Comparative Toxicogenomics Database Davis et al. A database of manually-curated associations between chemicals, gene products, phenotypes, diseases, and environmental exposures. Yes [60]
CRAFT Verspoor et al. 97 full-text biomedical publications annotated with linguistic structures and biological concepts Yes [61]
GENIA Corpus GENIA Project 1,999 biomedical research abstracts on the topics "human", "blood cells", and "transcription factors", annotated for parts of speech, syntax, terms, events, relations, and coreferences. Yes [62][63]
FamPlex Bachman et al. Protein names and families linked to unique identifiers. Includes affix sets. Yes [64]
FlySlip Abstracts FlySlip 82 research abstracts on Drosophila annotated with gene names. Yes [65]
FlySlip Full Papers FlySlip 5 research papers on Drosophila annotated with anaphoric relations between noun phrases referring to genes and biologically related entities. Yes [66]
FlySlip Speculative Sentences FlySlip More than 1,500 sentences annotated as speculative or not speculative. Includes annotations of clauses. Yes [67]
IEPA Ding et al. 486 sentences from biomedical research abstracts annotated for pairs of co-occurring chemicals, including proteins. No [68]
JNLPBA corpus Kim et al. An extended version of version 3 of the GENIA corpus for NER tasks. No [69]
Learning Language in Logic (LLL) Nédellec et al. 77 sentences from research articles about the bacterium Bacillus subtilis, annotated for protein–gene interactions. Yes [70]
Medical Subject Headings (MeSH) National Library of Medicine Hierarchically-organized terminology for indexing and cataloging biomedical documents. Yes [71]
Metathesaurus National Library of Medicine / UMLS 3.67 million concepts and 14 million concept names, mapped between more than 200 sources of biomedical vocabulary and identifiers. Yes, with UMLS License Agreement [72][73]
MIMIC-III MIT Lab for Computational Physiology de-identified data associated with 53,423 distinct hospital admissions for adult patients. Requires training and formal access request [74]
ODIE Corpus Savova et al. 180 clinical notes annotated with 5,992 coreference pairs. No [75]
OHSUMED Hersh et al. 348,566 biomedical research abstracts and indexing information from MEDLINE, including MeSH (as of 1991). Yes [76]
PMC Open Access Subset National Library of Medicine / PubMed Central More than 2 million research articles, updated weekly. Yes [77]
RxNorm National Library of Medicine / UMLS Normalized names for clinical drugs and drug packs, with combined ingredients, strengths, and form, and assigned types from the Semantic Network. Yes, with UMLS License Agreement [78]
Semantic Network National Library of Medicine / UMLS Lists of 133 semantic types and 54 semantic relationships covering biomedical concepts and vocabulary. Yes, with UMLS License Agreement [79][80]
SPECIALIST Lexicon National Library of Medicine / UMLS A syntactic lexicon of biomedical and general English. Yes [81][82]
Word Sense Disambiguation (WSD) National Library of Medicine / UMLS 203 ambiguous words and 37,888 automatically extracted instances of their use in biomedical research publications. Yes, with UMLS License Agreement [83][84]
Yapex Franzén et al. 200 biomedical research abstracts annotated with protein names. No [85]

Word embeddings

Several groups have developed sets of biomedical vocabulary mapped to vectors of real numbers, known as word vectors or word embeddings. Sources of pre-trained embeddings specific for biomedical vocabulary are listed in the table below. The majority are results of the word2vec model developed by Mikolov et al[86] or variants of word2vec.

Biomedical word embeddings
Set Name Authors or Group Contents and Source Citation
BioASQword2vec BioASQ Vectors produced by word2vec from 10,876,004 English PubMed abstracts. [87]
bio.nlplab.org resources Pyysalo et al. A collection of word vectors produced by different approaches, trained on text from PubMed and PubMed Central. [88]
BioVec Asgari and Mofrad Vectors for gene and protein sequences, trained using Swiss-Prot. [89]
RadiologyReportEmbedding Banerjee et al. Vectors produced by word2vec from the text of 10,000 radiology reports. [90]

Applications

A flowchart of a text mining protocol.
An example of a text mining protocol used in a study of protein-protein complexes, or protein docking.[91]

Text mining applications in the biomedical field include computational approaches to assist with studies in protein docking,[91] protein interactions,[92][93] and protein-disease associations.[94] Text mining techniques have several advantages over traditional manual curation for identifying associations. Text mining algorithms can identify and extract information from a vast amount of literature, and more efficiently than manual curation. This includes the integration of data from different sources, including literature, databases, and experimental results. These algorithms have transformed the process of identifying and prioritizing novel genes and gene-disease associations that have previously been overlooked.[95]

Файл:Text-mining process.png
Process of text-mining
Файл:GeneDiseaseVennDiagram.png
Disease genes at the intersection of genes, diseases, and traits.
Файл:FilterAndRanking.png
Filter and ranking of disease-relevant keywords, extracted from disease-relevant documents, papers, etc
Файл:Extraction.png
Extraction through text-mining

These methods are the foundation to facilitate systematic searches of overlooked scientific and biomedical  literature which could carry significant association between research. The combination of information can stem new discoveries and hypotheses especially with the integration of datasets. It must be noted that the quality of the database is as important as the size of it. Promising text mining methods such as iProLINK (integrated Protein Literature Information and Knowledge) have been developed to curate data sources that can aid text mining research in areas of bibliography mapping, annotation extraction, protein named entity recognition, and protein ontology development.[96] Curated databases such as UniProt can accelerate the accessibility of targeted information not only for genetic sequences, but also for literature and phylogeny.

Gene cluster identification

Methods for determining the association of gene clusters obtained by microarray experiments with the biological context provided by the corresponding literature have been developed.[97]

Protein interactions

Automatic extraction of protein interactions[98] and associations of proteins to functional concepts (e.g. gene ontology terms) has been explored.Шаблон:Citation needed The search engine PIE was developed to identify and return protein-protein interaction mentions from MEDLINE-indexed articles.[99] The extraction of kinetic parameters from text or the subcellular location of proteins have also been addressed by information extraction and text mining technology.Шаблон:Citation needed

Gene-disease associations

Computational gene prioritization is an essential step in understanding the genetic basis of diseases, particularly within genetic linkage analysis. Text mining and other computational tools extract relevant information, including gene-disease associations, among others, from numerous data sources, then apply different ranking algorithms to prioritize the genes based on their relevance to the specific disease.[100] Text mining and gene prioritization allow researchers to focus their efforts on the most promising candidates for further research.

Computational tools for gene prioritization continue to be developed and analyzed. One group studied the performance of various text-mining techniques for disease gene prioritization. They investigated different domain vocabularies, text representation schemes, and ranking algorithms in order to find the best approach for identifying disease-causing genes to establish a benchmark.[101]

Gene-trait associations

An agricultural genomics group identified genes related to bovine reproductive traits using text mining, among other approaches.[102]

Applications of phrase mining to disease associations

A text mining study assembled a collection of 709 core extracellular matrix proteins and associated proteins based on two databases: MatrixDB (matrixdb.univ-lyon1.fr) and UniProt. This set of proteins had a manageable size and a rich body of associated information, making it a suitable for the application of text mining tools. The researchers conducted phrase-mining analysis to cross-examine individual extracellular matrix proteins across the biomedical literature concerned with six categories of cardiovascular diseases. They used a phrase-mining pipeline, Context-aware Semantic Online Analytical Processing (CaseOLAP),[103] then semantically scored all 709 proteins according to their Integrity, Popularity, and Distinctiveness using the CaseOLAP pipeline. The text mining study validated existing relationships and informed previously unrecognized biological processes in cardiovascular pathophysiology.[94]

Software tools

Search engines

Search engines designed to retrieve biomedical literature relevant to a user-provided query frequently rely upon text mining approaches. Publicly available tools specific for research literature include PubMed search, Europe PubMed Central search, GeneView,[104] and APSE[105] Similarly, search engines and indexing systems specific for biomedical data have been developed, including DataMed[106] and OmicsDI.[107]

Some search engines, such as Essie,[108] OncoSearch,[109] PubGene,[110][111] and GoPubMed[112] were previously public but have since been discontinued, rendered obsolete, or integrated into commercial products.

Medical record analysis systems

Electronic medical records (EMRs) and electronic health records (EHRs) are collected by clinical staff in the course of diagnosis and treatment. Though these records generally include structured components with predictable formats and data types, the remainder of the reports are often free-text and difficult to search, leading to challenges with patient care.[113] Numerous complete systems and tools have been developed to analyse these free-text portions.[114] The MedLEE system was originally developed for analysis of chest radiology reports but later extended to other report topics.[115] The clinical Text Analysis and Knowledge Extraction System, or cTAKES, annotates clinical text using a dictionary of concepts.[116] The CLAMP system offers similar functionality with a user-friendly interface.[117]

Frameworks

Computational frameworks have been developed to rapidly build tools for biomedical text mining tasks. SwellShark[118] is a framework for biomedical NER that requires no human-labeled data but does make use of resources for weak supervision (e.g., UMLS semantic types). The SparkText framework[119] uses Apache Spark data streaming, a NoSQL database, and basic machine learning methods to build predictive models from scientific articles.

APIs

Some biomedical text mining and natural language processing tools are available through application programming interfaces, or APIs. NOBLE Coder performs concept recognition through an API.[120]

Conferences

The following academic conferences and workshops host discussions and presentations in biomedical text mining advances. Most publish proceedings.

Conferences for Biomedical Text Mining
Conference Name Session Proceedings
Association for Computational Linguistics (ACL) annual meeting plenary session and as part of the BioNLP workshop
ACL BioNLP workshop [121]
American Medical Informatics Association (AMIA) annual meeting in plenary session
Intelligent Systems for Molecular Biology (ISMB) in plenary session and in the BioLINK and Bio-ontologies workshops [122]
International Conference on Bioinformatics and Biomedicine (BIBM) [123]
International Conference on Information and Knowledge Management (CIKM) within International Workshop on Data and Text Mining in Biomedical Informatics (DTMBIO) [124]
North American Association for Computational Linguistics (NAACL) annual meeting plenary session and as part of the BioNLP workshop
Pacific Symposium on Biocomputing (PSB) in plenary session [125]
Practical Applications of Computational Biology & Bioinformatics (PACBB) [126]
Text REtrieval Conference (TREC) formerly as part of TREC Genomics track; as of 2018 part of Precision Medicine Track [127]

Journals

Шаблон:See also A variety of academic journals publishing manuscripts on biology and medicine include topics in text mining and natural language processing software. Some journals, including the Journal of the American Medical Informatics Association (JAMIA) and the Journal of Biomedical Informatics are popular publications for these topics.

References

Шаблон:Reflist

Further reading

Шаблон:Refbegin

Шаблон:Refend

External links

Партнерские ресурсы
Криптовалюты
Магазины
Хостинг
Разное

  1. ↑ Шаблон:Cite journal
  2. ↑ Шаблон:Cite journal
  3. ↑ Шаблон:Cite book
  4. ↑ Шаблон:Cite book
  5. ↑ 5,0 5,1 5,2 Шаблон:Cite journal
  6. ↑ 6,0 6,1 Шаблон:Cite journal
  7. ↑ 7,0 7,1 Шаблон:Cite journal
  8. ↑ Шаблон:Cite journal
  9. ↑ Шаблон:Cite journal
  10. ↑ Шаблон:Cite journal
  11. ↑ Шаблон:Cite book
  12. ↑ Шаблон:Cite journal
  13. ↑ Шаблон:Cite book
  14. ↑ 14,0 14,1 Шаблон:Cite journal
  15. ↑ Шаблон:Cite journal
  16. ↑ Шаблон:Cite journal
  17. ↑ 17,0 17,1 Шаблон:Cite journal
  18. ↑ Шаблон:Cite journal
  19. ↑ Шаблон:Cite journal
  20. ↑ Шаблон:Cite journal
  21. ↑ Шаблон:Cite web
  22. ↑ Шаблон:Cite journal
  23. ↑ Шаблон:Cite journal
  24. ↑ Шаблон:Cite journal
  25. ↑ Шаблон:Cite journal
  26. ↑ Шаблон:Cite journal
  27. ↑ Шаблон:Cite journal
  28. ↑ Шаблон:Cite journal
  29. ↑ Шаблон:Cite journal
  30. ↑ Шаблон:Cite journal
  31. ↑ 31,0 31,1 Шаблон:Cite journal
  32. ↑ Шаблон:Cite journal
  33. ↑ Шаблон:Cite journal
  34. ↑ 34,0 34,1 Шаблон:Cite book
  35. ↑ Шаблон:Cite journal
  36. ↑ Шаблон:Cite journal
  37. ↑ Шаблон:Cite journal
  38. ↑ Шаблон:Cite journal
  39. ↑ Semantics Scholar. (2020) "Cut through the clutter:[Open Access] Download the Coronavirus Open Research Dataset". Semantics Scholar website Retrieved 30 March 2020
  40. ↑ Brennan, Patti. (24 March 2020). "Blog:How Does a Library Respond to a Global Health Crisis?". National Library of Medicine website Retrieved 30 March 2020.
  41. ↑ Шаблон:Cite news
  42. ↑ Шаблон:Cite conference
  43. ↑ Шаблон:Cite journal
  44. ↑ Шаблон:Cite journal
  45. ↑ Шаблон:Cite journal
  46. ↑ Шаблон:Cite journal
  47. ↑ Шаблон:Cite journal
  48. ↑ Шаблон:Cite journal
  49. ↑ Шаблон:Cite journal
  50. ↑ Шаблон:Cite journal
  51. ↑ Шаблон:Cite journal
  52. ↑ Шаблон:Cite journal
  53. ↑ Шаблон:Cite journal
  54. ↑ Шаблон:Cite journal
  55. ↑ Шаблон:Cite journal
  56. ↑ Шаблон:Cite journal
  57. ↑ Шаблон:Cite journal
  58. ↑ Шаблон:Cite journal
  59. ↑ Шаблон:Cite book
  60. ↑ Шаблон:Cite journal
  61. ↑ Шаблон:Cite journal
  62. ↑ Шаблон:Cite journal
  63. ↑ Шаблон:Cite web
  64. ↑ Шаблон:Cite journal
  65. ↑ Шаблон:Cite journal
  66. ↑ Шаблон:Cite journal
  67. ↑ Шаблон:Cite journal
  68. ↑ Шаблон:Cite book
  69. ↑ Шаблон:Cite journal
  70. ↑ Шаблон:Cite web
  71. ↑ Шаблон:Cite web
  72. ↑ Шаблон:Cite journal
  73. ↑ Шаблон:Cite web
  74. ↑ Шаблон:Cite journal
  75. ↑ Шаблон:Cite journal
  76. ↑ Шаблон:Cite book
  77. ↑ Шаблон:Cite web
  78. ↑ Шаблон:Cite journal
  79. ↑ Шаблон:Cite journal
  80. ↑ Шаблон:Cite web
  81. ↑ Шаблон:Cite journal
  82. ↑ Шаблон:Cite web
  83. ↑ Шаблон:Cite journal
  84. ↑ Шаблон:Cite web
  85. ↑ Шаблон:Cite journal
  86. ↑ Шаблон:Cite arXiv
  87. ↑ Шаблон:Cite web
  88. ↑ Шаблон:Cite web
  89. ↑ Шаблон:Cite journal
  90. ↑ Шаблон:Cite journal
  91. ↑ 91,0 91,1 Шаблон:Cite journal
  92. ↑ Шаблон:Cite journal
  93. ↑ Шаблон:Cite journal
  94. ↑ 94,0 94,1 Шаблон:Cite journal
  95. ↑ Шаблон:Cite journal
  96. ↑ Шаблон:Cite journal
  97. ↑ Шаблон:Cite conference
  98. ↑ Шаблон:Cite journal
  99. ↑ Шаблон:Cite journal
  100. ↑ Шаблон:Cite journal
  101. ↑ Шаблон:Cite journal
  102. ↑ Шаблон:Cite journal
  103. ↑ Шаблон:Cite journal
  104. ↑ Шаблон:Cite journal
  105. ↑ Шаблон:Cite journal
  106. ↑ Шаблон:Cite journal
  107. ↑ Шаблон:Cite journal
  108. ↑ Шаблон:Cite journal
  109. ↑ Шаблон:Cite journal
  110. ↑ Шаблон:Cite journal
  111. ↑ Шаблон:Cite journal
  112. ↑ Шаблон:Cite journal
  113. ↑ Шаблон:Cite journal
  114. ↑ Шаблон:Cite journal
  115. ↑ Шаблон:Cite journal
  116. ↑ Шаблон:Cite journal
  117. ↑ Шаблон:Cite journal
  118. ↑ Шаблон:Cite arXiv
  119. ↑ Шаблон:Cite journal
  120. ↑ Шаблон:Cite journal
  121. ↑ Шаблон:Cite web
  122. ↑ Шаблон:Cite web
  123. ↑ https://ieeexplore.ieee.org/xpl/conhome/1001586/all-proceedings
  124. ↑ Шаблон:Cite web
  125. ↑ Шаблон:Cite web
  126. ↑ Шаблон:Cite web
  127. ↑ Шаблон:Cite web
Источник — http://wikihandbk.com/ruwiki/index.php?title=Английская_Википедия:Biomedical_text_mining&oldid=13530631