Analysis of statistical methods for stable combinations determination of keywords identification
Journal Title: Восточно-Европейский журнал передовых технологий - Year 2018, Vol 2, Issue 2
Abstract
<p class="a">The study has solved the task of making comparative analysis and choosing an optimal statistical method to determine stable word combinations while identifying keywords to process English-language and Ukrainian-language Web-resources. The effectiveness of the method directly proportionally depends on the quality of linguistic analysis, of Ukrainian and English texts, respectively, based on the technology of Web Mining and NLP. A decomposition of methods of linguistic analysis was performed to determine the impact on the quality of forming stable word combinations as keywords. The features of the method are the adaptation of the morphological and syntactic analyses of lexical units to the peculiarities of Ukrainian-language words/texts.</p><p class="a">To determine stable word combinations effectively, it is essential to exclude functional words (stops or references), pronouns, numerals and verbs because they are not related to the subject and content of a published work. A set of stable word combinations as keywords is determined by qualitative morphological and syntactic analyses of relevant texts. The set of the identified stable word combinations is used further to compare and determine the degree of the text relevance to a specific topic or user request. The internal “dynamics” of forming a set of stable word combinations as keywords was investigated in the study depending on the statistical method applied to the texts. The obtained results have been verified.</p><p class="a">The study has produced results of the experimental testing of the proposed content-monitoring method for determining stable word combinations to identify keywords in the processing of English-language and Ukrainian-language web-resources of the technical content based on Web Mining technology. It has been determined that the authors of published works often identify the keywords that are far from being considered. It has also been proven that the quality of the result is influenced by the quality of linguistic analysis of texts and subsequent filtering. Further experimental research requires approbation of the proposed method for determining keywords for other categories of texts – scientific, humanitarian, belletristic, journalistic, etc.</p>
Authors and Affiliations
Vasyl Lytvyn, Victoria Vysotska, Dmytro Uhryn, Mariya Hrendus, Oleh Naum
Keywords
Related Articles
- EP ID EP527851
- DOI 10.15587/1729-4061.2018.126009
- Views 135
- Downloads 0
Improving the reliability of informationcontrol systems at power generation facilities based on the fractalcluster theory
<p>We have developed a cluster model for the structure of an informational space as a combination of informational signals that carry information about emergency signs at a deviation of a technological process parameters...
Prediction of specific electrical resistivity of polymeric composites based on carbon fabrics
<p class="a">We have proposed an improved approach to forecasting electrical resistivity of composite materials based on carbon fabrics by using a finite element method that takes into consideration a deformation of the...
Development of the analytical method of the general mathieu equation solution
<p>An analytical method for solving the general Mathieu differential equation in the initial form is proposed. The method is based on the corresponding exact solution, which is found for arbitrary numerical parameters of...
Application of the new structural solutions in the seeders for precision sowing as a resource saving direction
<p>The study reported here provides a possibility to improve the reliability of conducting a technological process of dispensing the seeds, which affects the efficiency, that is, the cost of seed material, by introducing...
A study of the effect of tungstate ions on the electrochromic properties of Ni(OH)2 films
<p class="1">Thin films of nickel hydroxide were prepared using the cathodic template method and were tested in different electrolytes. The electrolytes were 0.1 M KOH and 0.1 M KOH with the addition of 0.1, 0.3 and 1 mM...