CLOUD SERVICES FOR NATURAL LANGUAGE PROCESSING
Journal Title: Современные информационные технологии и ИТ-образование - Year 2018, Vol 14, Issue 4
Abstract
The paper presents the results of experiments conducted with the aim of a comparative analysis of the performance of the existing cloud services for natural language processing in Russian. The article provides an overview of 10 cloud services: TextRazor, RosetteTextAnalytics, EurekaEngine, CloudNaturalLanguage, Texterra, Pullenti, NER-ru, UDPipe, AOT, DeepPavlov. Quantitative studies of their performance were made for 6 of them. In the process of evaluating services, the execution of such functions as the part of speech tagging, sentiment analysis, named entity recognition and the categorization of texts were analyzed. For a comparative assessment of the quality of the services, the following competition materials were used: factRuEval-2016 (named entities), AlemResearch (sentiment) and the corpora, Taiga and OpenCorpora (part of speech). The named entities recognition quality was evaluated by calculating Accuracy, Precision, Recall, and F1 parameters. As a result of the study, it was shown that when solving natural language text processing tasks in Russian, the best result is shown by the EurekaEngine service for recognizing named entities and sentiment analysis of the text, RosetteTextAnalytics service proved best in part of speech tagging the and TextRazor service in text categorization.
Authors and Affiliations
Ravil Mukhamediev, Adilkhan Symagulov, Yan Kuchin, Sabina Abdullayeva, Farida Abdoldina
Keywords
Related Articles
- EP ID EP522107
- DOI 10.25559/SITITO.14.201804.872-880
- Views 113
- Downloads 0
THE DEVELOPMENT OF APPROACHES FOR OBTAINING AUTOMATED SOLUTION ON THE FORMATION OF THE CURRICULUM
Modeling of training processes contributes to obtaining effective solutions of problems in the educational system. One of the most important tasks in the planning of the educational process is computer-aided curriculum d...
MODELING AND ANALYSIS OF FEATURES OF TEAM PLAY STRATEGIES IN ESPORTS APPLICATIONS
The perfect combination of sports and information technologies, implemented in video and computer games, has made eSports unusually popular, rapidly developing and meeting the challenges of the modern world. The scale of...
ABOUT THE EXPERIENCE OF REALIZATION OF THE UNIVERSITY INFORMATION TECHNOLOGY CLASSES
The article gives a brief description of the methods and forms of implementation, as well as models of university profile classes. The experience of the Orenburg State University on the implementation of university infor...
POSSIBILITIES OF PARTICIPATION OF THE UNIVERSITY "DUBNA" IN THE DEVELOPMENT OF OPEN EDUCATION
The article is devoted to new approaches to the organization of the educational process. Modern society dictates its requirements for training. The paper describes the opportunities and directions for introducing modern...
INFORMATION REVOLUTION: INSTRUMENTS OF ANALYSIS AND FORECASTING. Instruments of information revolution applied analysis and some results of their usage
The paper describes application of traditional analytical models of technology change - General Purpose Tecnhology, Saarbrücken model of technology transfer, S-shaped curve - towards current information revolution. Analy...