DISTRIBUTION OF THE NEURAL NETWORK BETWEEN MOBILE DEVICE AND CLOUD INFRASTRUCTURE SERVICES
Journal Title: Современные информационные технологии и ИТ-образование - Year 2018, Vol 14, Issue 4
Abstract
Neural networks become the only way to solve problems in some areas. Such tasks as recognition of images, sounds, classification require serious processor power and memory for training and functioning of the network. Modern mobile devices have quite good characteristics for primary layers of deep neural networks, but there are not enough resources for whole network. Since neural networks for mobile devices are trained separately on external resources, a method of distributed work of a neural network with vertical distribution over sets of layers with synchronization of training data was developed. The model is divided after saving its state, all layers on the mobile device are converted to the format for the mobile framework and synchronized with the device after training on a distributed platform. Variables and coefficients are formed separately, which allows to significantly reduce the size of the neural network data file uploaded to the device. An algorithm for automatic selection of a neural network separation point was proposed. It based on the data amount transferred between the layers and the load on the mobile device resources. The approach allows to use full-size deep neural networks with a mobile device. Performance experiment showed possibility of obtains an acceptable response even with an unstable communication channel without overloading communication channels and device resources.
Authors and Affiliations
Yuri Ushakov, Petr Polezhaev Petr, Aleksandr Shukhman, Margarita Ushakova
Keywords
Related Articles
- EP ID EP523569
- DOI 10.25559/SITITO.14.201804.903-910
- Views 105
- Downloads 0
RESOURCE INTENSITY CALCULATION For TEXTS LANGUAGE IDENTIFICATION PROGRAMS
The article deals with the resource intensity calculation of texts language identification programs depending on their identification methods. The most commonly used methods are described, together with an indication of...
INNOVATIVE DIDACTIC ELECTRONIC RESOURCES AND TEACHER'S PRODUCTS IN IT-EDUCATION
The article describes the design and implementation of computer support for the teacher’s activities, which combines such opportunities as data accounting and analysis, the use of pedagogical technology, and the situatio...
ANALYSIS OF INDICATORS FOR ASSESSING THE EFFICIENCY OF STRUCTURAL SUBDIVISIONS OF THE UNIVERSITY
The task of the authors was to rank the factors that are used to assess the rating of the structural units of the University. The authors define and describe the stages of ranking. The statistical analysis of data struct...
USING SYSTEMS APPROACH TO BUILD EDUCATION PROCESS BASED ON TECHNOLOGIES OF INTERACTIVE SUPPORT AND STUDENTS IDENTIFICATION
In the article systems approach to build educational complex with using IT and didactic methods is discussed. Technologies for each level of educational system are determined. Such kind of system supports interactivity a...
VECTORIZATION OF OPERATIONS ON SMALL-DIMENSIONAL MATRICES FOR INTEL XEON PHI KNIGHTS LANDING PROCESSOR
The article is devoted to the vectorization of calculations for Intel Xeon Phi Knights Landing (KNL) processor. Small-dimensional matrices are considered as objects for optimization. These operations are wide common in c...