A Formal Verification Model for Performance Analysis of Reinforcement Learning Algorithms Applied to Dynamic Networks - Europub

Search

A Formal Verification Model for Performance Analysis of Reinforcement Learning Algorithms Applied to Dynamic Networks

Journal Title: Journal of Applied Computer Science & Mathematics - Year 2017, Vol 11, Issue 23

Abstract

Routing data packets in a dynamic network is a difficult and important problem in computer networks. As the network is dynamic, it is subject to frequent topology changes and is subject to variable link costs due to congestion and bandwidth. Existing shortest path algorithms fail to converge to better solutions under dynamic network conditions. Reinforcement learning algorithms posses better adaptation techniques in dynamic environments. In this paper we apply model based Q-Routing technique for routing in dynamic network. To analyze the correctness of Q-Routing algorithms mathematically, we provide a proof and also implement a SPIN based verification model. We also perform simulation based analysis of Q-Routing for given metrics.

Authors and Affiliations

ALNASER As'ad Mahmoud As'ad

Keywords

Dynamic Networks Reinforcement Learning QRouting. SPIN model checking.

Related Articles

Application Of Mathematical Methods For Condition Monitoring Of Oil And Gas Facilities

irections for numerical realization of two-dimensional models in different frames account for environmental heterogeneity of matter distribution have been presented. The schemes allow to measure concentration of substanc...

An Attribute Involved Public Key Cryptosystem Based on P-Sylow Subgroups and Randomization

The Asymmetric Key Cryptosystem (AKC) or Public Key Encryption (PKE) is a mechanism used to encrypt the messages by using public key and decrypt the enciphered messages by using private key. Of late, the Attribute-Base...

Novel Kernel to Diagnose Dermatological Disorders

Development of computer aided system to diagnose dermatological disorders works as a second opinion when skin diseases have very little differences in clinical features. Support Vector Machine (SVM) is a good classifier...

Data mining techniques for e-learning

Data Mining (DM), sometimes called Knowledge Discovery in Databases (KDD), is a powerful new technology with great potential to help companies focus on the most important information in the data they have collected via t...

Identification of Core Architecture Classes for Object-Oriented Software Systems

The new member of the software development team needs to understand the software prior making modifications to the unknown system. The core classes that constitute the system architecture can reveal important structural...