Dynamic State Space Partitioning for Adaptive Simulation Algorithms
Journal Title: EAI Endorsed Transactions on Collaborative Computing - Year 2016, Vol 2, Issue 10
Abstract
Adaptive simulation algorithms can automatically change their configuration during runtime to adapt to changing computational demands of a simulation, e.g., triggered by a changing number of model entities or the execution of a rare event. These algorithms can improve the performance of simulations. They can also reduce the configuration effort of the user. By using such algorithms with machine learning techniques, the advantages come with a cost, i.e., the algorithm needs time to learn good adaptation policies and it must be equipped with the ability to observe its environment. An important challenge is to partition the observations to suitable macro states to improve the effectiveness and efficiency of the learning algorithm. Typically, aggregation algorithms, e.g., the adaptive vector quantization algorithm (AVQ), that dynamically partition the state space during runtime are preferred here. In this paper, we integrate the AVQ into an adaptive simulation algorithm.
Authors and Affiliations
Tobias Helms, Steffen Mentel, Adelinde Uhrmacher
Keywords
Related Articles
- EP ID EP45726
- DOI http://dx.doi.org/10.4108/eai.14-12-2015.2262710
- Views 286
- Downloads 0
Testing Software Using Swarm Intelligence: A Bee Colony Optimization Approach
Software testing is a critical activity in increasing our confidence of a system under test and improving its quality. The key idea for testing a software application is to minimize the number of faults found in the syst...
TinCan: User-Defined P2P Virtual Network Overlays for Ad-hoc Collaboration
Virtual private networking (VPN) has become an increasingly important component of a collaboration environment because it ensures private, authenticated communication among participants, using existing collaboration tool...
Welcome Message from the Editors-in-Chief
On behalf of the Editorial Board and the Advisory Board, we are pleased to welcome all to the inaugural issue of the EAI Endorsed Transactions on Collaborative Computing. This journal reflects the increasing maturity...
Automated Dimension Determination for NMF-based Incremental Collaborative Filtering
The nonnegative matrix factorization (NMF) based collaborative filtering t e chniques h a ve a c hieved great success in product recommendations. It is well known that in NMF, the dimensions of the factor matrices have t...
Space Searching Algorithms Used by Fungi
Experimental studies have shown that fungi use a natural program for searching the space available in micro-confined networks, e.g., mazes. This natural program, which comprises two subroutines, i.e., collision-induced b...