A Non-Deterministic Strategy for Searching Optimal Number of Trees Hyperparameter in Random Forest
Journal Title: Annals of Computer Science and Information Systems - Year 2018, Vol 15, Issue
Abstract
In this paper, we present a non-deterministic strategy for searching for optimal number of trees hyperparameter in Random Forest (RF). Hyperparameter tuning in Machine Learning (ML) algorithms is essential. It optimizes predictability of an ML algorithm and/or improves computer resources utilization. However, hyperparameter tuning is a complex optimization task and time wasting. We set up experiments with the goal of maximizing predictability, minimizing number of trees and minimizing time of execution. Compared to the deterministic algorithm, this research's non-deterministic algorithm recorded an average percentage accuracy of approximately 98\\%, number of trees percentage average improvement of 44.64\\%, average time of execution mean improvement ratio of 212.79 and an average improvement of 93\\% iterations. Moreover, evaluations using Jackkife Estimation show stable and reliable results from several experiment runs of the non-deterministic strategy. The non-deterministic approach in selecting hyperparameter shows a significant accuracy and better computer resources (i.e cpu and memory time) utilization. This approach can be adopted widely in hyperparameter tuning, and in conserving utilization of computer resources i.e green computing.
Authors and Affiliations
Kennedy Senagi, Nicolas Jouandeau
Keywords
Related Articles
- EP ID EP569796
- DOI 10.15439/2018F202
- Views 23
- Downloads 0
Proposal for simplified implementation of risk assessment method for measuring instruments
Legal Metrology is the economic sector where measuring instruments subject to legal control (taximeters, electricity meters, etc.) are used. In this field, constant growth of Measuring Instruments using ICT technology is...
Ranking Rough Sets in Pawlak Approximation Spaces
By the cardinality of finite sets, interval numbers can be assigned to rough sets which are represented by nested sets. Borrowing two different comparison methods from Multiple Attribute Decision Making analysis, rough s...
Real Time Risk Monitoring in Fine-art with IoT Technology
This work presents a bespoke system used to monitor inter-modal logistics within the fine arts industry. A custom IoT architecture provides end-to-end capabilities allowing continuous risk assessment during storage, hand...
The Potential of the Internet of Things in Knowledge Management System
Along with the increasing globalization and development of information and communication technology, business models are changing, and thus the need for innovative knowledge management is growing. Current knowledge manag...
ECG signal coding methods in digital systems
Article contains an overview of ECG signal coding methods. The presented methods are used to record and present he raw ECG signal in digital systems. The aim of the presentation is to choose the best technique for use in...