Evaluating The Performance of Machine Learning Models in Audit Opinion Prediction – A Study in Vietnam
Journal Title: Engineering and Technology Journal - Year 2024, Vol 9, Issue 10
Abstract
This study investigates the effectiveness of machine learning models in predicting audit opinions using a dataset from the FiinPro-X platform, comprising 9,783 audited consolidated financial statements from public companies listed on Vietnamese stock exchanges from 2016 to 2023. The dataset spans various industries, excluding banks and financial institutions, and focuses on identifying key financial, non-financial, and qualitative variables that influence audit opinions. Six supervised learning algorithms were applied—Logistic Regression, K-Nearest Neighbors (KNN), Decision Trees, Random Forests, Support Vector Machines (SVM), and Naive Bayes—evaluated based on their ability to predict both fully acceptable (unqualified) and non-fully acceptable audit opinions. All data processing and model training were implemented in a Python environment. The Random Forest model demonstrated the best overall performance, achieving an accuracy of 0.868 and an AUC-ROC of 0.87, though its F1 score for predicting non-fully acceptable audit opinions was lower (0.585). This suggests that while machine learning models can improve prediction accuracy, challenges remain in handling imbalanced data and non-linear relationships among input variables. The study also reduced the number of features by 30%, improving the models’ performance. Future research should further refine data and feature construction processes to ensure comparability and practical applicability.
Authors and Affiliations
Dang Dinh TanHo
Keywords
Related Articles
- EP ID EP748277
- DOI 10.47191/etj/v9i10.17
- Views 34
- Downloads 0
DATA PROCESSING ANALYSIS USING MATERIAL REQUIREMNT PLANNING (MRP) METHOD AT PT. XYZ
This journal discusses the application of material requirements management strategies in various manufacturing industries, based on material requirements planning (MRP) methodology. Manufacturing industries around the wo...
Influence of Natural Filler Powder on the Some Physical Properties of Polyurethane Foam Composites
An investigation was conducted to analyze the impact of incorporating perlite stone powder particles at different weight ratios (5, 10, 15, 25, and 35) on the polyurethane polymer's mechanical properties and thermal cond...
Evaporator Evaluation as a Heat Exchanger in Refrigeration Systems at Constant Thermal Load and Fouling Factor
Heat exchangers are widely used in various industrial installations, one of which is their use in air conditioning systems. In the design process of heat exchangers, the main focus is to determine the dimensions of the d...
Threat Modeling for Enhanced Security in the Healthcare Industry with a Focus on Mobile Health and IoT
The advancement of mobile health and the Internet of Things (IoT) promises to enhance healthcare quality while reducing costs, particularly with the transition from inpatient to home and ambulatory care. This shift, driv...
COMPARISON OF PROBABILITY IMPACT MATRIX AND FUZZY LOGIC METHODS FOR RISK ANALYSIS OF RURAL INFRASTRUCTURE PROJECTS IN INDONESIA
Through the provision of facilities and infrastructure in the Village, it can be used as an effort to empower the community to accelerate regional economic development that is effective and robust. In its implementation,...