An Integrated BERT-XGBoost Framework for Open-Source Intelligence Classification in Aerospace Technology
Journal Title: Information Dynamics and Applications - Year 2024, Vol 3, Issue 4
Abstract
Open-source intelligence in aerospace technology often contains lengthy text and numerous technical terms, which can affect classification accuracy. To enhance the precision of classifying such intelligence, a classification algorithm integrating the Bidirectional Encoder Representations from Transformers (BERT) and Extreme Gradient Boosting (XGBoost) models was proposed. Initially, key features within the intelligence were extracted through the deep structure of the BERT model. Subsequently, the XGBoost model was utilised to replace the final output layer of BERT, applying the extracted features for classification. To verify the algorithm's effectiveness, comparative experiments were conducted against prominent language models such as Text Recurrent Convolutional Neural Network (TextRCNN) and Deep Pyramid Convolutional Neural Network (DPCNN). Experimental results demonstrate that, for open-source intelligence classification in aerospace technology, this algorithm achieved accuracy improvements of 1.9% and 2.2% over the TextRCNN and DPCNN models, respectively, confirming the algorithm's efficacy in relevant classification tasks.
Authors and Affiliations
Suping Yu, Weiwei Mao
Keywords
Related Articles
- EP ID EP759520
- DOI https://doi.org/10.56578/ida030403
- Views 33
- Downloads 1
Ensemble Learning Applications in Multiple Industries: A Review
This study proposes a systematic review of the application of Ensemble learning (EL) in multiple industries. This study aims to review prevailing application in multiple industries to guide for the future landing applica...
Detection of Fruit Ripeness and Defectiveness Using Convolutional Neural Networks
The classification of fruit ripeness and detection of defects are critical processes in the agricultural industry to minimize losses during commercialization. This study evaluated the performance of three Convolutional N...
Comparative Analysis of Machine Learning Algorithms for Daily Cryptocurrency Price Prediction
The decentralised nature of cryptocurrency, coupled with its potential for significant financial returns, has elevated its status as a sought-after investment opportunity on a global scale. Nonetheless, the inherent unpr...
FEGAO: A Revolutionary Method for Enhancing Defective Fuzzy Images with Non-Linear Refinement
This study presents a novel image restoration method, designed to enhance defective fuzzy images, by utilizing the Fuzzy Einstein Geometric Aggregation Operator (FEGAO). The method addresses the challenges posed by non-l...
An Enhanced Convolutional Neural Network for Accurate Classification of Grape Leaf Diseases
Grape leaf diseases can significantly reduce grape yield and quality, making accurate and efficient identification of these diseases crucial for improving grape production. This study proposes a novel classification meth...