HUANG Liyuan,ZHANG Jin,JIN Xiaolong,et al.Stance detection method based on knowledge augmentation and adversarial training[J].BIG DATA RESEARCH,DOI:10.11959/j.issn.2096-0271.25261.
Stance detection method based on knowledge augmentation and adversarial training
Stance detection is a crucial research direction in natural language processing
aiming to determine the author's supportive
opposing
or neutral attitude towards a specific target. To address challenges such as complex linguistic expressions
insufficient domain-specific knowledge
and weak model generalization in social media contexts
this paper proposed a stance detection method named KABERT
based on knowledge augmentation and adversarial training. The method integrated the advantages of generative and discriminative models. A generative model was first used to extract deep semantic relationships between text and the target from the perspectives of keywords
implicit sentiment
and rhetorical devices
generating implicit knowledge. Then
a discriminative model was used as the classification backbone network for supervised fine-tuning
and a fast gradient method was introduced for adversarial training. Experiments were conducted on two standard stance detection datasets
SEM16 and P-Stance. Results show that KABERT achieves Macro-F1 scores of 68.85% and 79.24% respectively
outperforming current mainstream approaches by varying margins
demonstrating the effectiveness of the proposed approach.
关键词
Keywords
references
Zhang B , Dai G , Niu F , et al . A Survey of Stance Detection on Social Media: New Directions and Perspectives [J ] . arXiv preprint arXiv: 2409.15690 , 2024 .
Du J , Xu R , He Y , et al . Stance classification with target specific neural attention networks [C ] // International Joint Conferences on Artificial Intelligence , 2017 . 3988 - 3994 .
Bai J , Li F , Ji D H . Attention Based BiLSTM-CNN Chinese Microblogging Position Detection Model . Computer Applications and Software , 2018 , 35 ( 3 ): 266 - 274 .
Yang S C , Li Y , Zhao Q F . Stance Detection Method of Chinese Micro-Blog Based on GCN and Bi-LSTM . Journal of Chongqing University of Technology(Natural Science) , 2020 , 34 ( 6 ): 167 - 173 .
Radford A , Narasimhan K , Salimans T , et al . Improving language understanding by generative pre-training [J ] . 2018 .
Devlin , Jacob , et al . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding [C ] // Proceedings of NAACL-HLT . 2019 : 4171 - 4186 .
Nguyen D Q , Vu T , Nguyen A T . Bertweet: A pre-trained language model for English Tweets [J ] . arXiv preprint arXiv: 2005.10200 , 2020 .
Li Y J , T S , A S , et al . 2021 . P-Stance: A Large Dataset for Stance Detection in Political Domain . In Findings of the Association for Computational Linguistics : ACL-IJCNLP 2021 , pages 2355 – 2365 .
Huang H , Zhang B W , Li Y Y , et al . 2023 . Knowledge-enhanced prompt-tuning for stance detection. ACM Trans. Asian Low Resour. Lang. Inf . Process. , 22 ( 6 ): 159 : 1 – 159 : 20 .
Li A , Liang B , Zhao J Q , et al . 2023 . Stance Detection on Social Media with Background Knowledge . In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 15703 – 15717 , Singapore. Association for Computational Linguistics.
Goodfellow I J , Shlens J , Szegedy C . Explaining and harnessing adversarial examples [J ] . arXiv preprint arXiv: 1412.6572 , 2014 .
Miyato T , Dai A M , Goodfellow I . Adversarial training methods for semi-supervised text classification [J ] . arXiv preprint arXiv: 1605.07725 , 2016 .
Madry A , Makelov A , Schmidt L , et al . Towards deep learning models resistant to adversarial attacks [J ] . arXiv preprint arXiv: 1706.06083 , 2017 .
Zhu D , Lin W , Zhang Y , et al . At-bert: Adversarial training bert for acronym identification winning solution for sdu@ aaai-21 [J ] . arXiv preprint arXiv: 2101.03700 , 2021 .
Zhang Z , Li Y , Zhang J , et al . Llm-driven knowledge injection advances zero-shot and cross-target stance detection [C ] // Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers) . 2024 : 371 - 378 .
Vaswani A , Shazeer N , Parmar N , et al . Attention is all you need [J ] . Advances in neural information processing systems , 2017 , 30 .
Karimi A , Rossi L , Prati A . Adversarial training for aspect-based sentiment analysis with bert [C ] // 2020 25th International conference on pattern recognition (ICPR) . IEEE , 2021 : 8797 - 8803 .
Saif M , Svetlana K , Parinaz S , et al . Semeval-2016 Task 6: Detecting Stance in Tweets . In Proceedings of the International Workshop on Semantic Evaluation (SemEval ’ 16 ). June 2016. San Diego, California .
Graves A , Schmidhuber J . Framewise phoneme classification with bidirectional LSTM and other neural network architectures [J ] . Neural networks , 2005 , 18 ( 5-6 ): 602 - 610 .
Augenstein I , RocktÄSchel T , Vlachos A , et al . Stance Detection with Bidirectional Conditional Encoding [C ] . Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing , 2016 , pp. 876 – 885 .
Kim Y . Convolutional neural networks for sentence classification [J ] . Empirical Methods in Natural Language Processing , 2014 : 1746 - 1751 .
Liu Y H , Ott M , Goyal N , et al . RoBERTA: a robustly optimized BERT pretraining approach [J ] . arXiv preprint arXiv: 1907.11692 , 2019 .
Yao Z , Yang W , Wei F . Enhancing zero-shot stance detection with contrastive and prompt learning [J ] . Entropy , 2024 , 26 ( 4 ): 325 .
Nguyen Q M , Kim T . Is External Information Useful for Stance Detection with LLMs? [J ] . arXiv preprint , 2019 ,arXiv: 2507.01543 , 2025.