Journal of Cyber Security and Risk Auditing

ISSN: 3079-5354 (Online)

Interpretable Deep Learning-Based AI Framework with Multi-Sequence Attention for Brain Tumor Subtype Classification in MRI Scans

by 

Omar Gheni Abdulateef

PDF logoPDF

Published: 2025/05/14

Abstract

Robust and interpretable classification of brain tumor subtypes remains a core challenge in medical image analysis due to tumor heterogeneity, modality-specific contrast variations, and limited generalizability of conventional models. This research proposes a deep learning-based framework leveraging Convolutional Neural Networks (CNN), Transformer-based architectures, and multi-sequence attention mechanisms to classify glioma subtypes using T1, T1c, T2, and FLAIR MRI sequences from the BraTS 2023 dataset. The attention-enhanced CNN model achieved state-of-the-art performance with an F1-score of 0.974, AUC of 0.982, and classification accuracy of 98.2%, outperforming baseline CNNs (F1 = 0.88) and radiomics-based SVM models (F1 = 0.84). Integration of spatial and inter-sequence attention enabled dynamic weighting of modality-specific features, enhancing diagnostic precision and model interpretability. Grad-CAM and SHAP-based attribution maps showed a 90% overlap with expert-defined tumor regions, and a mean interpretability rating of 4.8/5 from clinical reviewers. The system maintained <150ms inference latency, meeting real-time diagnostic constraints. Transformer models demonstrated marginally higher accuracy but required 40–60% more compute resources, limiting their deployment feasibility. Early stopping at epoch 25 effectively minimized overfitting and preserved generalization across institutional data sources. Comparative benchmarking against ARIMA, SVM, and prior CNN architectures validated the superiority of attention-integrated deep networks in high-dimensional, multi-modal neuroimaging classification. The findings establish a scalable and clinically deployable AI framework for brain tumor subtype discrimination, with future directions including hybrid radiomics-transformer models and federated learning for decentralized clinical deployment.

Keywords

Brain Tumor Subtype ClassificationMulti-Sequence MRIExplainable AIClinical Deep LearningGlioma Segmentation

Doi Link

https://doi.org/10.63180/jcsra.thestap.2025.2.5

How to Cite the Article

Abdulateef, O. G. (2025). Interpretable Deep Learning-Based AI Framework with Multi-Sequence Attention for Brain Tumor Subtype Classification in MRI Scans. Journal of Cyber Security and Risk Auditing, 2025(2), 53–66. https://doi.org/10.63180/jcsra.thestap.2025.2.5

Interpretable Deep Learning-Based AI Framework with Multi-Sequence Attention for Brain Tumor Subtype Classification in MRI Scans is licensed under CC BY 4.0CCBY

References

  1. Amarnath, A., Al Bataineh, A., & Hansen, J. A. (2024). Transfer-learning approach for enhanced brain tumor classification in MRI imaging. BioMedInformatics, 4, 1745–1756.
  2. Özkaraca, O., Bağrıaçık, O. İ., Gürüler, H., Khan, F., Hussain, J., Khan, J., & Laila, U. E. (2023). Multiple brain tumor classification with dense CNN architecture using brain MRI images. Life, 13, 349.
  3. Ayadi, W., Elhamzi, W., Charfi, I., & Atri, M. (2021). Deep CNN for brain tumor classification. Neural Processing Letters, 53, 671–700.
  4. Munir, K., Elahi, H., Ayub, A., Frezza, F., & Rizzi, A. (2019). Cancer diagnosis using deep learning: A bibliographic review. Cancers, 11, 1235.
  5. Price, M., et al. (2024). CBTRUS statistical report: Primary brain and other central nervous system tumors diagnosed in the United States in 2017–2021. Neuro-Oncology, 26, vi1–vi85.
  6. Thakkar, P., Greenwald, B. D., & Patel, P. (2020). Rehabilitation of adult patients with primary brain tumors: A narrative review. Brain Sciences, 10, 492.
  7. Tandel, G. S., et al. (2019). A review on a deep learning perspective in brain cancer classification. Cancers, 11, 111.
  8. Abdusalomov, A. B., Mukhiddinov, M., & Whangbo, T. K. (2023). Brain tumor detection based on deep learning approaches and magnetic resonance imaging. Cancers, 15, 4172.
  9. Deepak, S., & Ameer, P. M. (2019). Brain tumor classification using deep CNN features via transfer learning. Computers in Biology and Medicine, 111, 103345.
  10. Polat, Ö., & Güngen, C. (2021). Classification of brain tumors from MR images using deep transfer learning. The Journal of Supercomputing, 77, 7236–7252.
  11. Srinivas, C., et al. (2022). Deep transfer learning approaches in performance analysis of brain tumor classification using MRI images. Journal of Healthcare Engineering, 2022, 3264367.
  12. Wang, S., et al. (2019). Artificial intelligence in lung cancer pathology image analysis. Cancers, 11, 1673.
  13. Gurcan, F., Dalveren, G. G. M., Cagiltay, N. E., & Soylu, A. (2022). Detecting latent topics and trends in software engineering research since 1980 using probabilistic topic modeling. IEEE Access, 10, 74638.
  14. Gurcan, F., & Soylu, A. (2024). Learning from imbalanced data: Integration of advanced resampling techniques and machine learning models for enhanced cancer diagnosis and prognosis. Cancers, 16, 3417.
  15. Kaya, Y., & Gürsoy, E. (2023). A Mobile Net-based CNN model with a novel fine-tuning mechanism for COVID-19 infection detection. Soft Computing, 27, 5521–5535.
  16. Gurcan, F. (2023). What issues are data scientists talking about? Identification of current data science issues using semantic content analysis of Q&A communities. PeerJ Computer Science, 9, e1361.
  17. Gürsoy, E., & Kaya, Y. (2024). Brain-GCN-Net: Graph-convolutional neural network for brain tumor identification. Computers in Biology and Medicine, 180, 108971.
  18. Swati, Z. N. K., et al. (2019). Brain tumor classification for MR images using transfer learning and fine-tuning. Computerized Medical Imaging and Graphics, 75, 34–46.
  19. Kaya, Y., & Gürsoy, E. (2023). A novel multi-head CNN design to identify plant diseases using the fusion of RGB images. Ecological Informatics, 75, 101998.
  20. Islam, M. M., et al. (2023). Transfer learning architectures with fine-tuning for brain tumor classification using magnetic resonance imaging. Healthcare Analytics, 4, 100270.
  21. Gurcan, F., & Soylu, A. (2024). Synthetic boosted resampling using deep generative adversarial networks: A novel approach to improve cancer prediction from imbalanced datasets. Cancers, 16, 4046.
  22. Badža, M. M., & Barjaktarović, M. Č. (2020). Classification of brain tumors from MRI images using a convolutional neural network. Applied Sciences, 10(6), 1999. https://doi.org/10.3390/app10061999
  23. Nickparvar, M. (2025). Brain_Tumor_MRI Dataset. Kaggle. https://www.kaggle.com/datasets/masoudnickparvar/brain-tumor-mri-dataset
  24. Mathivanan, S. K., et al. (2024). Employing deep learning and transfer learning for accurate brain tumor detection. Scientific Reports, 14, 7232.
  25. Rajput, I. S., Gupta, A., Jain, V., & Tyagi, S. (2024). A transfer learning-based brain tumor classification using magnetic resonance images. Multimedia Tools and Applications, 83, 20487–20506.
  26. Gómez-Guzmán, M. A., et al. (2023). Classifying brain tumors on magnetic resonance imaging by using convolutional neural networks. Electronics, 12, 955.
  27. Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1800–1807). Honolulu, HI, USA.
  28. Sandler, M., et al. (2018). MobileNetV2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, UT, USA.
  29. Xia, X., Xu, C., & Nan, B. (2017). Inception-v3 for flower classification. In Proceedings of the ICIVC, Chengdu, China.
  30. Wu, Z., Shen, C., & van den Hengel, A. (2019). Wider or deeper: Revisiting the ResNet model for visual recognition. Pattern Recognition, 90, 119–133.
  31. Teoh, J. R., Hasikin, K., Lai, K. W., Wu, X., & Li, C. (2024). Enhancing early breast cancer diagnosis through automated microcalcification detection using an optimized ensemble deep learning framework. PeerJ Computer Science, 10, e2082.
  32. Cinar, N., Ozcan, A., & Kaya, M. (2022). A hybrid DenseNet121-UNet model for brain tumor segmentation from MR images. Biomedical Signal Processing and Control, 76, 103647.
  33. Ullah, N., et al. (2022). An effective approach to detect and identify brain tumors using transfer learning. Applied Sciences, 12, 5645.
  34. Gurcan, F. (2024). Forecasting CO₂ emissions of fuel vehicles for an ecological world using ensemble learning, machine learning, and deep learning models. PeerJ Computer Science, 10, e2234.
  35. Abdolahnejad, M., Bhagwat, R., & Moocarme, M. (2020). Deep Learning with Keras Workshop. Birmingham, UK: Packt Publishing Ltd.
  36. Raschka, S., & Mirjalili, V. (2019). Python Machine Learning: Machine Learning and Deep Learning with Python, Scikit-Learn, and TensorFlow 2. Birmingham, UK: Packt Publishing Ltd.
  37. Yang, A., et al. (2019). Research on feature extraction of tumor image based on convolutional neural network. IEEE Access, 7, 24204–24213.
  38. Kumar, V., et al. (2022). Addressing binary classification over class imbalanced clinical datasets using computationally intelligent techniques. Healthcare, 10, 1293.
  39. Raschka, S., Patterson, J., & Nolet, C. (2020). Machine learning in Python: Main developments and technology trends in data science, machine learning, and artificial intelligence. Information, 11, 193.
  40. Rahman, M. A., et al. (2021). Artificial neural network with Taguchi method for robust classification model to improve classification accuracy of breast cancer. PeerJ Computer Science, 7, 2–27.
  41. Khan, S., Rahmani, H., Shah, S. A. A., & Bennamoun, M. (2018). A Guide to Convolutional Neural Networks for Computer Vision. Synthesis Lectures on Computer Vision, 8, 1–207.
  42. Vrbančič, G., & Podgorelec, V. (2020). Transfer learning with adaptive fine-tuning. IEEE Access, 8, 196197–196211.
  43. Islam, S. S., et al. (2022). Application of machine learning algorithms to predict the thyroid disease risk: An experimental comparative study. PeerJ Computer Science, 8, e898.
  44. Gürsoy, E., & Kaya, Y. (2025). Multi-source deep feature fusion for medical image analysis. Multidimensional Systems and Signal Processing, 36, 1–20.
  45. Ferroni, P., et al. (2019). Breast cancer prognosis using a machine learning approach. Cancers, 11, 328.
  46. Ullah, N., et al. (2022). A robust end-to-end deep learning-based approach for effective and reliable BTD using MR images. Sensors, 22, 7575.
  47. Cantone, M., Marrocco, C., Tortorella, F., & Bria, A. (2023). Convolutional networks and transformers for mammography classification: An experimental study. Sensors, 23, 1229.
  48. Yaqub, M., Feng, J., Zia, M. S., Arshid, K., Jia, K., Rehman, Z. U., & Mehmood, A. (2020). State-of-the-art CNN optimizer for brain tumor segmentation in magnetic resonance images. Brain Sciences, 10(7), 427. https://doi.org/10.3390/brainsci10070427
  49. Benzorgat, N., Xia, K., & Benzorgat, M. N. E. (2024). Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration. PeerJ Computer Science, 10, e2425. https://doi.org/10.7717/peerj-cs.2425
  50. Amin, J., Sharif, M., Yasmin, M., & Fernandes, S. L. (2020). A distinctive approach in brain tumor detection and classification using MRI. Pattern Recognition Letters, 139, 118–127.
  51. Mehrotra, R., Ansari, M. A., Agrawal, R., & Anand, R. S. (2020). A transfer learning approach for AI-based classification of brain tumors. Machine Learning with Applications, 2, 100003.
  52. Rehman, A., et al. (2020). A deep learning-based framework for automatic brain tumors classification using transfer learning. Circuits, Systems, and Signal Processing, 39, 757–775.
  53. Malla, P. P., Sahu, S., & Alutaibi, A. I. (2023). Classification of tumor in brain MR images using deep convolutional neural network and global average pooling. Processes, 11, 679.
  54. Öksüz, C., Urhan, O., & Güllü, M. K. (2022). Brain tumor classification using the fused features extracted from expanded tumor region. Biomedical Signal Processing and Control, 72, 103356.
  55. Kumar, S., et al. (2023). Brain tumor classification using deep neural network and transfer learning. Brain Topography, 36, 305–318.
  56. Zulfiqar, F., Bajwa, U. I., & Mehmood, Y. (2023). Multi-class classification of brain tumor types from MR images using EfficientNets. Biomedical Signal Processing and Control, 84, 104777.
  57. Nayak, D. R., Padhy, N., Mallick, P. K., Zymbler, M., & Kumar, S. (2022). Brain tumor classification using Dense Efficient-Net. Axioms, 11, 34.
  58. Badža, M. M., & Barjaktarović, M. Č. (2020). Classification of brain tumors from MRI images using a convolutional neural network. Applied Sciences, 10, 1999.
  59. Amin, J., Sharif, M., Yasmin, M., & Fernandes, S. L. (2020). A distinctive approach in brain tumor detection and classification using MRI. Pattern Recognition Letters, 139, 118–127.
  60. Mehrotra, R., Ansari, M. A., Agrawal, R., & Anand, R. S. (2020). A transfer learning approach for AI-based classification of brain tumors. Machine Learning with Applications, 2, 100003.
  61. Cantone, M., Marrocco, C., Tortorella, F., & Bria, A. (2023). Convolutional networks and transformers for mammography classification: An experimental study. Sensors, 23, 1229.