DEEP NETWORK-BASED METHOD AND SOFTWARE FOR SMALL SAMPLE BIOMEDICAL IMAGE GENERATION AND CLASSIFICATION
DOI:
https://doi.org/10.15588/1607-3274-2023-4-8Keywords:
computer-aided diagnosis system, breast cancer, deep neural networks, generative competitive networks, convolutional neural networksAbstract
Context. The authors of the article investigated the problem of generating and classifying breast cancer histological images. The widespread incidence of breast cancer explains the problem’s relevance. The automated diagnosing procedure saves time and eliminates the subjective aspect. The study’s findings can be applied to cancer CAD systems.
Objective. The purpose of the study is to develop a deep neural network-based method and software tool for generating and classifying histological images in order to increase classification accuracy.
Method. The method of histological image generation and classification was developed in the research study. This method employs CNN and GAN. To improve the classification accuracy, the initial image sample was expanded using GAN.
Results. The computer research of the developed method of image generation and classification was conducted on the basis of the dataset located on the Zenodo platform. Light microscopy served as the basis for obtaining the image. The dataset contained three classes of G1, G2, and G3 breast cancer histological images. Based on the developed method, the accuracy of image classification was 96%. This is a higher classification accuracy compared to existing models such as AlexNet, LeNet5, and VGG16. The software module can be integrated into CAD.
Conclusions. The developed method of generating and classifying images is the basis of the software module. The software module can be integrated into CAD.
References
Breast cancer burden in EU-27. [Electronic resource]. Access mode: https://ecis.jrc.ec.europa.eu/pdf/Breast_cancer_factsheetOct_2020.pdf
Cancer Facts for Women. American Cancer Society. [Electronic resource]. Access mode: https://www.cancer.org/cancer/riskprevention/understanding-cancer-risk/cancer-facts/cancerfacts-for-women.html
Cancer in Ukraine 2021–2022: Incidence, mortality, prevalence and other relevant statistics. Bulletin of the National Cancer Registry of Ukraine № 24, 2021–2022. [Electronic resource]. Access mode: http://www.ncru.inf.ua/publications/BULL_24/PDF_E/bull_ eng_24.pdf
Berezsky O., Pitsun O., Verbovyy S. et al. Computer diagnostic tools based on biomedical image analysis 14th International Conference The Experience of Designing and Application of CAD Systems in Microelectronics (CADSM), 21–25 Feb. 2017. Lviv, Ukraine, 2017, pp. 388–391.
Aswathy M. A., Jagannath M. Detection of breast cancer on digital histopathology images: Present status and future possibilities, Informatics in Medicine Unlocked, 2017, Vol. 8, pp. 74–79. DOI: 10.1016/j.imu.2016.11.001
Dey S., Mitra S., Chakrabortyc S. et al. GC-EnC: A Copula based ensemble of CNNs for malignancy identification in breast histopathology and cytology images, Computers in Biology and Medicine, 2023, Vol. 152, P. 106329. DOI: 10.1016/j.compbiomed.2022.106329
Chattopadhyay S., Dey A., Singh P. K. et al. MTRRE-Net: A deep learning model for detection of breast cancer from histopathological images, Computers in Biology and Medicine, 2022, Vol. 150, P. 106155. DOI: 10.1016/j.compbiomed.2022.106155
Shihabuddin A. R., Sabeena K. S. Multi CNN based automatic detection of mitotic nuclei in breast histopathological images, Computers in Biology and Medicine, 2023, Vol. 158, P. 106815. DOI: 10.1016/j.compbiomed.2023.106815
Vo D. M., Nguyen N.-Q., Lee S.-W. Classification of breast cancer histology images using incremental boosting convolution networks, Information Sciences, 2019, Vol. 482, pp. 123–138. DOI: 10.1016/j.ins.2018.12.089
Saikia A. R., Bora K., Mahanta L. B. et al. Comparative assessment of CNN architectures for classification of breast FNAC images, Tissue Cell, 2019, Vol. 57, pp. 8–14. DOI: 10.1016/j.tice.2019.02.001
Dogar G. M., Shahzad M., Fraz M. M. Attention augmented distance regression and classification network for nuclei instance segmentation and type classification in histology images, Biomedical Signal Processing and Control, 2023, Vol. 79, P. 104199. DOI: 10.1016/j.bspc.2022.104199
Gupta V., Vasudev M., Doegar A. et al. Breast cancer detection from histopathology images using modified residual neural networks, Biocybernetics and biomedical engineering, 2021, Vol. 41, pp. 1272–1287. DOI: 10.1016/j.bbe.2021.08.011
Karthik R., Menaka R., Siddharth M. V. Classification of breast cancer from histopathology images using an ensemble of deep multiscale networks, Biocybernetics and biomedical engineering, 2022, Vol. 42, pp. 963–976. DOI: 10.1016/j.bbe.2022.07.006
Dovbysh A., Shelehov I., Romaniuk A. et al. Decisionmaking support system for diagnosis of oncopathologies by histological images, Journal of Pathology Informatics, 2023, Vol. 14, P. 100193. DOI: 10.1016/j.jpi.2023.100193
Roy K., Banik D., Bhattacharjee D. et al. Patch-based system for Classification of Breast Histology images usingdeep learning, Computerized Medical Imaging and Graphics, 2019, Vol. 71, pp. 90–103. DOI: 10.1016/j.compmedimag.2018.11.003
Wang Y., Acs B., Robertson S. et al. Improved breast cancer histological grading using deep learning, Annals of oncology, 2021, Vol. 33, № 1, pp. 89–98. DOI: 10.1016/j.annonc.2021.09.007
Roberto G. F., Lumini A., Neves L. A. et al. Fractal Neural Network: A new ensemble of fractal geometry and convolutional neural networks for the classification of histology images, Expert Systems With Applications, 2021, Vol. 166, P. 114103. DOI: 10.1016/j.eswa.2020.114103
Houssein E. H., Emama M. M., Ali A. A. Deep and machine learning techniques for medical imaging-based breast cancer: A comprehensive review, Expert Systems with Applications, 2021, Vol. 167, P. 114161. DOI:10.1016/j.eswa.2020.114161
Majumdar S., Pramanik P., Ram S. Gamma function based ensemble of CNN models for breast cancer detection in histopathology images, Expert Systems With Applications, 2023, Vol. 213, P. 119022. DOI: 10.1016/j.eswa.2022.119022
Yana R., Ren F., Wangb Z. et al. Breast cancer histopathological image classification using a hybrid deep neural network, Methods, 2020, Vol. 173, pp. 52–60. DOI: 10.1016/j.ymeth.2019.06.014
Dianzhi Y., Jianwu L., Tengbao C. et al. SECS: An effective CNN joint construction strategy for breast cancer histopathological image classification, Journal of King Saud University – Computer and Information Sciences, 2023, Vol. 35, pp. 810–820. DOI: 10.1016/j.jksuci.2023.01.017
Aresta G., Araújo T., Kwok S. et al. BACH: Grand challenge on breast cancer histology images, Medical Image Analysis, 2019, Vol. 56, pp. 122–139. DOI: 10.1016/j.media.2019.05.010
Sohail A., Khan A., Nisar H. et al. Mitotic nuclei analysis in breast cancer histopathology images using deep ensemble classifier, Medical Image Analysis, 2021, Vol. 72, P. 102121. DOI: 10.1016/j.media.2021.102121
Wahab N., Khan A. Multifaceted fused-CNN based scoring of breast cancer whole-slide histopathology images, Applied Soft Computing Journal, 2020, Vol. 97, P. 106808. DOI: 10.1016/j.asoc.2020.106808
Rehman M. U., Akhtar S., Zakwan M. et al. Novel architecture with selected feature vector for effective classification of mitotic and non-mitotic cells in breast cancer histology images, Biomedical Signal Processing and Control, 2022, Vol. 71, P. 103212. DOI:10.1016/j.bspc.2021.103212
Bhausaheb D. P., Kashyap K. L. Shuffled shepherd deer hunting optimization based deep neural network for breast cancer classification using breast histopathology images, Biomedical Signal Processing and Control, 2023, Vol. 83, P. 104570. DOI: 10.1016/j.bspc.2023.104570
Guptaa K., Chawlaa N. Analysis of Histopathological Images for Prediction of Breast Cancer Using Traditional Classifiers with Pre-Trained CNN, Procedia Computer Science, 2020, №167, pp. 878–889. DOI: 10.1016/j.procs.2020.03.427
Yadav R. K., Singh P., Kashtriya P. Diagnosis of Breast Cancer using Machine Learning Techniques – A Survey, Procedia Computer Science, 2023, Vol. 218, pp. 1434– 1443. DOI: 10.1016/j.procs.2023.01.122
Dabeer S., Khan M. M., Islam S. Cancer diagnosis in histopathological image: CNN based approach, Informatics in Medicine Unlocked, 2019, Vol. 16, P. 100231. DOI: 10.1016/j.imu.2019.100231
Kate V., Shukla P. A 3 Tier CNN model with deep discriminative feature extraction for discovering malignant growth in multi-scale histopathology images, Informatics in Medicine Unlocked, 2021, Vol. 24, P. 100616. DOI: 10.1016/j.imu.2021.100616
Shallu S., Mehra R. Breast cancer histology images classification: Training from scratch or transfer learning?, ICT Express, 2018, Vol. 4, pp. 247–254. DOI: 10.1016/j.icte.2018.10.007
Desai M., Shah M. An anatomization on breast cancer detection and diagnosis employing multi-layer perceptron neural network (MLP) and Convolutional neural network (CNN), Clinical eHealth, 2021, Vol. 4, pp. 1–11. DOI: 10.1016/j.ceh.2020.11.002
Asadi B., Memon Q. Efficient breast cancer detection via cascade deep learning network, International Journal of Intelligent Networks, 2023, Vol. 4, pp. 46–52. DOI: 10.1016/j.ijin.2023.02.001
Joseph A. A., Abdullahi M., Junaidu S. B. et al. Improved multi-classification of breast cancer histopathological images using handcrafted features and deep neural network (dense layer), Intelligent Systems with Applications, 2022, Vol. 14, P. 200066. DOI: 10.1016/j.iswa.2022.200066
Chaudhury S., Sau K. A BERT encoding with Recurrent Neural Network and Long-Short Term Memory for breast cancer image classification, Decision Analytics Journal, 2023, Vol. 6, P. 100177. DOI: 10.1016/j.dajour.2023.100177
Lovkin V. M., Subbotin S. A., Oliinyk A. O. et al. Method and software component model for skin disease diagnosis, Radio Electronics, Computer Science, Control, 2023, № 1, P. 40. DOI: 10.15588/1607-3274-2023-1-4
Berezsky О. М., Berezska К. M., Melnyk G. M. et al. Design of computer systems for biomedical image analysis, Proceedings of the X th International Conference «The Experience of Designing and Application of CAD Systems in Microelectronics» CADSM 2009, 24–28 February 2009, Lviv-Polyana, Ukraine. Lviv, Publishing House Vezha&CoС, Р. 186–191.
Berezsky O., Datsko T., Verbovyy S. The intelligent system for diagnosing breast cancers based on image analysis, Proceedings of Information Technologies in Innovation Business (ITIB). Kharkiv, Ukraine, 7–9 October, 2015, pp. 27– 30. DOI: 10.1109/ITIB.2015.7355067.
Berezsky O., Verbovyy S., Dubchak L. et al. Fuzzy system diagnosing of precancerous and cancerous conditions of the breast cancer, Proceedings of the XIth International Scientific and Technical Conference Computer Sciences and Information Technologies (CSIT’2016). Lviv, Ukraine, 6–10 September, 2016, pp. 200–203. DOI: 10.1109/STCCSIT.2016.7589906.
Berezsky О., Dubchak L., Pitsun O. Access Distribution in Automated Microscopy System / O. Berezsky, // Proceedings of the 14 th International Conference «The Experience of Designing and Application of CAD Systems in Microelectronics» CADSM 2017, 21–25 February 2017, Lviv, Ukraine. Lviv, 2017, pp. 241–243. DOI: 10.1109/CADSM.2017.7916125
Berezsky O., Verbovyy S., Pitsun O. Hybrid Intelligent information techology for biomedical image processing, Proceedings of the IEEE International Conference “Computer Science and Information Technologies” CSIT’2018, Lviv, Ukraine, 11–14 September, 2018. Lviv, 2018, pp. 420–423. DOI: 10.1109/STC-CSIT.2018.8526711.
Berezsky O., Pitsun O., Batryn N., et al. Modern automated microscopy systems in oncology, Proceedings of the 1st International Workshop on Informatics & Data-Driven Medicine, Lviv, Ukraine, 28–30 november 2018. Lviv, 2018, pp. 311–325.
Berezsky O. M., Pitsun O. Y. Evaluation methods of image segmentation quality, Radio Electronics, Computer Science, Control, 2018, Vol. 1, pp. 119–128. DOI:10.15588/16073274-2018-1-14
Berezsky O., Dubchak L., Batryn N., et al. Fuzzy System For Breast Disease Diagnosing Based On Image Analysis, Proceedings of the II International Workshop Informatics & Data-Driven Medicine (IDDM 2019). Lviv, Ukraine, 11–13 November, 2019. Lviv, 2019, pp. 69–83.
Berezsky O., Pitsun O., Melnyk G. et al. An Approach toward Automatic Specifics Diagnosis of Breast Cancer Based on an Immunohistochemical Image, Journal of Imaging, 2023, Vol. 9, № 1, P. 12. DOI: 10.3390/jimaging9010012
Berezsky O., Datsko T., Melnyk G. Cytological and histological images of breast cancer, [Electronic resource]. Access mode: https://zenodo.org/records/7890874. DOI: 10.5281/zenodo.7890874
Intresoft Consulting. General Data Protection Regulation (GDPR). Recital 26. [Electronic resource]. Access mode: https://gdpr-info.eu/recitals/no-26/
Liashchynskyi P. Rudi. Lightweight image converter and dataset augmentor, [Electronic resource]. Access mode: https://github.com/liashchynskyi/rudi
He K., Zhang X., Ren S. et al. Deep Residual Learning for Image Recognition, 2015. [Electronic resource]. Access mode: https://arxiv.org/pdf/1512.03385.pdf
Lim J. H., Ye J. C. Geometric GAN, 2017. [Electronic resource]. Access mode: https://arxiv.org/pdf/1705.02894v2.pdf
Salimans T., Goodfellow I., Zaremba W. et al. Improved techniques for training GANs, Advances in neural information processing systems: Annual Conference on Neural Information Processing Systems 2016, December 5–10, 2016, Barcelona. Spain, Barcelona, 2016, pp. 2226–2234 DOI: 10.48550/arXiv.1606.03498
Heusel M., Ramsauer H., Unterthiner T. et al. GANs trained by a two time-scale update rule converge to a local nash equilibrium, Proceedings of the 31st International Conference on Neural Information Processing Systems. NY, United States, Curran Associates Inc., 2017, pp. 6629–6640. Access mode: https://dl.acm.org/doi/10.5555/3295222.3295408
Nawaz W., Ahmed S., Tahir A. et al. Classification Of Breast Cancer Histology Images Using ALEXNET. In: Campilho, A., Karray, F., ter Haar Romeny, B. (eds) Image Analysis and Recognition. ICIAR 2018, Lecture Notes in Computer Science. Springer, Cham, 2018, Vol. 10882, pp. 869–876. DOI: 10.1007/978–3-319-93000-8_99
Verdhan V. Image Classification Using LeNet. In: Computer Vision Using Deep Learning. Apress, Berkeley, CA., 2021, pp. 67–101. DOI: 10.1007/978-1-4842-6616-8_3
Tammina S. Transfer learning using VGG-16 with Deep Convolutional Neural Network for Classifying Images, International Journal of Scientific and Research Publications, 2019, Vol. 9, Issue 10, pp. 143–150. DOI: 10.29322/IJSRP.9.10.2019.p9420
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 O. M. Berezsky, P. B. Liashchynskyi, O. Y. Pitsun, G. M. Melnyk
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Creative Commons Licensing Notifications in the Copyright Notices
The journal allows the authors to hold the copyright without restrictions and to retain publishing rights without restrictions.
The journal allows readers to read, download, copy, distribute, print, search, or link to the full texts of its articles.
The journal allows to reuse and remixing of its content, in accordance with a Creative Commons license СС BY -SA.
Authors who publish with this journal agree to the following terms:
-
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License CC BY-SA that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
-
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
-
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
