access icon free Tongue colour and coating prediction in traditional Chinese medicine based on visible hyperspectral imaging

Tongue diagnosis is an important concept in Traditional Chinese Medicine (TCM). The tongue colour and coating can aid understanding of the body's physiological mechanisms, as well as the pathology of diseases. Existing research has focused on using digital images and tongue colour classification, without considering the other visible bands of information in the tongue. In this study, a visible hyperspectral image system, with an approximate spectral range of 400–1000 nm, was used to predict the tongue colour values and the coating position in TCM, and a stacked autoencoder (SAE) predict model based on spectral–spatial feature was performed to digital the tongue colour space and the coating. The experimental results show the effectiveness of the spectral–spatial feature with SAE model in predicting the CIELAB values of L, a, and coating position, thus the authors provide a new technique for the objective and digitising development of TCM.

Inspec keywords: biological organs; image colour analysis; hyperspectral imaging; feature extraction; medical image processing; diseases; patient diagnosis; image classification

Other keywords: Traditional Chinese Medicine; approximate spectral range; tongue colour values; tongue colour classification; SAE predict model; tongue diagnosis; size 400.0 nm to 1000.0 nm; TCM; visible hyperspectral image system; coating position; CIELAB values; spectral–spatial feature; digital images; stacked autoencoder predict model

Subjects: Biomedical measurement and imaging; Computer vision and image processing techniques; Image recognition; Patient diagnostic methods and instrumentation; Biology and medical computing

References

    1. 1)
      • 7. Yamamoto, S., Ishikawa, Y., Nakaguchi, T., et al: ‘Temporal changes in tongue color as criterion for tongue diagnosis in Kampo medicine’, For schende Komplementarmedizin, 2012, 19, (2), pp. 8085.
    2. 2)
      • 30. Lin, Z., Chen, Y., Zhao, X., et al: ‘Spectral-spatial classification of hyperspectral image using auto encoders’. Proc. 9th Int. Conf. on Information, Communication and Signal Processing, 2013.
    3. 3)
      • 35. Pal, M., Foody, G.M.: ‘Feature selection for classification of hyperspectral data by SVM’, IEEE Trans. Geosci. Remote Sens., 2010, 48, pp. 22972307.
    4. 4)
      • 4. Kamarudin, N., Ooi, C., Kawanabe, T., et al: ‘Tongue's substance and coating recognition analysis using HSV color threshold in tongue diagnosis’. 1st Int. Workshop on Pattern Recognition Proc. SPIE, vol. 10011, Tokyo, Japan, 2016.
    5. 5)
      • 5. Kim, K., Do, J., Ryu, H., et al: ‘Tongue diagnosis method for extraction of effective region and classification of tongue coating’. Proc. 1st Workshops on Image Processing Teory, Tools and Applications (IPTA ‘08), Sousse, Tunisia, 2008, pp. 17.
    6. 6)
      • 28. Wang, Q., Lin, J., Yuan, Y.: ‘Salient band selection for hyperspectral image classification via manifold ranking’, IEEE. Trans. Neural. Netw. Learn. Syst., 2017, 27, pp. 12791289.
    7. 7)
      • 19. Qiao, T., Ren, J., Wang, Z., et al: ‘Effective denoising and classification of hyperspectral images using curvelet transform and singular spectrum analysis’, IEEE Trans. Geosci. Remote Sens., 2017, 55, (1), pp. 119133.
    8. 8)
      • 27. Wang, Q., Zhang, F., Li, X.: ‘Optimal clustering framework for hyperspectral band selection’, IEEE Trans. Geosci. Remote Sens., 2018, 56, pp. 113.
    9. 9)
      • 32. Imani, M., Ghassemian, H.: ‘Principal component discriminant analysis for feature extraction and classification of hyperspectral images’. Processing of 2014 Iranian Conf. on Intelligent System, Bam, 2014, pp. 15.
    10. 10)
      • 17. Sun, M., Zhang, D., Wang, Z., et al: ‘What's wrong with the muralsat the Mogao Grottoes: a near-infrared hyperspectral imaging method’, Sci. Rep., 2015, 5, p. 14371, doi: 10.1038/srep14371.
    11. 11)
      • 18. Zhang, A., Sun, G., Ren, J., et al: ‘A dynamic neighborhood learning-based gravitational search algorithm’, IEEE Trans. Cynernet., 2018, 48, (1), p. 436.
    12. 12)
      • 14. Ning, J.F., Zhang, D., Wu, C.K., et al: ‘Automatic tongue image segmentation based on gradient vector flow and region merging’, Neural Comput. Appl., 2012, 21, (8), pp. 18191826.
    13. 13)
      • 6. Zhiming, X., Baoan, Y., Xin, C.: ‘Semantic object generation in tongue image analysis’, in Sobh, T. (ed.) ‘Innovations and advanced techniques in computer and information sciences and engineering’ (Springer, Dordrecht, The Netherlands, 2007), pp. 4146.
    14. 14)
      • 37. Shao, Z., Zhang, L., Zhou, X., et al: ‘A novel hierarchical semi supervised SVM for classification of hyperspectral images’, IEEE Geosci. Remote Sens. Lett., 2014, 11, pp. 16091613.
    15. 15)
      • 29. Chen, Y., Lin, Z., Zhao, X., et al: ‘Deep learning-based classification of hyperspectral data’, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 2014, 7, pp. 20942107.
    16. 16)
      • 33. Garini, Y., Young, I.T., McNamara, G.: ‘Spectral imaging, principles, and applications’, Cytometry Part A, 2006, 69A, pp. 735747.
    17. 17)
      • 31. Uzair, M., Mahmood, A., Mian, A.: ‘Hyperspectral face recognition with spatio spectral information fusion and PLS regression’, IEEE Trans. Image Process., 2015, 24, pp. 11271137.
    18. 18)
      • 34. Baassou, B., He, M.Y., Mei, S.H.: ‘An accurate SVM-based classification approach for hyperspectral image classification’. Processing of the 2013 21st Int. Conf. on Geoinformatics, Kaifeng, 2013, pp. 17.
    19. 19)
      • 13. Kim, J., Han, G.J., Choi, B.H., et al: ‘Development of differential criteria on tongue coating thickness in tongue diagnosis’, Complement. Ther. Med., 2012, 20, (5), pp. 316322.
    20. 20)
      • 36. Kuo, B.C., Ho, H.H., Li, C.H., et al: ‘A kernel-based feature selection method for SVM with RBF kernel for hyperspectral image classification’, IEEE J. Sel. Top. Appl. Obs. Remote Sens., 2014, 7, pp. 317326.
    21. 21)
      • 39. Zhong, Z., Fan, B., Duan, J., et al: ‘Discriminant tensor spectral-spatial feature extraction for hyperspectral image classification’, IEEE Trans. Geosci. Remote Sens. Lett., 2015, 12, pp. 10281032.
    22. 22)
      • 12. Wang, Y., Zhou, Y., Yang, J., et al: ‘An image analysis system for tongue diagnosis in traditional Chinese medicine’, Comput. Inf. Sci., 2004, 3314, pp. 11811186.
    23. 23)
      • 25. Li, J., Huang, X., Gamba, P., et al: ‘Multiple feature learning for hyperspectral image classification’, IEEE Trans. Geosci. Remote Sens., 2015, 53, pp. 15921606.
    24. 24)
      • 22. Liu, Z., Yan, J., Zhang, D., et al: ‘Automated tongue segmentation in hyperspectral images for medicine’, Appl. Opt., 2007, 46, (34), pp. 83288334.
    25. 25)
      • 8. Zhai, X.M., Lu, H.D., Zhang, L.Z.: ‘Application of image segmentation technique in tongue diagnosis’. Proc. of the Int. Forum on Information Technology and Applications (IFITA ‘09), Chengdu, China, 2009, pp. 768771.
    26. 26)
      • 23. Zhou, Y., Wei, Y.: ‘Learning hierarchical spectral-spatial features for hyperspectral image classification’, IEEE Trans. Cybernet., 2016, 46, pp. 16671678.
    27. 27)
      • 16. ElMasry, G., Sun, D., Allen, P.: ‘Near-infrared hyperspectral imaging for predicting colour, pH and tenderness of fresh beef’, J. Food Eng., 2012, 110, pp. 127140.
    28. 28)
      • 1. Li, Q., Wang, Y., Liu, H., et al: ‘Sublingual vein extraction algorithm based on hyperspectral tongue imaging technology’, Comput. Med. Imaging Graph., 2011, 35, pp. 179185.
    29. 29)
      • 11. Kamarudin, N.D., Ooi, C.Y., Kawanabe, T., et al: ‘Tongue's substance and coating recognition analysis using HSV color threshold in tongue diagnosis’. 1st Int. Workshop on Pattern Recognition of Proc. SPIE, vol. 10011, Tokyo, Japan, 2016, p. 5.
    30. 30)
      • 24. Fang, L., Li, S., Kang, X., et al: ‘Spectral–spatial hyperspectral image classification via multiscale adaptive sparse representation’, IEEE Trans. Geosci. Remote Sens., 2014, 52, pp. 77387749.
    31. 31)
      • 9. Oji, T., Namiki, T., Nakaguchi, T., et al: ‘Study of factors involved in tongue color diagnosis by Kampo medical practitioners using the Farnsworth-Munsell 100 hue test and tongue color images’, Evidence-Based Complementary Altern. Med., 2014, 2014, pp. 19.
    32. 32)
      • 20. Zhao, H., Ren, J.: ‘Cognitive computation of compressed sensing for watermark signal measurement’, Cogn. Comput., 2016, 8, (2), pp. 246260.
    33. 33)
      • 21. Li, Q., Liu, Z.: ‘Tongue color analysis and discrimination based on hyperspectral images’, Comput. Med. Imaging Graph., 2009, 33, (3), pp. 217221.
    34. 34)
      • 15. Sun, M., Zhang, D., Liu, L., et al: ‘How to predict the sugariness and hardness of melons: A near-infrared hyperspectral imaging method’, Food Chem., 2017, 218, pp. 413421.
    35. 35)
      • 38. Hinton, G.E., Salakhutdinov, R.R.: ‘Reducing the dimensionality of data with neural networks’, Science, 2006, 313, pp. 504507.
    36. 36)
      • 3. Zhu, M., Du, J.: ‘A novel approach for color tongue image extraction based on random walk algorithm’, Appl. Mech. Mater., 2014, 462–463, pp. 338342.
    37. 37)
      • 2. Ning, J., Zhang, D., Wu, C., et al: ‘Automatic tongue image segmentation based on gradient vector flow and region merging’, Neural Comput. Appl., 2012, 21, (8), pp. 18191826.
    38. 38)
      • 40. Romero, A., Gatta, C., Camps-Valls, G.: ‘Unsupervised deep feature extraction for remote sensing image classification’, IEEE Trans. Geosci. Remote Sens., 2016, 54, pp. 13491362.
    39. 39)
      • 10. Qi, Z., Tu, L., Chen, J., et al: ‘The classification of tongue colors with standardized acquisition and ICC profile correction in traditional Chinese medicine’, Bio. Med. Res. Int., 2016, 2016, pp. 19.
    40. 40)
      • 26. Xu, Y., Han, Y., Hong, R., et al: ‘Sequential video VLAD: training the aggregation locally and temporally’, IEEE Trans. Image Process., 2018, 27, pp. 49334944.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2018.5398
Loading

Related content

content/journals/10.1049/iet-ipr.2018.5398
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading