http://iet.metastore.ingenta.com
1887

Measuring meaningful information in images: algorithmic specified complexity

Measuring meaningful information in images: algorithmic specified complexity

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Computer Vision — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Both Shannon and Kolmogorov–Chaitin–Solomonoff (KCS) information models fail to measure meaningful information in images. Pictures of a cow and correlated noise can both have the same Shannon and KCS information, but only the image of the cow has meaning. The application of ‘algorithmic specified complexity’ (ASC) to the problem of distinguishing random images, simple images and content-filled images is explored. ASC is a model for measuring meaning using conditional KCS complexity. The ASC of various images given a context of a library of related images is calculated. The ‘portable network graphic' (PNG) file format’s compression is used to account for typical redundancies found in images. Images which containing content can thereby be distinguished from those containing simply redundancies, meaningless or random noise.

References

    1. 1)
      • P. Mirowski . (2002)
        1. Mirowski, P.: ‘Machine dreams: economics becomes a cyborg science’ (Cambridge University Press, New York, NY, 2002).
        .
    2. 2)
      • R.J. Marks II . (2013)
        2. Marks II, R.J.: ‘Information theory & biology: introductory comments’, in Marks II, R.J., Behe, M.J., Dembski, W.A., Gordon, B.L., Sanford, J.C. (Eds.): ‘Biological information – new perspectives’ (World Scientific, Singapore, 2013), pp. 110.
        .
    3. 3)
    4. 4)
      • T.M. Cover , J.A. Thomas . (2006)
        4. Cover, T.M., Thomas, J.A.: ‘Elements of information theory’ (Wiley-Interscience, Hoboken, NJ, 2006, 2nd edn.).
        .
    5. 5)
    6. 6)
    7. 7)
    8. 8)
    9. 9)
    10. 10)
      • A.N. Kolmogorov .
        10. Kolmogorov, A.N.: ‘Three approaches to the quantitative definition of information’, Problm. Inform. Transm., 1965, 1, (1), pp. 17.
        . Problm. Inform. Transm. , 1 , 1 - 7
    11. 11)
    12. 12)
    13. 13)
      • G.J. Chaitin . (1999)
        13. Chaitin, G.J.: ‘The unknowable’ (Springer, New York, New York, USA, 1999).
        .
    14. 14)
      • G.J. Chaitin . (2006)
        14. Chaitin, G.J.: ‘Meta math!: the quest for Ω‘ (Vintage, Visalia, CA, 2006).
        .
    15. 15)
      • R.J. Solomonoff .
        15. Solomonoff, R.J.: ‘A preliminary report on a general theory of inductive inference’. Technical Report, Zator Co. and Air Force Office of Scientific Research, Cambridge, MA, 1960.
        . Technical Report
    16. 16)
      • W. Gitt , R. Compton , J. Fernandez . (2013)
        16. Gitt, W., Compton, R., Fernandez, J.: ‘Biological information – what is it?’, in Marks II, R.J., Behe, M.J., Dembski, W.A., Gordon, B.L., Sanford, J.C. (Eds.): ‘Biological information – new perspectives’ (World Scientific, Singapore, 2013), pp. 1125.
        .
    17. 17)
      • J.W. Oller . (2013)
        17. Oller, J.W.Jr.: ‘Pragmatic information’, in Marks II, R.J., Behe, M.J., Dembski, W.A., Gordon, B.L., Sanford, J.C. (Eds.): ‘Biological information – new perspectives’ (World Scientific, Singapore, 2013), pp. 6486.
        .
    18. 18)
    19. 19)
    20. 20)
      • A. McIntosh . (2006)
        20. McIntosh, A.: ‘Functional information and entropy in living systems’ (WIT Press, UK, 2006).
        .
    21. 21)
      • G. Tononi . (2012)
        21. Tononi, G.: ‘Phi: a voyage from the brain to the soul’ (Random House, New York, NY, 2012).
        .
    22. 22)
      • W.A. Dembski . (1998)
        22. Dembski, W.A.: ‘The design inference: eliminating chance through small probabilities’ (Cambridge University Press, New York, NY, 1998), vol. 112, no. 447.
        .
    23. 23)
      • W. Ewert , W.A. Dembski , R.J. Marks II .
        23. Ewert, W., Dembski, W.A., Marks II, R.J.: ‘On the improbability of algorithmic specified complexity’. 2013 IEEE 45th Southeastern Symp. on System Theory: SSST 2013, Waco, TX, 2013.
        . 2013 IEEE 45th Southeastern Symp. on System Theory: SSST 2013
    24. 24)
      • W. Ewert , W.A. Dembski , R.J. Marks II . (2014)
        24. Ewert, W., Dembski, W.A., Marks II, R.J.: ‘Algorithmic specified complexity’, in Bartlett, J., Halsmer, D., Hall, M. (Eds.): ‘Engineering and the ultimate: an interdisciplinary investigation of order and design in nature and craft’ (Blyth Institute Press, Tulsa, OK, 2014), pp. 131149.
        .
    25. 25)
    26. 26)
      • W.C. Stone . (1962)
        26. Stone, W.C.: ‘The success system that never fails’ (Prentice-Hall, Upper Saddle River, NJ, 1962).
        .
    27. 27)
      • Q.-F. Zhu , W. Yao .
        27. Zhu, Q.-F., Yao, W.: ‘Error control and concealment for video communication’, Opt. Eng. New York Marcel Dekker Inc., 1999, 64, pp. 163204.
        . Opt. Eng. New York Marcel Dekker Inc. , 163 - 204
    28. 28)
    29. 29)
      • M. Li , P.M. Vitányi . (2008)
        29. Li, M., Vitányi, P.M.: ‘An introduction to Kolmogorov complexity and its applications’ (Springer, Berlin, 2008).
        .
    30. 30)
      • B. Cyganek . (2013)
        30. Cyganek, B.: ‘Object detection and recognition in digital images: theory and practice’ (Wiley, Hoboken, NJ, 2013).
        .
    31. 31)
      • H.V. Poor . (1994)
        31. Poor, H.V.: ‘An introduction to signal detection and estimation’ (Springer, Berlin, 1994, 2nd edn.).
        .
    32. 32)
      • J. Thomas . (1969)
        32. Thomas, J.: ‘An introduction to statistical communication theory’ (John Wiley & Sons, New York, 1969).
        .
    33. 33)
    34. 34)
    35. 35)
    36. 36)
    37. 37)
    38. 38)
    39. 39)
    40. 40)
    41. 41)
      • N. Nikvand , Z. Wang .
        41. Nikvand, N., Wang, Z.: ‘Generic image similarity based on Kolmogorov complexity’. 2010 17th IEEE Trans. on Image Processing (ICIP), 2010, pp. 309312.
        . 2010 17th IEEE Trans. on Image Processing (ICIP) , 309 - 312
    42. 42)
      • S. Supamahitorn .
        42. Supamahitorn, S.: ‘Investigation of a Kolmogorov complexity based similarity metric for content based image retrieval’. Masters thesis, Oklahoma State University, 2004.
        . Masters thesis
    43. 43)
      • M. Kramm . (2008)
        43. Kramm, M.: ‘Image group compression using texture databases’, in Rogowitz, B.E., Pappas, T.N. (Eds.): ‘Human Vision and Electronic Imaging XIIIProc. SPIE, 2008, 6806, pp. 680513-1680513-10.
        .
    44. 44)
      • J.-D. Lee , S.-Y. Wan , C.-M. Ma , R.-F. Wu .
        44. Lee, J.-D., Wan, S.-Y., Ma, C.-M., Wu, R.-F.: ‘Compressing sets of similar images using hybrid compression model’. Proc. IEEE Int. Conf. on Multimedia and Expo, IEEE, 2002, no. l, pp. 617620.
        . Proc. IEEE Int. Conf. on Multimedia and Expo , 617 - 620
    45. 45)
      • G. Chaitin .
        45. Chaitin, G.: ‘Kolmogorov complexity and information theory’. Available at http://www.umcs.maine.edu/c~haitin/ontology.pdf, 2014, accessed 20 October 2014.
        .
    46. 46)
    47. 47)
    48. 48)
    49. 49)
      • R. SureFile .
        49. SureFile, R.: ‘Software powered byPKZIP... BSSFDS 0103 authorized reseller: Technical specifications platformsMicrosoft®Windows® 98 second edition me |atNT 4.0 workstation sp6a 2000 professional sp2.’.
        .
    50. 50)
      • L.P. Deutsch .
        50. Deutsch, L.P.: ‘DEFLATE compressed data format specification version 1.3’. Available at https://www.tools.ietf.org/html/rfc1951, 1996, last accessed 15 January 2015.
        .
    51. 51)
      • T. Kohno .
        51. Kohno, T.: ‘Analysis of the WinZip encryption method’, IACR Cryptol. ePrint Arch., 2004, 2004, p. 78.
        . IACR Cryptol. ePrint Arch. , 78
    52. 52)
      • T. Boutell .
        52. Boutell, T.: ‘PNG (Portable Network Graphics) Specification Version 1.0’, 1997.
        .
    53. 53)
      • G. Roelofs , R. Koman . (1999)
        53. Roelofs, G., Koman, R.: ‘PNG: the definitive guide’ (O'Reilly & Associates, Inc. Sebastopol, CA, 1999).
        .
    54. 54)
    55. 55)
      • C.-C. Wang .
        55. Wang, C.-C.: ‘Vision and Autonomous Systems Center's Image Database’.
        .
    56. 56)
      • C. Costa Santos , J. Bernardes , P.M. Vitányi , L. Antunes .
        56. Costa Santos, C., Bernardes, J., Vitányi, P.M., Antunes, L.: ‘Clustering fetal heart rate tracings by compression’. 19th IEEE Int. Symp. on Computer-Based Medical Systems, 2006. CBMS 2006, 2006, pp. 685690.
        . 19th IEEE Int. Symp. on Computer-Based Medical Systems, 2006. CBMS 2006 , 685 - 690
    57. 57)
      • E. Keogh , S. Lonardi , C.A. Ratanamahatana .
        57. Keogh, E., Lonardi, S., Ratanamahatana, C.A.: ‘Towards parameter-free data mining’. Proc. of the Tenth ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, 2004, pp. 206215.
        . Proc. of the Tenth ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining , 206 - 215
    58. 58)
      • R. Cilibrasi , P. Vitányi .
        58. Cilibrasi, R., Vitányi, P.: ‘Automatic extraction of meaning from the web’. 2006 IEEE Int. Symp. on Information Theory, 2006, pp. 23092313.
        . 2006 IEEE Int. Symp. on Information Theory , 2309 - 2313
    59. 59)
    60. 60)
    61. 61)
    62. 62)
    63. 63)
      • H.M. Wallach .
        63. Wallach, H.M.: ‘Topic modeling: beyond bag-of-words’. Proc. 23rd Int. Conf. on Machine Learning, 2006, pp. 977984.
        . Proc. 23rd Int. Conf. on Machine Learning , 977 - 984
    64. 64)
    65. 65)
      • J. Martin , C. Baylis , R. Marks , M. Moldovan .
        65. Martin, J., Baylis, C., Marks, R., Moldovan, M.: ‘Perturbation size and harmonic limitations in affine approximation for time invariant periodicity preservation systems’. Submitted to IEEE Waveform Diversity Conf., 2011.
        . Submitted to IEEE Waveform Diversity Conf.
    66. 66)
    67. 67)
      • R.J. Marks II . (2009)
        67. Marks II, R.J.: ‘Handbook of Fourier analysis & its applications’ (Oxford University Press, Oxford, New York, 2009).
        .
    68. 68)
      • R.J. Marks II , J.F. Walkup , M.O. Hagler . (1977)
        68. Marks II, R.J., Walkup, J.F., Hagler, M.O.: ‘Volume hologram representation of space-variant system’, in Marom, E.E., Friesem, A., Wiener-Aunear, E. (Eds.): ‘Applications of holography and optical data processing’ (Pergamon Press, Oxford, 1977), pp. 105113.
        .
    69. 69)
      • T. Krile , R.J. Marks II , J.F. Walkup , M.O. Hagler . (1994)
        69. Krile, T., Marks II, R.J., Walkup, J.F., Hagler, M.O.: ‘Holographic representations of space – variant systems using phase-coded reference beams’, in Sincerbox, G.T. (Ed.): ‘SPIE selected papers in holographic storage’ (SPIE Optical Engineering Press, Bellingham, WA, 1994).
        .
    70. 70)
    71. 71)
    72. 72)
    73. 73)
      • R.J. Marks II , J.F. Walkup , M.O. Hagler .
        73. Marks II, R.J., Walkup, J.F., Hagler, M.O.: ‘Sampling theorems for shift-variant systems’. Proc. of the 1977 Midwest Symp. on Circuits and Systems, Texas Tech University, Lubbock, August 1977.
        . Proc. of the 1977 Midwest Symp. on Circuits and Systems
    74. 74)
      • T. Krile , R. Marks II , J. Walkup , M. Hagler .
        74. Krile, T., Marks II, R., Walkup, J., Hagler, M.: ‘Space-variant holographic optical systems using phase-coded reference beams’. 21st Annual Technical Symp., 1977, pp. 610.
        . 21st Annual Technical Symp. , 6 - 10
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2014.0141
Loading

Related content

content/journals/10.1049/iet-cvi.2014.0141
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address