Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Measuring meaningful information in images: algorithmic specified complexity

Both Shannon and Kolmogorov–Chaitin–Solomonoff (KCS) information models fail to measure meaningful information in images. Pictures of a cow and correlated noise can both have the same Shannon and KCS information, but only the image of the cow has meaning. The application of ‘algorithmic specified complexity’ (ASC) to the problem of distinguishing random images, simple images and content-filled images is explored. ASC is a model for measuring meaning using conditional KCS complexity. The ASC of various images given a context of a library of related images is calculated. The ‘portable network graphic' (PNG) file format’s compression is used to account for typical redundancies found in images. Images which containing content can thereby be distinguished from those containing simply redundancies, meaningless or random noise.

References

    1. 1)
      • 49. SureFile, R.: ‘Software powered by PKZIP... BSSF DS 0103 authorized reseller: Technical specifications platforms Microsoft® Windows® 98 second edition me |atNT 4.0 workstation sp6a 2000 professional sp2.’.
    2. 2)
      • 41. Nikvand, N., Wang, Z.: ‘Generic image similarity based on Kolmogorov complexity’. 2010 17th IEEE Trans. on Image Processing (ICIP), 2010, pp. 309312.
    3. 3)
      • 44. Lee, J.-D., Wan, S.-Y., Ma, C.-M., Wu, R.-F.: ‘Compressing sets of similar images using hybrid compression model’. Proc. IEEE Int. Conf. on Multimedia and Expo, IEEE, 2002, no. l, pp. 617620.
    4. 4)
      • 10. Kolmogorov, A.N.: ‘Three approaches to the quantitative definition of information’, Problm. Inform. Transm., 1965, 1, (1), pp. 17.
    5. 5)
    6. 6)
      • 52. Boutell, T.: ‘PNG (Portable Network Graphics) Specification Version 1.0’, 1997.
    7. 7)
    8. 8)
      • 4. Cover, T.M., Thomas, J.A.: ‘Elements of information theory’ (Wiley-Interscience, Hoboken, NJ, 2006, 2nd edn.).
    9. 9)
    10. 10)
    11. 11)
      • 56. Costa Santos, C., Bernardes, J., Vitányi, P.M., Antunes, L.: ‘Clustering fetal heart rate tracings by compression’. 19th IEEE Int. Symp. on Computer-Based Medical Systems, 2006. CBMS 2006, 2006, pp. 685690.
    12. 12)
    13. 13)
      • 29. Li, M., Vitányi, P.M.: ‘An introduction to Kolmogorov complexity and its applications’ (Springer, Berlin, 2008).
    14. 14)
      • 53. Roelofs, G., Koman, R.: ‘PNG: the definitive guide’ (O'Reilly & Associates, Inc. Sebastopol, CA, 1999).
    15. 15)
      • 45. Chaitin, G.: ‘Kolmogorov complexity and information theory’. Available at http://www.umcs.maine.edu/c~haitin/ontology.pdf, 2014, accessed 20 October 2014.
    16. 16)
      • 51. Kohno, T.: ‘Analysis of the WinZip encryption method’, IACR Cryptol. ePrint Arch., 2004, 2004, p. 78.
    17. 17)
    18. 18)
      • 74. Krile, T., Marks II, R., Walkup, J., Hagler, M.: ‘Space-variant holographic optical systems using phase-coded reference beams’. 21st Annual Technical Symp., 1977, pp. 610.
    19. 19)
      • 20. McIntosh, A.: ‘Functional information and entropy in living systems’ (WIT Press, UK, 2006).
    20. 20)
      • 24. Ewert, W., Dembski, W.A., Marks II, R.J.: ‘Algorithmic specified complexity’, in Bartlett, J., Halsmer, D., Hall, M. (Eds.): ‘Engineering and the ultimate: an interdisciplinary investigation of order and design in nature and craft’ (Blyth Institute Press, Tulsa, OK, 2014), pp. 131149.
    21. 21)
      • 43. Kramm, M.: ‘Image group compression using texture databases’, in Rogowitz, B.E., Pappas, T.N. (Eds.): ‘Human Vision and Electronic Imaging XIIIProc. SPIE, 2008, 6806, pp. 680513-1680513-10.
    22. 22)
      • 17. Oller, J.W.Jr.: ‘Pragmatic information’, in Marks II, R.J., Behe, M.J., Dembski, W.A., Gordon, B.L., Sanford, J.C. (Eds.): ‘Biological information – new perspectives’ (World Scientific, Singapore, 2013), pp. 6486.
    23. 23)
    24. 24)
      • 22. Dembski, W.A.: ‘The design inference: eliminating chance through small probabilities’ (Cambridge University Press, New York, NY, 1998), vol. 112, no. 447.
    25. 25)
    26. 26)
      • 16. Gitt, W., Compton, R., Fernandez, J.: ‘Biological information – what is it?’, in Marks II, R.J., Behe, M.J., Dembski, W.A., Gordon, B.L., Sanford, J.C. (Eds.): ‘Biological information – new perspectives’ (World Scientific, Singapore, 2013), pp. 1125.
    27. 27)
    28. 28)
    29. 29)
      • 23. Ewert, W., Dembski, W.A., Marks II, R.J.: ‘On the improbability of algorithmic specified complexity’. 2013 IEEE 45th Southeastern Symp. on System Theory: SSST 2013, Waco, TX, 2013.
    30. 30)
      • 63. Wallach, H.M.: ‘Topic modeling: beyond bag-of-words’. Proc. 23rd Int. Conf. on Machine Learning, 2006, pp. 977984.
    31. 31)
      • 69. Krile, T., Marks II, R.J., Walkup, J.F., Hagler, M.O.: ‘Holographic representations of space – variant systems using phase-coded reference beams’, in Sincerbox, G.T. (Ed.): ‘SPIE selected papers in holographic storage’ (SPIE Optical Engineering Press, Bellingham, WA, 1994).
    32. 32)
      • 26. Stone, W.C.: ‘The success system that never fails’ (Prentice-Hall, Upper Saddle River, NJ, 1962).
    33. 33)
    34. 34)
      • 30. Cyganek, B.: ‘Object detection and recognition in digital images: theory and practice’ (Wiley, Hoboken, NJ, 2013).
    35. 35)
      • 57. Keogh, E., Lonardi, S., Ratanamahatana, C.A.: ‘Towards parameter-free data mining’. Proc. of the Tenth ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, 2004, pp. 206215.
    36. 36)
      • 31. Poor, H.V.: ‘An introduction to signal detection and estimation’ (Springer, Berlin, 1994, 2nd edn.).
    37. 37)
    38. 38)
      • 14. Chaitin, G.J.: ‘Meta math!: the quest for Ω‘ (Vintage, Visalia, CA, 2006).
    39. 39)
      • 50. Deutsch, L.P.: ‘DEFLATE compressed data format specification version 1.3’. Available at https://www.tools.ietf.org/html/rfc1951, 1996, last accessed 15 January 2015.
    40. 40)
    41. 41)
      • 32. Thomas, J.: ‘An introduction to statistical communication theory’ (John Wiley & Sons, New York, 1969).
    42. 42)
      • 13. Chaitin, G.J.: ‘The unknowable’ (Springer, New York, New York, USA, 1999).
    43. 43)
      • 49. SureFile, R.: ‘Software powered byPKZIP... BSSFDS 0103 authorized reseller: Technical specifications platformsMicrosoft®Windows® 98 second edition me |atNT 4.0 workstation sp6a 2000 professional sp2.’.
    44. 44)
      • 21. Tononi, G.: ‘Phi: a voyage from the brain to the soul’ (Random House, New York, NY, 2012).
    45. 45)
      • 55. Wang, C.-C.: ‘Vision and Autonomous Systems Center's Image Database’.
    46. 46)
    47. 47)
    48. 48)
      • 2. Marks II, R.J.: ‘Information theory & biology: introductory comments’, in Marks II, R.J., Behe, M.J., Dembski, W.A., Gordon, B.L., Sanford, J.C. (Eds.): ‘Biological information – new perspectives’ (World Scientific, Singapore, 2013), pp. 110.
    49. 49)
    50. 50)
    51. 51)
    52. 52)
    53. 53)
      • 42. Supamahitorn, S.: ‘Investigation of a Kolmogorov complexity based similarity metric for content based image retrieval’. Masters thesis, Oklahoma State University, 2004.
    54. 54)
    55. 55)
      • 27. Zhu, Q.-F., Yao, W.: ‘Error control and concealment for video communication’, Opt. Eng. New York Marcel Dekker Inc., 1999, 64, pp. 163204.
    56. 56)
      • 67. Marks II, R.J.: ‘Handbook of Fourier analysis & its applications’ (Oxford University Press, Oxford, New York, 2009).
    57. 57)
      • 73. Marks II, R.J., Walkup, J.F., Hagler, M.O.: ‘Sampling theorems for shift-variant systems’. Proc. of the 1977 Midwest Symp. on Circuits and Systems, Texas Tech University, Lubbock, August 1977.
    58. 58)
    59. 59)
      • 68. Marks II, R.J., Walkup, J.F., Hagler, M.O.: ‘Volume hologram representation of space-variant system’, in Marom, E.E., Friesem, A., Wiener-Aunear, E. (Eds.): ‘Applications of holography and optical data processing’ (Pergamon Press, Oxford, 1977), pp. 105113.
    60. 60)
    61. 61)
      • 65. Martin, J., Baylis, C., Marks, R., Moldovan, M.: ‘Perturbation size and harmonic limitations in affine approximation for time invariant periodicity preservation systems’. Submitted to IEEE Waveform Diversity Conf., 2011.
    62. 62)
    63. 63)
    64. 64)
      • 15. Solomonoff, R.J.: ‘A preliminary report on a general theory of inductive inference’. Technical Report, Zator Co. and Air Force Office of Scientific Research, Cambridge, MA, 1960.
    65. 65)
    66. 66)
    67. 67)
    68. 68)
      • 58. Cilibrasi, R., Vitányi, P.: ‘Automatic extraction of meaning from the web’. 2006 IEEE Int. Symp. on Information Theory, 2006, pp. 23092313.
    69. 69)
    70. 70)
      • 1. Mirowski, P.: ‘Machine dreams: economics becomes a cyborg science’ (Cambridge University Press, New York, NY, 2002).
    71. 71)
    72. 72)
    73. 73)
    74. 74)
    75. 75)
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2014.0141
Loading

Related content

content/journals/10.1049/iet-cvi.2014.0141
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address