Noise-resistant hemispherical basis for image-based relighting

Author(s): P.-M. Lam ; C.-S. Leung ; T.-T. Wong
DOI: 10.1049/iet-ipr.2009.0134

For access to this article, please select a purchase option:

Buy article PDF

Buy Knowledge Pack

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership

Recommend Title Publication to library

IET Image Processing — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Author(s): P.-M. Lam ¹ ; C.-S. Leung ¹ ; T.-T. Wong ²
- Affiliations: 1: Department of Electronic Engineering, City University of Hong Kong, Kowloon, People's Republic of China
  2: Department of Computer Science and Engineering, The Chinese University of Hong Kong, Shatin, People's Republic of China
Source: Volume 6, Issue 1, February 2012, p. 72 – 86
DOI: 10.1049/iet-ipr.2009.0134 , Print ISSN 1751-9659, Online ISSN 1751-9667

The spherical harmonic (SH) basis has been widely used for representing relighting data. However, under some situations, the magnitudes of the estimated SH coefficients could be very large. Hence, relit images are very sensitive to quantisation (or compression) noise of these estimated SH coefficients. To tackle this issue, this study proposes a new spherical basis, namely eigen hemispherical harmonic (EHSH) basis. Its approximation ability is the same as that of the SH basis. With this new basis, the magnitudes of the estimated coefficients are controllable. Hence, the artefacts in the relit images can be suppressed. Besides, the transform from the classical hemispherical SH coefficients to the EHSH coefficients is discussed. Finally, the authors present the way to relight images based on the EHSH basis.

References

1. 1)
  - P.-P. Sloan , X. Liu , H.-Y. Shum , J. Snyder . Bi-scale radiance transfer. ACM Trans. Graph. , 3 , 370 - 375
2. 2)
  - ‘Precomputed radiance transfer (Direct3D 9)’, http://msdn.microsoft.com/en-us/library/bb147287(VS.85).aspx.
3. 3)
  - Gautron, P., Křivánek, J., Pattanaik, S.N., Bouatouch, K.: `A novel hemispherical basis for accurate and efficient rendering', Rendering Techniques 2004, Eurographics Symp. on Rendering, June 2004, p. 321–330.
4. 4)
  - Malzbender, T., Gelb, D., Wolters, H.: `Polynomial texture maps', SIGGRAPH'01: Proc. 28th Annual Conf. on Computer Graphics and Interactive Techniques, 2001, New York, NY, USA, p. 519–528.
5. 5)
  - Oats, C.: `Adding spherical harmonic lighting to the sushi engine', Game Developer Conf., 2004, http://ati.amd.com/developer/gdc/Oat-GDC04-SphericalHarmonicLighting.pdf.
6. 6)
  - J. Ivanic , K. Ruedenberg . Rotation matrices for real spherical harmonics. Direct determination by recursion. J. Phys. Chem. , 15 , 6342 - 6347
7. 7)
  - R.W. Buccigrossi , E.P. Simoncelli . Image compression via joint statistical characterization in the wavelet domain. IEEE Trans. Image Proc. , 12 , 1688 - 1701
8. 8)
  - T.-Y. Ho , P.-M. Lam , C.-S. Leung , T.-T. Wong . GPU-friendly rendering for illumination adjustable images. Image Commun. , 10 , 919 - 933
9. 9)
  - Moreno-Noguer, F., Nayar, S.K., Belhumeur, P.N.: `Optimal illumination for image and video relighting', Int. Conf. on Computer Graphics and Interactive Techniques, SIGGRAPH'05: ACM SIGGRAPH 2005 Sketches, 2005, New York, NY, USA, p. 75.
10. 10)
  - P. Debevec . Image-based modeling and lighting. ACM SIGGRAPH Comput. Graph. , 4 , 46 - 50
11. 11)
  - T.T. Wong , C.S. Leung . Compression of illumination adjustable image. IEEE Trans. Circuits Syst. Video Technol. , 11 , 1107 - 1118
12. 12)
  - A. Gersho , R.M. Gray . (1991) Vector quantization and signal compression.
13. 13)
  - Kautz, J., Sloan, P.-P., Snyder, J.: `Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics', EGRW'02: Proc. 13th Eurographics Workshop on Rendering, Aire-la-Ville, Switzerland, 2002, Switzerland, p. 291–296.
14. 14)
  - J. Ivanic , K. Ruedenberg . Additions and corrections: rotation matrices for real spherical harmonics. Direct determination by recursion. J. Phys. Chem. , 5 , 9099 - 9100
15. 15)
  - B.E. Usevitch . A tutorial on modern lossy wavelet image compression: foundations of JPEG 2000. IEEE Signal Process. Mag. , 5 , 22 - 35
16. 16)
  - P.M. Lam , C.S. Leung , T.T. Wong . Noise-resistant fitting for spherical harmonics. IEEE Trans. Vis. Comput. Graph. , 2 , 254 - 265
17. 17)
  - T.T. Wong , C.W. Fu , P.A. Heng , C.S. Leung . The plenoptic illumination function. IEEE Trans. Multimed. , 3 , 361 - 371
18. 18)
  - R. Ng , R. Ramamoorthi , P. Hanrahan . All-frequency shadows using non-linear wavelet lighting approximation. ACM Trans. Graph. , 3 , 376 - 381
19. 19)
  - J.K. Proakis , D.G. Manolakis . (1996) Digital signal processing: principles, algorithms, and applications.
20. 20)
  - T.-P. Wu , K.-L. Tang , C.-K. Tang , T.-T. Wong . Dense photometric stereo: a Markov random field approach. IEEE Trans. Patt. Anal. Mach. Intell. , 11 , 1830 - 1846
21. 21)
  - Sloan, P.-P., Kautz, J., Snyder, J.: `Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments', SIGGRAPH '02: Proc. 29th Annual Conf. on Computer Graphics and Interactive Techniques, 2002, New York, NY, USA, p. 527–536.
22. 22)
  - J. Ko , M. Ko , M. Zuricker , W. Engel . (2004) Practical methods for a PRT-based shader using spherical harmonics, ShaderX6: advanced rendering techniques.
23. 23)
  - Marschner, S.R., Westin, S.H., Lafortune, E.P.F., Torrance, K.E., Greenberg, D.P.: `Image-based BRDF measurement including human skin', Proc. Tenth Eurographics Workshop on Rendering, June 1999, p. 139–152.
24. 24)
  - P. Sloan , J. Kautz , J. Snyder . Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Trans. Graph. , 3 , 527 - 536
25. 25)
  - Bai, G., Qi, Y.: `An interactive, 3D exhibition system with global illumination for digital museum,’', ‘Learning by Playing. Game-based Education System Design and Development’ (LNCS, 5670), 2009, p. 85–92.
26. 26)
  - T.T. Wong , C.W. Fu , P.A. Heng . Interactive relighting of panoramas. IEEE Comput. Graph. Appl. , 2 , 32 - 41
27. 27)
  - Sloan, P.P.: `Stupid spherical harmonics (SH) tricks', Game Developers Conf. 2008, February 2008.
28. 28)
  - Liu, B., Kaneko, T.: `Error analysis of digital filter realized with floating-point arithmetic', Proc. IEEE, October 1969, 57, p. 1735–1747.
29. 29)
  - M. Pharr , G. Humphreys . (2004) Physically-based rendering: from theory to implementation.
30. 30)
  - C.H. Choi , J. Ivanic , M.S. Gordon , K. Ruedenbers . Rapid and stable determination of rotation matrices between spherical harmonics by direct recursion. J. Chem. Phys. , 19 , 8828 - 8831
31. 31)
  - Adams, M.D., Ward, R.: `Wavelet transforms in the JPEG-2000 standard', Proc. IEEE Pacific Rim Conf. on Communications, Computers and Signal Processing, 2001, 1, p. 160–163.
32. 32)
  - X. Liu , P.P. Sloan , H.Y. Shum , J. Snyder , A. Keller , H.W. Jensen . (2004) All-frequency precomputed radiance transfer for glossy objects, Eurographics symposium on rendering Norrköping.
33. 33)
  - Ramamoorthi, R., Hanrahan, P.: `Frequency space environment map rendering', SIGGRAPH’02: Proc. 29th Annual Conf. on Computer Graphics and Interactive Techniques, 2002, New York, NY, USA, p. 517–526.
34. 34)
  - E.H. Adelson , J.R. Bergen , M.S. Landy , J.A. Movshon . (1991) The plenoptic function and the elements of early vision, Computational models of visual processing.

Noise-resistant hemispherical basis for image-based relighting

Noise-resistant hemispherical basis for image-based relighting

Buy article PDF

Buy Knowledge Pack

Thank you

References

Related content