Isocube-based spherical wavelet for image-based relighting

Author(s): L. Wan ; C.-S. Leung ; P.-M. Lam ; S.K. Mak ; T.-T. Wong
DOI: 10.1049/iet-cvi.2009.0080

For access to this article, please select a purchase option:

Buy article PDF

Buy Knowledge Pack

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership

Recommend Title Publication to library

IET Computer Vision — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Author(s): L. Wan ^{1, 2} ; C.-S. Leung ¹ ; P.-M. Lam ¹ ; S.K. Mak ¹ ; T.-T. Wong ³
- Affiliations: 1: Department of Electronic Engineering, City University of Hong Kong, Kowloon Tong, Hong Kong
  2: School of Computer Software, Tianjin University, Tianjin, People's Republic of China
  3: Department of Computer Science and Engineering, Chinese University of Hong Kong, Shatin, Hong Kong
Source: Volume 5, Issue 3, May 2011, p. 151 – 163
DOI: 10.1049/iet-cvi.2009.0080 , Print ISSN 1751-9632, Online ISSN 1751-9640

Using the brute-force way of synthesising a scene that is, illuminated under a distant environment is computationally intensive. To speed up the synthesis, we can represent the appearance of the scene under different lighting directions as an illumination adjustable image (IAI). Relighting the scene under a lighting environment is then achieved by manipulating the pre-recorded images of the IAI. However, the relighting based on the pre-recorded images is still inefficient because of the large storage and computation requirements. The approaches based on spherical harmonics (SH) and cubemap-based spherical wavelets (CSW) have been proposed to improve the relighting efficiency. Note that the SH approach is suitable for low-frequency lighting only, whereas the CSW approach suffers the problem of uneven sampling. In this paper, we propose a novel approach, Isocube-based spherical wavelets (IsoSW), to efficiently synthesise images based on the IAI representation. Unlike the SH approach, our approach can effectively capture high-frequency illumination effects. Compared with the CSW approach, our approach not only improves the rendering quality, but also makes the synthesis process more efficient.

References

1. 1)
  - Liu, X., Sloan, P.P., Shum, H.Y., Snydeer, J.: `All-frequency precomputed radiance transfer for glossy objects', Proc. 15th Eurographics Symp. on Rendering, 2004, Norrköping, Sweden, p. 337–344.
2. 2)
  - T.T. Wong , C.W. Fu , P.A. Heng , C.S. Leung . The plenoptic illumination function. IEEE Trans. Multimed. , 3 , 361 - 371
3. 3)
  - Veach, E., Guibas, L.J.: `Optimally combining sampling techniques for Monte Carlo rendering', SIGGRAPH95, August 1995, Los Angeles, California, USA, p. 419–428.
4. 4)
  - S. Mallat . (1998) A wavelet tour of signal processing.
5. 5)
  - Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., Sagar, M.: `Acquiring the reflectance field of a human face', SIGGRAPH00, July 2000, New Orleans, Louisiana, USA, p. 145–156.
6. 6)
  - Wong, T.T., Heng, P.A., Or, S.H., Ng, W.Y.: `Image-based rendering with controllable illumination', Proc. Eighth Eurographics Workshop on Rendering, June 1997, Saint Etienne, France, p. 13–22.
7. 7)
  - Debevec, P., Malik, J.: `Recovering high dynamic range radiance maps from photographs', SIGGRAPH97, August 1997, p. 369–378.
8. 8)
  - Kautz, J., Sloan, P.P., Snyder, J.: `Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics', Proc. 13th Eurographics Workshop on Rendering, June 2002, Pisa, Italy, p. 291–297.
9. 9)
  - R. Ng , R. Ramamoorthi , P. Hanrahan . All-frequency shadows using non-linear wavelet lighting approximation. ACM Trans. Graph. , 3 , 376 - 381
10. 10)
  - L. Wan , T.T. Wong , C.S. Leung . Isocube: exploiting the cubemap hardware. IEEE Trans. Vis. Comput. Graph. , 4 , 720 - 731
11. 11)
  - Z. Wang , C.S. Leung , Y.S. Zhu , T.T. Wong . Data compression with spherical wavelets and wavelets for the image-based relighting. Comput. Vis. Image Underst. , 3 , 327 - 344
12. 12)
  - Schröder, P., Sweldens, W.: `Spherical wavelets: efficiently representing functions on the sphere', SIGGRAPH95, August 1995, Los Angeles, California, USA, p. 161–172.
13. 13)
  - P. Debevec . Image-based lighting. IEEE Comput. Graph. Appl. , 2 , 26 - 34
14. 14)
  - T.T. Wong , C.S. Leung . Compression of illumination adjustable image. IEEE Trans. Circuits Syst. Video Technol. , 11 , 1107 - 1118
15. 15)
  - T.T. Wong , C.W. Fu , P.A. Heng . Interactive relighting of panoramas. IEEE Comput. Graph. Appl. , 2 , 32 - 41
16. 16)
  - T. Macrobert . (1948) Spherical harmonics: an elementary treatise on harmonic functions with applications.
17. 17)
  - Zongker, D.E., Werner, D.M., Curless, B., Salesin, D.H.: `Environment matting and compositing', SIGGRAPH99, August 1999, Los Angeles, California, USA, p. 205–214.
18. 18)
  - N. Greene . Environment mapping and other applications of world projections. IEEE Comput. Graph. Appl. , 11 , 21 - 29
19. 19)
  - Z. Lin , T.T. Wong , H.Y. Shum . Relighting with the reflected irradiance field: representation, sampling and reconstruction. Int. J. Comput. Vis. , 229 - 246
20. 20)
  - Gorski, K.M., Wandelt, B.D., Hivon, E., Hansen, F.K., Banday, A.J.: `The HEALPix primer', Techical Report, February 2003, astro-ph/9905275.

Isocube-based spherical wavelet for image-based relighting

Isocube-based spherical wavelet for image-based relighting

Buy article PDF

Buy Knowledge Pack

Thank you

References

Related content