http://iet.metastore.ingenta.com
1887

Shape-from-shading using sensor and physical object characteristics applied to human teeth surface reconstruction

Shape-from-shading using sensor and physical object characteristics applied to human teeth surface reconstruction

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Computer Vision — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Image formation involves understanding the sensors characteristics and object reflectance. In dentistry, for example an accurate three-dimensional (3D) representation of the human jaw may be used for diagnostic and treatment purposes. Photogrammetry can offer a flexible, cost-effective solution in that regard. Nonetheless there are several challenges, such as non-friendly image acquisition environment inside the human mouth, problems with lighting (specularity effects because of saliva, gum discolourisation, and occlusion because of the tongue in the lower jaw), and errors because of the data acquisition sensors (e.g. camera calibration errors, lens distortion and so on). In this study, the authors focus on the 3D surface reconstruction aspect for human jaw modelling based on physical surface characteristics and sensor properties. Owing to apparent lens distortion imposed by near-field imaging, the authors propose a new flexible calibration for lens radial distortion based on a single image of a sphere. The authors propose a non-Lambertian shape-from-shading (SFS) algorithm under perspective projection which benefits from camera calibration parameters. Our experiments provide quantitative metric results for the proposed approach. The reflectance of the tooth surface is modelled by the Oren–Nayar reflectance model for rough surfaces whose roughness parameter is physically computed from an optical surface profiler measurements. As compared to state-of-the-art SFS approaches, our approach is able to recover geometric details of tooth occlusal surface. This work is fundamental for establishing an optical-based approach for reconstructing the human jaw, that is inexpensive and does not use ionising radiation.

References

    1. 1)
      • D. Laurendeau , D. Possart .
        1. Laurendeau, D., Possart, D.: ‘A computer-vision technique for the acquisition and processing of 3d profiles of dental imprints: An application in orthodontics’, IEEE Trans. Med. Imaging, 1991, 10, pp. 453461 (doi: 10.1109/42.97596).
        . IEEE Trans. Med. Imaging , 453 - 461
    2. 2)
      • A.A. Goshtasby , S. Nambala , W.G. deRijk , S.D. Campbell .
        2. Goshtasby, A.A., Nambala, S., deRijk, W.G., Campbell, S.D.: ‘A system for digital reconstruction of gypsum dental casts’, IEEE Trans. Med. Imaging, 1997, 16, pp. 664674 (doi: 10.1109/42.640757).
        . IEEE Trans. Med. Imaging , 664 - 674
    3. 3)
      • M.J. Grenness , J.E. Osborn , M.J. Tyas .
        3. Grenness, M.J., Osborn, J.E., Tyas, M.J.: ‘Mapping tooth surface loss with a fixed-base stereo-camera’, Photogramm. Rec., 2008, 23, pp. 194207 (doi: 10.1111/j.1477-9730.2008.00479.x).
        . Photogramm. Rec. , 194 - 207
    4. 4)
      • H.L. Mitchell , R.G. Chadwick .
        4. Mitchell, H.L., Chadwick, R.G.: ‘Challenges of photogrammetric intra-oral tooth measurement’. The Int. Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Kyoto, Japan, 2008, pp. 779782.
        . The Int. Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences , 779 - 782
    5. 5)
      • S.M. Yamany , A.A. Farag , D. Tasman , A.G. Farman .
        5. Yamany, S.M., Farag, A.A., Tasman, D., Farman, A.G.: ‘A 3-d reconstruction system for the human jaw using a sequence of optical images’, IEEE Trans. Med. Imaging, 2000, 19, pp. 538547 (doi: 10.1109/42.870264).
        . IEEE Trans. Med. Imaging , 538 - 547
    6. 6)
      • M.T. Ahmed , A. Eid , A.A. Farag .
        6. Ahmed, M.T., Eid, A., Farag, A.A.: ‘Human jaw reconstruction: New approach and improvements’. Int. Conf. on Medical Image Computing and Computer-Assisted Intervention (MICCAI'01), The Netherlands, October 2001.
        . Int. Conf. on Medical Image Computing and Computer-Assisted Intervention (MICCAI'01)
    7. 7)
      • B.K.P. Horn , M.J. Brooks .
        7. Horn, B.K.P., Brooks, M.J.: ‘The variational approach to shape from shading’, Comput. Vis. Graph. Image Process., 1986, 33, pp. 174208 (doi: 10.1016/0734-189X(86)90114-3).
        . Comput. Vis. Graph. Image Process. , 174 - 208
    8. 8)
      • T. Collins , A. Bartoli . (2012)
        8. Collins, T., Bartoli, A.: ‘Towards live monocular 3d laparoscopy using shading and specularity information’, in Abolmaesumi, P., Joskowicz, L., Navab, N., Jannin, P. (Eds.): ‘Information processing in computer-assisted interventions’ (Springer Berlin Heidelberg, 2012) (LNCS, 7330), pp. 1121.
        .
    9. 9)
      • R. Zhang , P. Tsai , J.E. Cryer , M. Shah .
        9. Zhang, R., Tsai, P., Cryer, J.E., Shah, M.: ‘Shape from shading: A survey’, IEEE Trans. Pattern Anal. Mach. Intell., 1999, 21, (1), pp. 690706 (doi: 10.1109/34.784284).
        . IEEE Trans. Pattern Anal. Mach. Intell. , 1 , 690 - 706
    10. 10)
      • J.D. Durou , M. Falcone , M. Sagona .
        10. Durou, J.D., Falcone, M., Sagona, M.: ‘Numerical methods for shape-from-shading: A new survey with benchmarks’, Comput. Vis. Image Underst., 2008, 109, (1), pp. 2243 (doi: 10.1016/j.cviu.2007.09.003).
        . Comput. Vis. Image Underst. , 1 , 22 - 43
    11. 11)
      • F. Courteille , A. Crouzil , J.-D. Durou , P. Gurdjos .
        11. Courteille, F., Crouzil, A., Durou, J.-D., Gurdjos, P.: ‘Shape from shading for the digitization of curved documents’, J. Math. Imaging Vis., 2007, 18, pp. 301316.
        . J. Math. Imaging Vis. , 301 - 316
    12. 12)
      • J.K. Hasegawa , C.L. Tozzi .
        12. Hasegawa, J.K., Tozzi, C.L.: ‘Shape from shading with perspective projection and camera calibration’, Comput. Graph., 1996, 20, (3), pp. 351364 (doi: 10.1016/0097-8493(96)00004-0).
        . Comput. Graph. , 3 , 351 - 364
    13. 13)
      • E. Prados , F. Camilli , O. Faugeras .
        13. Prados, E., Camilli, F., Faugeras, O.: ‘A unifying and rigorous shape from shading method adapted to realistic data and applications’, J. Math. Imaging Vis., 2006, 25, pp. 307328 (doi: 10.1007/s10851-006-6899-x).
        . J. Math. Imaging Vis. , 307 - 328
    14. 14)
      • A. Tankus , N. Sochen , Y. Yeshurun .
        14. Tankus, A., Sochen, N., Yeshurun, Y.: ‘Shape-from-shading under perspective projection’, Int. J. Comput. Vis., 2005, 63, (1), pp. 2143 (doi: 10.1007/s11263-005-4945-6).
        . Int. J. Comput. Vis. , 1 , 21 - 43
    15. 15)
      • S.Y. Yuen , Y.Y. Tsui , C.K. Chow .
        15. Yuen, S.Y., Tsui, Y.Y., Chow, C.K.: ‘A fast marching formulation of perspective shape from shading under frontal illumination’, Pattern Recognit. Lett., 2007, 28, pp. 806824 (doi: 10.1016/j.patrec.2006.11.008).
        . Pattern Recognit. Lett. , 806 - 824
    16. 16)
      • T. Okatani , K. Deguchi .
        16. Okatani, T., Deguchi, K.: ‘Shape reconstruction from an endoscope image by shape from shading techniques for a point light source at the projection center’, Comput. Vis. Image Underst., 1997, 66, (2), pp. 119131 (doi: 10.1006/cviu.1997.0613).
        . Comput. Vis. Image Underst. , 2 , 119 - 131
    17. 17)
      • A. Ahmed , A. Farag .
        17. Ahmed, A., Farag, A.: ‘Shape from shading under various imaging conditions’. Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'07), Minneapolis, MN, 18-23 June 2007, pp. X1X8.
        . Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'07) , X1 - X8
    18. 18)
      • M. Oren , S. Nayar .
        18. Oren, M., Nayar, S.: ‘Generalization of Lambert's reflectance model’. Computer Graphics, 28 (Annual Conf. Series), 1994, pp. 239246.
        . Computer Graphics, 28 (Annual Conf. Series) , 239 - 246
    19. 19)
      • H. Ragheb , E. Hancock .
        19. Ragheb, H., Hancock, E.: ‘Surface normals and height from non-Lambertian image data’. Second Int. Symp. on 3D Data Processing, Visualization and Transmission (3DPVT'04), Greece, 2004.
        . Second Int. Symp. on 3D Data Processing, Visualization and Transmission (3DPVT'04)
    20. 20)
      • R. Frankot , R. Chellappa .
        20. Frankot, R., Chellappa, R.: ‘A method for enforcing integrability in shape from shading algorithms’, IEEE Trans. PAMI, 1988, 10, (4), pp. 439451 (doi: 10.1109/34.3909).
        . IEEE Trans. PAMI , 4 , 439 - 451
    21. 21)
      • D. Samaras , D. Metaxas .
        21. Samaras, D., Metaxas, D.: ‘Incorporating illumination constraints in deformable models for shape from shading and light direction estimation’, IEEE Trans. PAMI, 2003, 25, (2), pp. 247264 (doi: 10.1109/TPAMI.2003.1177155).
        . IEEE Trans. PAMI , 2 , 247 - 264
    22. 22)
      • C.N. Carter , R.J. Pusateri , D. Chen , A.H. Ahmed , A.A. Farag .
        22. Carter, C.N., Pusateri, R.J., Chen, D., Ahmed, A.H., Farag, A.A.: ‘Shape from shading for hybrid surfaces as applied to tooth reconstruction’. Int. Conf. on Image Processing (ICIP10), Hong Kong, 2010, pp. 40494052.
        . Int. Conf. on Image Processing (ICIP10) , 4049 - 4052
    23. 23)
      • A.S. Abdelrahim , M.A. Abdelrahman , H. Abdelmunim , A. Farag , M. Miller .
        23. Abdelrahim, A.S., Abdelrahman, M.A., Abdelmunim, H., Farag, A., Miller, M.: ‘Novel image-based 3d reconstruction of the human jaw using shape from shading and feature descriptors’. Proc. of the British Machine Vision Conf., 2011, pp. 41.141.11.
        . Proc. of the British Machine Vision Conf. , 41.1 - 41.11
    24. 24)
      • J. Weng , P. Cohen , M. Herniou .
        24. Weng, J., Cohen, P., Herniou, M.: ‘Camera calibration with distortion models and accuracy evaluation’, IEEE Trans. Pattern Anal. Mach. Intell. (PAMI), 1992, 14, (10), pp. 965980 (doi: 10.1109/34.159901).
        . IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) , 10 , 965 - 980
    25. 25)
      • M.T. Ahmed , A. Farag .
        25. Ahmed, M.T., Farag, A.: ‘Nonmetric calibration of camera lens distortion: Differential methods and robust estimation’, IEEE Trans. Image Process., 2005, 14, (8), pp. 12151230 (doi: 10.1109/TIP.2005.846025).
        . IEEE Trans. Image Process. , 8 , 1215 - 1230
    26. 26)
      • L. Robert .
        26. Robert, L.: ‘Camera calibration without feature extraction’, Comput. Vis. Image Underst., 1996, 63, (2), pp. 314325 (doi: 10.1006/cviu.1996.0021).
        . Comput. Vis. Image Underst. , 2 , 314 - 325
    27. 27)
      • C.K. Liang , Y.C. Shih , H.H. Chen .
        27. Liang, C.K., Shih, Y.C., Chen, H.H.: ‘Light field analysis for modeling image formation’, IEEE Trans. Image Process., 2011, 20, (2), pp. 446460 (doi: 10.1109/TIP.2010.2063036).
        . IEEE Trans. Image Process. , 2 , 446 - 460
    28. 28)
      • B. Horn . (1986)
        28. Horn, B.: ‘Robot vision’ (McGraw-Hill, 1986).
        .
    29. 29)
      • B.K.P. Horn , R.W. Sjoberg .
        29. Horn, B.K.P., Sjoberg, R.W.: ‘Calculating the reflectance map’, Appl. Opt., 1979, 18, pp. 17701779 (doi: 10.1364/AO.18.001770).
        . Appl. Opt. , 1770 - 1779
    30. 30)
      • F. Devernay , O. Faugeras .
        30. Devernay, F., Faugeras, O.: ‘Straight lines have to be straight: Automatic calibration and removal of distortion from scenes of structured environments’, Mach. Vis. Appl., 2001, 1, pp. 1424 (doi: 10.1007/PL00013269).
        . Mach. Vis. Appl. , 14 - 24
    31. 31)
      • R. Swaminathan , S. Nayar .
        31. Swaminathan, R., Nayar, S.: ‘Non-metric calibration of wide-angle lenses and polycameras’, PAMI, 2000, 22, (10), pp. 11721178 (doi: 10.1109/34.879797).
        . PAMI , 10 , 1172 - 1178
    32. 32)
      • C. Ricolfe-Viala , A.-J. Sánchez-Salmerón .
        32. Ricolfe-Viala, C., Sánchez-Salmerón, A.-J.: ‘Robust metric calibration of non-linear camera lens distortion’, Pattern Recognit., 2010, 43, pp. 16881699 (doi: 10.1016/j.patcog.2009.10.003).
        . Pattern Recognit. , 1688 - 1699
    33. 33)
      • H. Zhang , K. Wong , G. Zhang .
        33. Zhang, H., Wong, K., Zhang, G.: ‘Newblock camera calibration from images of spheres’, IEEE Trans. Pattern Anal. Mach. Intell. (PAMI), 2007, 29, (3), pp. 499502 (doi: 10.1109/TPAMI.2007.45).
        . IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) , 3 , 499 - 502
    34. 34)
      • J. Aloimonos .
        34. Aloimonos, J.: ‘Perspective approximations’, Image Vis. Comput., 1990, 8, (3), pp. 179192 (doi: 10.1016/0262-8856(90)90064-C).
        . Image Vis. Comput. , 3 , 179 - 192
    35. 35)
      • Q. Zheng , R. Chellapa .
        35. Zheng, Q., Chellapa, R.: ‘Estimation of illuminant direction, albedo and shape from shading’, IEEE Trans. Pattern Anal. Mach. Intell. (PAMI), 1991, 13, (7), pp. 680702 (doi: 10.1109/34.85658).
        . IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) , 7 , 680 - 702
    36. 36)
      • C.C. Slama . (1980)
        36. Slama, C.C.: ‘Manual of photogrammetry’ (American Society of Photogrammetry, 1980).
        .
    37. 37)
      • A.P. Pentland .
        37. Pentland, A.P.: ‘Local shading analysis’, IEEE Trans. Pattern Anal. Mach. Intell. (PAMI), 1984, PAMI-6, (2), pp. 170187 (doi: 10.1109/TPAMI.1984.4767501).
        . IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) , 2 , 170 - 187
    38. 38)
      • S.K. Nayar , K. Ikeuchi , T. Kanade .
        38. Nayar, S.K., Ikeuchi, K., Kanade, T.: ‘Surface reflection: physical and geometrical perspectives’, Pattern Anal. Mach. Intell., IEEE Trans., 1991, 13, (7), pp. 611634 (doi: 10.1109/34.85654).
        . Pattern Anal. Mach. Intell., IEEE Trans. , 7 , 611 - 634
    39. 39)
      • J.M. Bennett , L. Mattsson . (1999)
        39. Bennett, J.M., Mattsson, L.: ‘Introduction to surface roughness and scattering’ (Optical Society of America, Washington, DC, 1999).
        .
    40. 40)
      • J.L. Fuller , G.E. Denehy , T.M. Schulein . (2001)
        40. Fuller, J.L., Denehy, G.E., Schulein, T.M.: ‘Concise dental anatomy and morphology’ (University of Iowa Pubns Dept, 2001, 4th edn.).
        .
    41. 41)
      • R.C. Marino . (2004)
        41. Marino, R.C.: ‘Dental anatomy: quick study academic’ (Barcharts Inc, 2004), illustrated by: Vincent Perez.
        .
    42. 42)
      • J.F. Blinn .
        42. Blinn, J.F.: ‘Models of light reflection for computer synthesized pictures’, SIGGRAPH Comput. Graph., 1977, 11, pp. 192198 (doi: 10.1145/965141.563893).
        . SIGGRAPH Comput. Graph. , 192 - 198
    43. 43)
      • R.L. Cook , K.E. Torrance .
        43. Cook, R.L., Torrance, K.E.: ‘A reflectance model for computer graphics’, ACM Trans.Graph., 1982, 1, (1), pp. 724 (doi: 10.1145/357290.357293).
        . ACM Trans.Graph. , 1 , 7 - 24
    44. 44)
      • M. Ashikmin , S. Premoze , P. Shirley .
        44. Ashikmin, M., Premoze, S., Shirley, P.: ‘A microfacet-based brdf generator’. Proceedings of the 27th annual conference on Computer graphics and interactive techniques, SIGGRAPH’00, New York, NY, USA, 2000, pp. 6574.
        . Proceedings of the 27th annual conference on Computer graphics and interactive techniques, SIGGRAPH’00 , 65 - 74
    45. 45)
      • M. Oren , S. Nayar .
        45. Oren, M., Nayar, S.: ‘Generalization of the Lambertian model and implications for machine vision’, Int. J. Comput. Vis., 1995, 14, (3), pp. 227251 (doi: 10.1007/BF01679684).
        . Int. J. Comput. Vis. , 3 , 227 - 251
    46. 46)
      • K.E. Torrance , E.M. Sparrow .
        46. Torrance, K.E., Sparrow, E.M.: ‘Theory for off-specular reflection from roughened surfaces’, J. Am. Opt. Soc., 1967, 57, (9), pp. 11051114 (doi: 10.1364/JOSA.57.001105).
        . J. Am. Opt. Soc. , 9 , 1105 - 1114
    47. 47)
      • Y.G. Leclerc , A.F. Bobick .
        47. Leclerc, Y.G., Bobick, A.F.: ‘The direct computation of height from shading’ (IEEE Computer Sco. Press, 1991), vol. 91, pp. 552558.
        .
    48. 48)
      • P.S. Tsai , M. Shah .
        48. Tsai, P.S., Shah, M.: ‘A fast linear shape from shading’. Proc. IEEE Computer Vision and Pattern Recognition Conf. (CVPR), Urbana, Illinois, June 1992, pp. 734736.
        . Proc. IEEE Computer Vision and Pattern Recognition Conf. (CVPR) , 734 - 736
    49. 49)
      • A.H. Abdelrehim , A.A. Farag .
        49. Abdelrehim, A.H., Farag, A.A.: ‘A new formulation for shape from shading for non-Lambertian surfaces’. Int. Conf. on Computer Vision and Pattern Recognition CVPR06, NY, USA, 2006, pp. 18171824.
        . Int. Conf. on Computer Vision and Pattern Recognition CVPR06 , 1817 - 1824
    50. 50)
      • M. Elad , A. Tal , S. Ar .
        50. Elad, M., Tal, A., Ar, S.: ‘Content based retrieval of vrml objects: an iterative and interactive approach’. Proc. of the Sixth Eurographics workshop on Multimedia 2001, New York, NY, USA, 2002, pp. 107118..
        . Proc. of the Sixth Eurographics workshop on Multimedia 2001 , 107 - 118
    51. 51)
      • H. Chui , A. Rangarajan .
        51. Chui, H., Rangarajan, A.: ‘A new point matching algorithm for non-rigid registration’, Comput. Vis. Image Underst., 2003, 89, pp. 114141 (doi: 10.1016/S1077-3142(03)00009-2).
        . Comput. Vis. Image Underst. , 114 - 141
    52. 52)
      • R. Tyrrell Rockafellar , R.J.-B. Wets . (2005)
        52. Tyrrell Rockafellar, R., Wets, R.J.-B.: ‘Variational analysis’ (Springer-Verlag, 2005), p. 117.
        .
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2013.0068
Loading

Related content

content/journals/10.1049/iet-cvi.2013.0068
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address