Journal of Conservation Science (보존과학회지)

The Korean Society Of Conservation Science For Cultural Heritage (한국문화재보존과학회)
권호 표지
DOI QR코드

DOI QR Code

Off-Site Distortion and Color Compensation of Underwater Archaeological Images Photographed in the Very Turbid Yellow Sea

  • Jung, Young-Hwa (Department of Cultural Heritage Conservation Science, Kongju National University) ;
  • Kim, Gyuho (Department of Cultural Heritage Conservation Science, Kongju National University) ;
  • Yoo, Woo Sik (WaferMasters, Inc.)
  • Received : 2021.12.01
  • Accepted : 2022.01.11
  • Published : 2022.02.20
Download PDF
⟨ Previous Next ⟩

Abstract

Underwater photographing and image recording are essential for pre-excavation survey and during excavation in underwater archaeology. Unlike photographing on land, all underwater images suffer various quality degradations such as shape distortions, color shift, blur, low contrast, high noise levels and so on. Outcome is very often heavily photographing equipment and photographer dependent. Excavation schedule, weather conditions, and water conditions can put burdens on divers. Usable images are very limited compared to the efforts. In underwater archaeological study in very turbid water such as in the Yellow Sea (between mainland China and the Korean peninsula), underwater photographing is very challenging. In this study, off-site image distortion and color compensation techniques using an image processing/analysis software is investigated as an alternative image quality enhancement method. As sample images, photographs taken during the excavation of 800-year-old Taean Mado Shipwrecks in the Yellow Sea in 2008-2010 were mainly used. Significant enhancement in distortion and color compensation of archived images were obtained by simple post image processing using image processing/analysis software (PicMan) customized for given view ports, lenses and cameras with and without optical axis offsets. Post image processing is found to be very effective in distortion and color compensation of both recent and archived images from various photographing equipment models and configurations. Merits and demerit of in-situ, distortion and color compensated photographing with sophisticated equipment and conventional photographing equipment, which requires post image processing, are compared.

Keywords

Acknowledgement

All authors would like to acknowledge National Research Institute of Maritime Cultural Heritage (NRIMCH), Mokpo, Korea for providing Taean Mado Shipwreck excavation reports with archived underwater images photographed during pre-excavation survey and excavation activities. Y.-H. Jung would like to express his special thanks to his colleagues at NRIMCH for their encouragement and support during this project.

References

  1. Bahn, P.G., 2004, The bluffer's guide to archaeology. Oval Books, London, 31.
  2. Benjamin, J., McCarthy, J., Wiseman, C., Bevin, S., Kowlessar, J., Astrup, P.M., Nauman, J. and Hacke, J., 2019, Integrating aerial and underwater data for archaeology: digital maritime landscapes in 3D. In: McCarthy J., Benjamin J., Winton T., van Duivenvoorde W. (eds.), 3D Recording and Interpretation for Maritime Archaeology. Coastal Research Library, vol 31. Springer, Cham, Switzerland, 211-231.
  3. Berman, D., Levy, D., Avidan, S. and Tali Treibitz, T., 2021, Underwater single image color restoration using haze-lines and a new quantitative dataset. IEEE transactions on pattern analysis and machine intelligence, 43(8), 2822-2837.
  4. Castillon, M., Palomer, A., Forest, J. and Ridao, P., 2019, State of the art of underwater active optical 3D scanners. Sensors, 19(23), 5161. https://doi.org/10.3390/s19235161
  5. Codevilla, F., De O. Gaya, J., Filho, N.D. and Botelho, S.S.C., 2015, Achieving turbidity robustness on underwater images local feature detection. 26th British Machine Vision Conference ( BMVC), Swansea, UK, Sep 7-10, 154.1-154.13.
  6. Danko, J.P., 2018, Underwater photography in murky water - tips and tricks, https://www.diyphotography.net/underwaterphotography-in-murky-water-tips-and-tricks/ (June 19, 2021)
  7. Fitzgibbon, A.W., 2001, Simultaneous linear estimation of multiple view geometry and lens distortion. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, HI, USA, Dec 8-14, 1063-6919.
  8. Global Times, 2019, Sunken 19th century Chinese battleship discovered in Yellow Sea, https://www.globaltimes.cn/content/1164822.shtml (June 25, 2021)
  9. HyperPhysics, 2021, Refraction of Light. http://hyperphysics. phy-astr.gsu.edu/hbase/geoopt/refr.html (June 19, 2021)
  10. Jung, Y.-H., Lee, Y.-H., Kim, J.-H., Lee, S.-H., Kim, H.-D. and Kim, Y.-H., 2017, Development of the sledge-type underwater metal detection system for underwater cultural heritage exploration. http://www.themua.org/collections/items/show/1813 (June 25, 2021)
  11. Jung, Y.-H, Kim, G. and Yoo, W.S., 2021, Study on distortion compensation of underwater archaeological images acquired through a fisheye lens and practical suggestions for underwater photography - a case of Taean Mado Shipwreck No. 1 and No. 2 -, Journal of Conservation Science, 37(4), 312-321. https://doi.org/10.12654/JCS.2021.37.4.01
  12. Kim, E.A., Kim, D.S., Hyen, J.H. and Kim, G.H., 2019, Study on material characteristic evaluation of Sangpyeongtongbo coins in Joseon Dynasty using non-destructive analysis. Science and Engineering of Cultural Heritage, 14(1), 23-30. (in Korean with English Abstract) https://doi.org/10.37563/SECH.14.1.4
  13. Kim, M. and Moon, W.S., 2011, Tracking 800-year-old shipments: an archaeological investigation of the Mado Shipwreck cargo, Taean, Korea. Journal of Maritime Archaeology, 6, 129-149. https://doi.org/10.1007/s11457-011-9082-5
  14. Kim, G., Kim, J.G., Kang K. and Yoo, W.S., 2019, Image-based quantitative analysis of foxing stains on old printed paper documents. Heritage, 2, 2665-2677. https://doi.org/10.3390/heritage2030164
  15. Kocak, D.M., Dalgleish, F.R., Caimi, F.M. and Schechner, Y.Y., 2008, A focus on recent developments and trends in underwater imaging. Marine Technology Society Journal, 42(1), 52-67. https://doi.org/10.4031/002533208786861209
  16. Koh, K.-H., 2014, Food culture of Koryo dynasty from the viewpoint of marine relics of Taean Mado Shipwrecks No. 1 and No. 2. J. Korean Soc. Food Cult., 29(6): 499-510. (in Korean with English Abstract) https://doi.org/10.7318/KJFC/2014.29.6.499
  17. Kunz, C. and Singh, H., 2008, Hemispherical refraction and camera calibration in underwater vision. In Proceedings of the OCEANS 2008, Quebec, Canada, Sep 15-18, 1-7.
  18. Lee, M.Y. and Wi, K.C., 2021, A study on the color of natural solvent for the red color reproduction of safflower. Journal of Conservation Science, 37(1), 13-24. https://doi.org/10.12654/JCS.2021.37.1.02
  19. Lee, H.J., Wang, Y.P., Chu, Y.S. and Jo, H.R., 2006, Suspended sediment transport in the coastal area of Jinhae Bay - Nakdong estuary, Korea Strait. Journal of Coastal Research, 22(5), 1062-1069. https://doi.org/10.2112/04-0231.1
  20. Lee, Y.-H., Kim, J.-H., Lee, S.-H. and Kim, S.-B., 2021, Underwater excavation records using underwater acoustic survey: a case study in South Korea. Appl. Sci., 11, 4252. https://doi.org/10.3390/app11094252
  21. Liu, F., Li, X., Han, P. and Shao, X., 2021, Advanced visualization polarimetric imaging: removal of water spray effect utilizing circular polarization. Appl. Sci., 11, 2996. https://doi.org/10.3390/app11072996
  22. Mangeruga, M., Bruno, F., Cozza, M., Agrafiotis, P. and Skarlatos, D., 2018, Guidelines for underwater image enhancement based on benchmarking of different methods. Remote sensing, 10(10), 1652. https://doi.org/10.3390/rs10101652
  23. Mathivanan, P., Dhanigaivel, Hariharan, Kannan, N. and Kumar, P., 2019, Underwater image enhancement by wavelength compensation and de-hazing. International Journal of Applied Engineering Research, 14(6, Special Issue), 37-41.
  24. Menna, F., Nocerino, E., Fassi, F. and Remondino, F., 2016, Geometric and optic characterization of a hemispherical dome port for underwater photogrammetry. Sensors, 16(1), 48. https://doi.org/10.3390/s16010048
  25. Menna, F., Nocerino, E. and Remondino, F., 2017, Flat versus hemispherical dome ports in underwater photogrammetry. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLII-2/W3, 3D Virtual Reconstruction and Visualization of Complex Architectures, Nafplio, Greece, Mar 1-3, 481-487.
  26. Mohan. S. and Simon, P., 2020, Underwater image enhancement based on histogram manipulation and multiscale fusion. Procedia Computer Science, 171, 941-950. https://doi.org/10.1016/j.procs.2020.04.102
  27. Nam, B., Park, D., Kang, H., Jang, S. and Jung, Y.-H., 2010, A study of extracting appropriate conditions for efficient desalination for the underwater archaeological ceramics from Ma Island in Taean. Journal of Conservation Science, 36(6), 133-142. (in Korean with English Abstract)
  28. NASA, 2015, Swirls of color in the Yellow Sea, https://earthobservatory.nasa.gov/images/85514/swirls-ofcolor-in-the-yellow-sea (June 19, 2021)
  29. NRIMCH (National Research Institute of Maritime Cultural Heritage of Korea), 2010, Taean Mado Shipwreck No. 1. Underwater Excavation Report, 2010.
  30. NRIMCH (National Research Institute of Maritime Cultural Heritage of Korea), 2011, Taean Mado Shipwreck No. 2. Underwater Excavation Report, 2011.
  31. Pedroso de Lima, R.L., Boogaard, F.C. and de Graaf-van Dinther, R.E., 2020, Innovative water quality and ecology monitoring using underwater unmanned vehicles: field applications, challenges and feedback from water managers. Water, 12, 1196. https://doi.org/10.3390/w12041196
  32. Reef2Reef, 2021, Refractometers and salinity measurement. https://www.reef2reef.com/ams/refractometers-and-salinity-measurement.5/ (June 19, 2021)
  33. Stack overflow, 2011, Formulas for barrel/pincushion distortion. http://marcodiiga.github.io/radial-lens-undistortionfiltering (August 4, 2021)
  34. Stupar, D.Z., Bajic, J.S., Joza, A.V, Dakic, B.M., Slankamenac, M.P., Zivanov, M.B. and Cibula, E., 2012, Remote monitoring of water salinity by using side-polished fiber-optic U-shaped sensor. 15th International Conference: Power Electronics and Motion Control Conference (EPE/PEMC), Novi Sad, Serbia, Sep 4-6.
  35. Viduka, A.J., 2012, Unit 10 intrusive techniques in underwater archaeology. In: UNESCO Office Bangkok and Regional Bureau for Education in Asia and the Pacific (eds.), Training manual for the UNESCO foundation course on the protection and management of underwater cultural heritage in asia and the pacific. UNESCO Bangkok, 243-273.
  36. Wei, J., Li, C.F., Hu, S.M., Martin, R.R. and Tai, C.L., 2012, Fisheye video correction. IEEE Transactions on Visualization and Computer Graphics, 18(10), 1771-1783. https://doi.org/10.1109/TVCG.2011.130
  37. Wells, J.T. and Huh, O.K., 1984, Fall-season patterns of turbidity and sediment transport in the Korea strait and southeastern Yellow Sea. Elsevier Oceanography Series, 39, 387-397. https://doi.org/10.1016/S0422-9894(08)70314-3
  38. Wells, J.T., 1988, Distribution of suspended sediment in the Korea strait and southeastern Yellow Sea: Onset of winter monsoons. Marine Geology, 83(1-4), 273-284. https://doi.org/10.1016/0025-3227(88)90062-X
  39. Wikipedia, 2021, Yellow Sea. https://en.wikipedia.org/wiki/Yellow_Sea (June 19, 2021)
  40. Xu, M., 2019, Comparison and research of fisheye image correction algorithms in coal mine survey. IOP Conference Series: Earth and Environmental Science, 300(2), 022075.
  41. Yang, S.S., 2011, Packaging and loading methods of Goryeo Dynasty ceramics excavated underwater. The 2011 Asia-Pacific Regional Conference on Underwater Cultural Heritage Proceedings. Manila, Philippines, Nov 8-12.
  42. Yoo, Y. and Yoo, W.S., 2020, Turning image sensors into position and time sensitive quantitative colorimetric data sources with the aid of novel image processing/analysis software. Sensors, 20, 6418. https://doi.org/10.3390/s20226418
  43. Yoo, Y. and Yoo, W.S., 2021, Digital image comparisons for investigating aging effects and artificial modifications using image analysis software. Journal of Conservation Science, 37(1), 1-12. https://doi.org/10.12654/JCS.2021.37.1.01
  44. Yoo, W.S., Ishigaki, T. and Kang, K., 2017, Image processing software assisted quantitative analysis of various digital images in process monitoring, process control and material characterization. The 2017 International Conference on Frontiers of Characterization and Metrology for Nanoelectronics (ICFCMN), Monterey, CA, Mar 21-23.
  45. Yoo, W.S., Kang, K., Kim, J.G. and Jung, Y.-H., 2019, Development of image analysis software for archaeological applications. Advancing Southeast Asian Archaeology, 402-411.
  46. Yoo, W.S, Yoo, S.S, Yoo, B.H. and Yoo, S.J., 2021, Investigation on the conservation status of the 50-year-old "Yu Kil-Chun Archives" and an effective and practical method of preserving and sharing contents. Journal of Conservation Science, 37(2), 167-178. (in Korean with English Abstract) https://doi.org/10.12654/JCS.2021.37.2.08
  47. Yoo, W.S., 2020, Comparison of outlines by image analysis for derivation of objective validation results: "Ito Hirobumi's characters on the foundation stone" of the main building of Bank of Korea. Journal of Conservation Science, 36(6), 511-518. (in Korean with English Abstract) https://doi.org/10.12654/JCS.2020.36.6.07
  48. Zhang, Z., 1999, Flexible camera calibration by viewing a plane from unknown orientation. The Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece, Sep 20-27, 666-673.