Korean Journal of Environment and Ecology (한국환경생태학회지)

Korean Society of Environment and Ecology (한국환경생태학회)
권호 표지
DOI QR코드

DOI QR Code

Anura Call Monitoring Data Collection and Quality Management through Citizen Participation

시민참여형 무미목 양서류 음성신호 수집 및 품질관리 방안

  • 김경태 (단국대학교 대학원 생명공학대학 환경원예조경학과) ;
  • 이현정 (단국대학교 대학원 생명공학대학 환경원예조경학과) ;
  • 송원경 (단국대학교 바이오융합대학 생명자원학부)
  • Received : 2023.12.03
  • Accepted : 2024.04.25
  • Published : 2024.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Amphibians, sensitive to external environmental changes, serve as bioindicator species for assessing alterations or disturbances in local ecosystems. It is known that one-third of amphibian species within the order Anura are at risk of extinction due to anthropogenic threats such as habitat destruction and fragmentation caused by urbanization. To develop effective protection and conservation strategies for anuran amphibians, species surveys that account for population characteristics are essential. This study aimed to investigate the potential for citizen participation in ecological monitoring using the mating calls of anura species. We also proposed suitable quality control measures to mitigate errors and biases, ensuring the extraction of reliable species occurrence data. The Citizen Science project was carried out nationwide from April 1 to August 31, 2022, targeting 12 species of anura amphibians in Korea. Citizens voluntarily participated in voice signal monitoring, where they listened to anura species' mating calls and recorded them using a mobile application. Additionally, we established a quality control process to extract reliable species occurrence data, categorizing errors and biases from citizen-collected data into three levels: omission, commission, and incorrect identification. A total of 6,808 observations were collected during the citizen participation in anura species vocalization monitoring. Through the quality control process, errors and biases were identified in 1,944 (28.55%) of the 6,808 data. The most common type of error was omission, accounting for 922 cases (47.43%), followed by incorrect identification with 540 cases (27.78%), and commission with 482 cases (24.79%). During the Citizen Science project, we successfully recorded the mating calls of 10 out of the 12 anuran amphibian species in Korea, excluding the Asian toads (Bufo gargarizans Cantor), Korean brown frog (Rana coreana). Difficulties in collecting mating calls were primarily attributed to challenges in observing due to population decline or discrepancies between the breeding season of non-emergent individuals and the timing of the citizen science project. This study represents the first investigation of distribution status and species emergence data collection through mating calls of anura species in Korea based on citizen participation. It can serve as a foundation for designing future bioacoustic monitoring that incorporates citizen science and quality control measures for citizen science data.

외부 환경변화에 민감한 양서류는 지역 내 생태환경의 변화나 교란을 평가하는 생물지표종으로 활용되고 있다. 도시화로 인한 서식지 파괴, 단절과 같은 인위적인 위협으로 인해 무미목 양서류 종 3분의 1이 멸종 위험에 처한 것으로 알려져있다. 무미목 양서류의 적절한 보호 및 보전전략 마련을 위해서는 개체군의 특성을 고려한 생물종 조사가 요구된다. 본 연구는 무미목 양서류의 번식기 울음소리를 이용한 생태모니터링에 있어 시민들의 참여 가능성을 모색하고자 하였다. 또한 적절한 품질관리 방안을 제안하여 오류나 편향을 제거하고 신뢰도 높은 생물종 출현 자료를 추출하고자 하였다. 시민과학 프로젝트는 국내에 서식하는 무미목 양서류 12종을 대상으로 2022년 4월 1일부터 8월 31일까지 전국을 대상으로 수행되었다. 시민들의 자발적인 참여를 통해 무미목 양서류의 번식기 울음소리를 직접 청취하고 모바일 애플리케이션을 통해 녹음함으로써 음성신호 모니터링이 진행되었다. 또한 품질관리 프로세스를 구축하여 시민들로부터 수집된 데이터의 오류 및 편향을 누락, 허위, 잘못된 식별과 같이 3단계로 분류하여 신뢰도 높은 생물종 출현 자료를 추출하고자 하였다. 시민참여 무미목 양서류 음성신호 모니터링 결과 총 6,808건의 관찰 기록을 수집할 수 있었다. 품질관리 프로세스를 통해 6,808건의 데이터 중 1,944건(28.55%)에서 오류 및 편향이 발생하였다. 오류 및 편향 유형으로는 누락이 922건 (47.43%)으로 높은 빈도를 보였으며 잘못된 식별 540건(27.78%), 허위 482건(24.79%) 순서로 나타났다. 시민과학프로젝트를 통해 국내에 서식하는 12종의 무미목 양서류 중 두꺼비(Bufo gargarizans Cantor), 한국산개구리(Rana coreana)를 제외한 10종의 무미목 양서류의 번식기 울음소리를 관찰할 수 있었다. 주로 개체수 감소로 인하여 관찰이 어렵거나 비 출현 개체의 번식기와 시민과학 프로젝트 진행 시점과의 차이로 인해 번식기 울음소리를 수집하는데 어려움이 발생한 것으로 나타났다. 본 연구는 시민참여를 토대로 국내에 서식하는 무미목 양서류의 번식기 울음소리를 통해 분포현황과 생물종 출현 자료 수집을 처음으로 검토한 연구이다. 향후 시민과학을 접목한 생물음향 모니터링 설계와 시민과학 데이터 품질관리 방안에 대한 기초자료로 활용될 수 있을 것으로 판단된다.

Keywords

Acknowledgement

본 논문은 환경부 한국환경산업기술원의 생태계 기반 탄소흡수원 조성·관리 기술개발사업(RS-2023-00218245)의 지원을 받아 작성되었습니다.

References

  1. Ahrends, A., C. Rahbek, M.T. Bulling, N.D. Burgess, P.J. Platts, L.C. Lovett ... and R. Marchant(2011) Conservation and the botanist effect. Biological Conservation 144(1): 131-140. https://doi.org/10.1016/j.biocon.2010.08.008
  2. Andrachuk, M., M. Marschke, C. Hings and D. Armitage(2019) Smartphone technologies supporting community-based environmental monitoring and implementation: A systematic scoping review. Biological Conservation 237: 430-442. https://doi.org/10.1016/j.biocon.2019.07.026
  3. Aristeidou, M., C. Herodotou, H.L. Ballard, L. Higgins, R.F. Johnson, A.E. Miller ... and L.D. Robinson(2021) How do young community and citizen science volunteers support scientific research on biodiversity? The case of iNaturalist. Diversity 13(7): 318.
  4. Attenborough, D.(2020) A life on our planet: My witness statement and a vision for the future. Random House.
  5. Beebee, T.J. and R.A. Griffiths(2005) The amphibian decline crisis: A watershed for conservation biology?. Biological Conservation 125(3): 271-285. https://doi.org/10.1016/j.biocon.2005.04.009
  6. Bieluch, K.H., T. Willis, J. Smith and K.A. Wilson(2017) The complexities of counting fish: Engaging citizen scientists in fish monitoring. Maine policy review.
  7. Bird, T.J., A.E. Bates, J.S. Lefcheck, N.A. Hill, R.J. Thomson, G.J. Edgar ... and S. Frusher(2014) Statistical solutions for error and bias in global citizen science datasets. Biological Conservation 173: 144-154. https://doi.org/10.1016/j.biocon.2013.07.037
  8. Blair, W.F.(1964) Isolating mechanisms and interspecies interactions in anuran amphibians. The Quarterly Review of Biology 39(4): 334-344. https://doi.org/10.1086/404324
  9. Boakes, E.H., P.J. McGowan, R.A. Fuller, D. Chang-qing, N.E. Clark, K. O'Connor and G.M. Mace(2010) Distorted views of biodiversity: Spatial and temporal bias in species occurrence data. PLoS biology 8(6): e1000385.
  10. Bodilis, P., P. Louisy, M. Draman, H.O. Arceo and P. Francour (2014) Can citizen science survey non-indigenous fish species in the eastern Mediterranean Sea? Environmental Management 53: 172-180. https://doi.org/10.1007/s00267-013-0171-0
  11. Bohan, D.A., C. Vacher, A. Tamaddoni-Nezhad, A. Raybould, A.J. Dumbrell and G. Woodward(2017) Next-generation global biomonitoring: Large-scale, automated reconstruction of ecological networks. Trends in Ecology & Evolution 32(7): 477-487. https://doi.org/10.1016/j.tree.2017.03.001
  12. Bolitho, L., D. Newell and H. Hines(2023) Bioacoustic monitoring reveals the calling activity of an endangered mountaintop frog (Philoria kundagungan) in response to environmental conditions. Diversity 15(8): 931.
  13. Bonter, D.N. and C.B. Cooper(2012) Data validation in citizen science: A case study from Project Feeder Watch. Frontiers in Ecology and the Environment 10(6): 305-307. https://doi.org/10.1890/110273
  14. Borzee, A., C.N. Kyong, H.K. Kil and Y. Jang(2018) Impact of water quality on the occurrence of two endangered Korean anurans: Dryophytes suweonensis and Pelophylax chosenicus. Herpetologica 74(1): 1-7. https://doi.org/10.1655/Herpetologica-D-17-00011
  15. Boullhesen, M., M. Vaira, R.M. Barquez and M.S. Akmentins (2021) Evaluating the efficacy of visual encounter and automated acoustic survey methods in anuran assemblages of the Yungas Andean forests of Argentina. Ecological Indicators 127: 107750.
  16. Broadhurst, H., E.E. Smith, J.M. Jackman, N. Singleton, D. Tansley, R. Raynor ... and A.D. McDevitt(2023) Citizen scientists' motivation to participate in environmental DNA (eDNA) surveys: A case study on monitoring mammals in the UK.
  17. Buckley, J. and T.J. Beebee(2004, August) Monitoring the conservation status of an endangered amphibian: The natterjack toad Bufo calamita in Britain. In Animal Conservation forum (Vol. 7, No. 3, pp. 221-228). Cambridge University Press.
  18. Callaghan, C.T., J.J. Rowley, W.K. Cornwell, A.G. Poore and R.E. Major(2019) Improving big citizen science data: Moving beyond haphazard sampling. PLoS Biology 17(6): e3000357.
  19. Carignan, V. and M.A. Villard(2002) Selecting indicator species to monitor ecological integrity: A review. Environmental Monitoring and Assessment 78: 45-61. https://doi.org/10.1023/A:1016136723584
  20. Chaudhury, S., K.L. Sahrawat, K. Srinivasu, S.P. Wani And N. Puppala(2016) Advertisement calls of Amboli leaping frog Indirana chiravasi (Anura: Ranixalidae) from northern Western Ghats, India. Current Science 110(12): 2220.
  21. Cheng, J., Xie, B., Lin, C., and Ji, L. (2012) A comparative study in birds: Call-type-independent species and individual recognition using four machine-learning methods and two acoustic features. Bioacoustics 21(2): 157-171. https://doi.org/10.1080/09524622.2012.669664
  22. Coelho, I.P., F.Z. Teixeira, P. Colombo, A.V.P. Coelho and A. Kindel(2012) Anuran road-kills neighboring a peri-urban reserve in the Atlantic Forest, Brazil. Journal of Environmental Management 112: 17-26. https://doi.org/10.1016/j.jenvman.2012.07.004
  23. Collins, J.P. and A. Storfer(2003) Global amphibian declines: Sorting the hypotheses. Diversity and Distributions 9(2): 89-98. https://doi.org/10.1046/j.1472-4642.2003.00012.x
  24. Cosentino, B.J., D.M. Marsh, K.S. Jones, J.J. Apodaca, C. Bates, J. Beach ... and A. Willey(2014) Citizen science reveals widespread negative effects of roads on amphibian distributions. Biological Conservation 180: 31-38. https://doi.org/10.1016/j.biocon.2014.09.027
  25. Cushman, S.A.(2006) Effects of habitat loss and fragmentation on amphibians: A review and prospectus. Biological Conservation 128(2): 231-240. https://doi.org/10.1016/j.biocon.2005.09.031
  26. Darwall, W.R. and N.K. Dulvy(1996) An evaluation of the suitability of non-specialist volunteer researchers for coral reef fish surveys. Mafia Island, Tanzania-a case study. Biological Conservation 78(3): 223-231.
  27. Davies, L., R. Fradera, H. Riesch and P. Lakeman-Fraser(2016) Surveying the citizen science landscape: An exploration of the design, delivery and impact of citizen science through the lens of the Open Air Laboratories (OPAL) programme. BMC Ecology 16: 1-13. https://doi.org/10.1186/s12898-016-0066-z
  28. De Souza, E., J. Lima-Santos, O.M. Entiauspe-Neto, M.M. dos Santos, P.R. de Moura and E. Hingst-Zaher(2022) Ophiophagy in Brazilian birds: A contribution from a collaborative platform of citizen science. Ornithology Research 30(1): 15-24. https://doi.org/10.1007/s43388-022-00082-5
  29. Delis, P.R., H.R. Mushinsky and E.D. McCoy(1996) Decline of some west-central Florida anuran populations in response to habitat degradation. Biodiversity & Conservation 5: 1579-1595. https://doi.org/10.1007/BF00052117
  30. Dickinson, J.L., J. Shirk, D. Bonter, R. Bonney, R.L. Crain, J. Martin ... and K. Purcell(2012) The current state of citizen science as a tool for ecological research and public engagement. Frontiers in Ecology and the Environment 10(6): 291-297. https://doi.org/10.1890/110236
  31. Erard, C.(2010) Wells, KD-The ecology and behavior of amphibians. The University of Chicago Press, Chicago and London. 2008. Revue d'Ecologie (La Terre et La Vie) 65(1): 93-95.
  32. Farr, C. M., F. Ngo and B. Olsen(2023) Evaluating data quality and changes in species identification in a citizen science bird monitoring project. Citizen Science: Theory and Practice 8(1): 24.
  33. Fischer, H.A., L.R. Gerber and E.A. Wentz(2021) Evaluating the fitness for use of citizen science data for wildlife monitoring. Frontiers in Ecology and Evolution 9: 620850.
  34. Forrester, G., P. Baily, D. Conetta, L. Forrester, E. Kintzing and L. Jarecki(2015) Comparing monitoring data collected by volunteers and professionals shows that citizen scientists can detect long-term change on coral reefs. Journal for Nature Conservation 24: 1-9. https://doi.org/10.1016/j.jnc.2015.01.002
  35. Foster-Smith, J. and S.M. Evans(2003) The value of marine ecological data collected by volunteers. Biological Conservation 113(2): 199-213. https://doi.org/10.1016/S0006-3207(02)00373-7
  36. Gardiner, M.M., L.L. Allee, P.M. Brown, J.E. Losey, E.E. Roy and R.R. Smyth(2012) Lessons from lady beetles: Accuracy of monitoring data from US and UK citizen-science programs. Frontiers in Ecology and the Environment 10(9): 471-476. https://doi.org/10.1890/110185
  37. Geldmann, J., J. Heilmann-Clausen, T.E. Holm, I. Levinsky, B.O. Markussen, K. Olsen ... and A.P. Tottrup(2016) What determines spatial bias in citizen science? Exploring four recording schemes with different proficiency requirements. Diversity and Distributions 22(11): 1139-1149. https://doi.org/10.1111/ddi.12477
  38. Green, D.M.(2003) The ecology of extinction: Population fluctuation and decline in amphibians. Biological Conservation 111(3): 331-343. https://doi.org/10.1016/S0006-3207(02)00302-6
  39. Guzy, J.C., S.J. Price and M.E. Dorcas(2014) Using multiple methods to assess detection probabilities of riparian-zone anurans: Implications for monitoring. Wildlife Research 41(3): 243-257. https://doi.org/10.1071/WR14038
  40. Haklay, M., S. Mazumdar and J. Wardlaw(2018) Citizen science for observing and understanding the earth. Earth Observation Open Science and Innovation, 69-88.
  41. Hamer, A.J. and M.J. McDonnell(2008) Amphibian ecology and conservation in the urbanising world: A review. Biological Conservation 141(10): 2432-2449. https://doi.org/10.1016/j.biocon.2008.07.020
  42. Heigl, F., K. Horvath, G. Laaha and J.G. Zaller(2017) Amphibian and reptile road-kills on tertiary roads in relation to landscape structure: Using a citizen science approach with open-access land cover data. BMC Ecology 17: 1-11. https://doi.org/10.1186/s12898-016-0111-y
  43. Heyer, R., M.A. Donnelly, M. Foster and R. McDiarmid(2014) Measuring and monitoring biological diversity: Standard methods for amphibians. Smithsonian Institution Press, Washington.
  44. Hirai, T. and M. Matsui(1999) Feeding habits of the pond frog, Rana nigromaculata, inhabiting rice fields in Kyoto, Japan. Copeia 1999(4): 940-947. https://doi.org/10.2307/1447969
  45. Hirai, T. and M. Matsui(2002) Feeding relationships between Hyla japonica and Rana nigromaculata in rice fields of Japan. Journal of Herpetology 36(4): 662-667. https://doi.org/10.1670/0022-1511(2002)036[0662:FRBHJA]2.0.CO;2
  46. Hong, S.G., C.K. An, H.J. Kim, K.C. Oh, S.Y. Park, S. Na and H. Yi(2017) Ecological study of narrow-mouthed Toad (Kaloula borealis) population at Myeongji district in Busan Metropolitan City. Journal of Wetlands Research 19(1): 172-179. https://doi.org/10.17663/JWR.2017.19.1.172
  47. Hsing, P.Y., R.A. Hill, G.C. Smith, S. Bradley, S.E. Green, V.T. Kent ... and P.A. Stephens(2022) Large-scale mammal monitoring: The potential of a citizen science camera-trapping project in the United Kingdom. Ecological Solutions and Evidence 3(4): e12180.
  48. Huang, C.J., Y.J. Chen, H.M. Chen, J.J. Jian, S.C. Tseng, Y.J. Yang and P.A. Hsu(2014) Intelligent feature extraction and classification of anuran vocalizations. Applied Soft Computing 19: 1-7. https://doi.org/10.1016/j.asoc.2014.01.030
  49. Hutto Jr, D. and K. Barrett(2021) Do urban open spaces provide refugia for frogs in urban environments? PLoS One 16(1): e0244932.
  50. Hutto, D. and K. Barrett(2022) Do open spaces within an urban matrix increase anuran abundance? Herpetological Conservation and Biology 17(3): 582-592.
  51. IUCN(2021) The IUCN Red List of Threatened Species. Summary statistics, threatened species in past and present Red Lists. IUCN, Gland, Switzerland. [Accessed June 2021].
  52. Jang, H.J. and J.H. Suh(2010) Distribution of amphibian species in South Korea. Korean Journal of Herpetology 2: 45-51.
  53. Johnson, M.F., C. Hannah, L. Acton, R. Popovici, K.K. Karanth and E. Weinthal(2014) Network environmentalism: Citizen scientists as agents for environmental advocacy. Global Environmental Change 29: 235-245. https://doi.org/10.1016/j.gloenvcha.2014.10.006
  54. Johnston, A., E. Matechou and E.B. Dennis(2023) Outstanding challenges and future directions for biodiversity monitoring using citizen science data. Methods in Ecology and Evolution 14(1): 103-116. https://doi.org/10.1111/2041-210X.13834
  55. Jordan, R.C., H.L. Ballard and T.B. Phillips(2012) Key issues and new approaches for evaluating citizen-science learning outcomes. Frontiers in Ecology and the Environment 10(6): 307-309. https://doi.org/10.1890/110280
  56. Kache, P.A., G.M. Bron, S. Zapata-Ramirez, J.I. Tsao, L.C. Bartholomay, S.M. Paskewitz ... and M. del Pilar Fernandez (2023) Evaluating spatial and temporal patterns of tick exposure in the United States using community science data submitted through a smartphone application. Ticks and Tick-borne Diseases 14(4): 102163.
  57. Katayama, N., T. Amano, G. Fujita and H. Higuchi(2012) Spatial overlap between the intermediate egret Egretta intermedia and its aquatic prey at two spatiotemporal scales in a rice paddy landscape. Zoological Studies 51(7): 1105-1112.
  58. Katayama, N., T. Goto, F. Narushima, T. Amano, H. Kobori and T. Miyashita(2013) Indirect positive effects of agricultural modernization on the abundance of Japanese tree frog tadpoles in rice fields through the release from predators. Aquatic Ecology 47: 225-234. https://doi.org/10.1007/s10452-013-9437-0
  59. Kim, I.H., C.H. Ham, S.W. Jang, E.Y. Kim and J.B. Kim(2012) Determination of breeding season, and daily pattern of calling behavior of the endangered suweon-tree frog (Hyla suweonensis). Korean Journal of Herpetology 4: 23-29.
  60. Kim, J.C. and G.J. Lee(2010) A study on habitat improvement for narrow-mouth frog (Kaloula borealis) in-situ conservation. In Proceedings of the Korean Society of Environment and Ecology Conference (pp. 150-154). Korean Society of Environment and Ecology.
  61. Kim, K.S., Y. Song, C.D. Park, D.W. Kang and J.D. Yoon(2020) Characterizing development of endangered gold-spotted pond frog (Pelophylax chosenicus) focused on egg development and growth and survival rates of tadpoles with different feed. Korean Journal of Ecology and Environment 53(3): 221-228. https://doi.org/10.11614/KSL.2020.53.3.221
  62. Kim, S.K., H.C. Sung, D.S. Park and S.R. Park(2006) Changes in environmental attitudes of middle and high school students after anuran call monitoring. Korean Journal of Environmental Education 19(1): 104-115.
  63. Knutson, M.G., J.R. Sauer, D.A. Olsen, M.J. Mossman, L.M. Hemesath and M.J. Lannoo(1999) Effects of landscape composition and wetland fragmentation on frog and toad abundance and species richness in Iowa and Wisconsin, USA. Conservation Biology 13(6): 1437-1446. https://doi.org/10.1046/j.1523-1739.1999.98445.x
  64. Kohler, J., M. Jansen, A. Rodriguez, P.J.R. Kok, L.F. Toledo, M. Emmrich, F. Glaw, C.F.B. Haddad, M.O. Rodel and M. Vences(2017) The use of bioacoustics in anuran taxonomy: Theory, terminology, methods and recommendations for best practice. Zootaxa 4251: 1-124. 10.11646/zootaxa.4251.1.1.
  65. Kress, W.J., C. Garcia-Robledo, J.V. Soares, D. Jacobs, K. Wilson, I.C. Lopez and P.N. Belhumeur(2018) Citizen science and climate change: Mapping the range expansions of native and exotic plants with the mobile app Leafsnap. BioScience 68(5): 348-358. https://doi.org/10.1093/biosci/biy019
  66. Lee, H.L., C.W. Lee, H.S. Yang, T.S. Kim and B.G. Yang(2013) Post-breeding dispersal and movement patterns of Asian toad (Bufo gargarizans). The Korean Research Society of Herpetologists 5(1): 1-8.
  67. Lee, W.C., J.W. Yoo and P.H. Rho(2023) Comparative study of citizen science and expert based survey data using the species distribution model of Rana uenoi. Journal of Environmental Science International 32(6): 429-440.
  68. Littlejohn, M.J.(1969) The systematic significance of isolating mechanisms. In: National Research Council (Ed.) Systematic Biology: Proceedings of an International Conference. National Academies Press, Washington, DC, 459-482. 10.17226/21293
  69. Lopes, M.T., L.L. Gioppo, T.T. Higushi, C.A. Kaestner, C.N. Silla Jr and A.L. Koerich(2011, December) Automatic bird species identification for large number of species. In 2011 IEEE International Symposium on Multimedia (pp. 117-122). IEEE.
  70. Lotz, A.,and C.R. Allen(2007) Observer bias in anuran call surveys. The Journal of Wildlife Management 71(2): 675-679. https://doi.org/10.2193/2005-759
  71. Marceno, C., J. Padulles Cubino, M. Chytry, E. Genduso, D. Salemi, A. La Rosa ... and R. Guarino(2021) Facebook groups as citizen science tools for plant species monitoring. Journal of Applied Ecology 58(10): 2018-2028. https://doi.org/10.1111/1365-2664.13896
  72. McKinley, D.C., A.J. Miller-Rushing, H.L. Ballard, R. Bonney, H. Brown, S.C. Cook-Patton ... and M.A. Soukup(2017) Citizen science can improve conservation science, natural resource management, and environmental protection. Biological Conservation 208: 15-28. https://doi.org/10.1016/j.biocon.2016.05.015
  73. McKinley, D.C., A.J. Miller-Rushing, H.L. Ballard, R. Bonney, H. Brown, D.M. Evans ... and M.A. Soukup(2015) Investing in citizen science can improve natural resource management and environmental protection. Issues in Ecology 2015(19): 1-27.
  74. Moilanen, A. and M. Nieminen(2002) Simple connectivity measures in spatial ecology. Ecology 83(4): 1131-1145. https://doi.org/10.1890/0012-9658(2002)083[1131:SCMISE]2.0.CO;2
  75. Naito, R., M. Sakai and Y. Morimoto(2012) Negative effects of deep roadside ditches on Pelophylax porosa brevipoda dispersal and migration in comparison with Hyla japonica in a rice paddy area in Japan. Zoological Science 29(9): 599-603. https://doi.org/10.2108/zsj.29.599
  76. Newman, G., A. Wiggins, A. Crall, E. Graham, S. Newman and K. Crowston(2012) The future of citizen science: Emerging technologies and shifting paradigms. Frontiers in Ecology and the Environment 10(6): 298-304. https://doi.org/10.1890/110294
  77. Oesterheld, M., V. Schmid-Loertzer, M. Calvera-Isabal, I. Amarasinghe, P. Santosb and Y.N. Golumbicc(2022). Identifying learning dimensions in citizen science projects.
  78. Park, M.K. and S.H. Bae(2022) Accuracy verification for unmanned aerial vehicle system for mapping of amphibians mating call. Journal of the Korean Society of Environmental Restoration Technology 25(2): 85-92. https://doi.org/10.13087/KOSERT.2022.25.2.85
  79. Park, S.C., B.H. Han and M.J. Park(2019). A study on the evaluation and maintenance for alternative habitats of the narrow-mouth frog (Kaloula borealis): A case study on the alternative habitats of Kaloula borealis at the University of Seoul. Journal of the Korean Institute of Landscape Architecture 47(1): 76-87. https://doi.org/10.9715/KILA.2019.47.1.076
  80. Park, S.H. and K.H. Cho (2017) Comparison of health status of Japanese tree frog (Hyla Japonica) in a rural and an urban area. Ecology and Resilient Infrastructure 4(1): 71-74. https://doi.org/10.17820/ERI.2017.4.1.071
  81. Parsons, A.W., C. Goforth, R. Costello and R. Kays(2018) The value of citizen science for ecological monitoring of mammals. PeerJ 6: e4536.
  82. Pettorelli, N., W.F. Laurance, T.G. O'Brien, M. Wegmann, H. Nagendra and W. Turner(2014) Satellite remote sensing for applied ecologists: Opportunities and challenges. Journal of Applied Ecology 51(4): 839-848. https://doi.org/10.1111/1365-2664.12261
  83. Pocock, M.J., H.E. Roy, C.D. Preston and D.B. Roy(2015) The biological records centre: A pioneer of citizen science. Biological Journal of the Linnean Society 115(3): 475-493. https://doi.org/10.1111/bij.12548
  84. Pocock, M.J., M. Chandler, R. Bonney, I. Thornhill, A. Albin, T. August ... and F. Danielsen(2018) A vision for global biodiversity monitoring with citizen science. In Advances in Ecological Research (Vol. 59, pp. 169-223). Academic Press.
  85. Ray, N., A. Lehmann and P. Joly(2002) Modeling spatial distribution of amphibian populations: A GIS approach based on habitat matrix permeability. Biodiversity and Conservation 11: 2143-2165. https://doi.org/10.1023/A:1021390527698
  86. Riesch, H. and C. Potter(2014) Citizen science as seen by scientists: Methodological, epistemological and ethical dimensions. Public Understanding of Science 23(1): 107-120. https://doi.org/10.1177/0963662513497324
  87. Robinson, W.D., T.A. Hallman and R. A. Hutchinson(2021) Benchmark bird surveys help quantify counting accuracy in a citizen-science database. Frontiers in Ecology and Evolution 9: 568278.
  88. Rovero, F., M. Menegon, J. FjeldsAa, L. Collett, N. Doggart, C. Leonard ... and N.D. Burgess(2014) Targeted vertebrate surveys enhance the faunal importance and improve explanatory models within the Eastern Arc Mountains of Kenya and Tanzania. Diversity and Distributions 20(12): 1438-1449. https://doi.org/10.1111/ddi.12246
  89. Rowley, J.J. and C.T. Callaghan(2020) The FrogID dataset: expert- validated occurrence records of Australia's frogs collected by citizen scientists. ZooKeys 912: 139.
  90. Rowley, J.J., C.T. Callaghan, T. Cutajar, C. Portway, K. Potter, S. Mahony ... and A. Woods(2019) FrogID: Citizen scientists provide validated biodiversity data on frogs of Australia. Herpetological Conservation and Biology 14(1): 155-170.
  91. Rowley, J.J.L., D.T. TranT, T.T.D. Le, V.Q. Dau, P.L. Peloso, T.Q. Nguyen, H.D. HoangD, T.T. Nguyen and T. Ziegler(2016) Five new, microendemic Asian leaf-litter frogs (Leptolalax) from the southern Annamite mountains, Vietnam. Zootaxa 4085: 63-102. 10.11646/zootaxa.4085.1.3.
  92. Sewell, D. and R.A. Griffiths(2009) Can a single amphibian species be a good biodiversity indicator? Diversity 1(2): 102-117. https://doi.org/10.3390/d1020102
  93. Silvertown, J.(2009) A new dawn for citizen science. Trends in Ecology & Evolution 24(9): 467-471. https://doi.org/10.1016/j.tree.2009.03.017
  94. Socientize Consortium(2013) Green paper on citizen science. Citizen Science for Europe. Towards a better society of empowered citizens and enhanced research. Brussels.
  95. Song, J.Y., M.H. Chang and K.S. Koo(2020) Sound monitoring effectiveness of the black-spotted pond frog, Pelophylax nigromaculatus in the Baenanggimi Wetland. The Korean Research Society of Herpetologists 11(1): 15-20.
  96. Song, U., E. Yang, M.W. Kim, B. Kim, S. Kwak, S. Oh ... and H. Rime(2022) Predicting the effects of climate change on tadpole stage fitness in the Korean brown frog Rana uenoi Matsui, 2014 (Amphibia: Ranidae). Asian Journal of Conservation Biology 11(1).
  97. Sterrett, S.C., R.A. Katz, W.R. Fields and E.H. Campbell Grant(2019) The contribution of road-based citizen science to the conservation of pond-breeding amphibians. Journal of Applied Ecology 56(4): 988-995. https://doi.org/10.1111/1365-2664.13330
  98. Stuart, S.N., J.S. Chanson, N.A. Cox, B.E. Young, A.S. Rodrigues, D.L. Fischman and R.W. Waller(2004) Status and trends of amphibian declines and extinctions worldwide. Science 306(5702): 1783-1786. https://doi.org/10.1126/science.1103538
  99. Sullivan, B.L., J.L. Aycrigg, J.H. Barry, R.E. Bonney, N. Bruns, C.B. Cooper ... and S. Kelling(2014) The eBird enterprise: An integrated approach to development and application of citizen science. Biological Conservation 169: 31-40. https://doi.org/10.1016/j.biocon.2013.11.003
  100. Sung, H.C., N.Y. Ra, S.W. Cheong, S.K. Kim, S.M. Cha and D.S. Park(2009) Reproductive dynamics of the Gold-spotted pond frog (Rana plancyi chosenica) population located at Cheongwon, Korea. Korean Journal of Environmental Biology 27(1): 20-30.
  101. Theobald, E.J., A.K. Ettinger, H.K. Burgess, L.B. DeBey, N.R. Schmidt, H.E. Froehlich ... and J.K. Parrish(2015) Global change and local solutions: Tapping the unrealized potential of citizen science for biodiversity research. Biological Conservation 181: 236-244. https://doi.org/10.1016/j.biocon.2014.10.021
  102. Tiralongo, F., F. Crocetta, E. Riginella, A.O. Lillo, E. Tondo, A. Macali ... and E. Azzurro(2020) Snapshot of rare, exotic and overlooked fish species in the Italian seas: A citizen science survey. Journal of Sea Research 164: 101930.
  103. Toomey, A.H. and M.C. Domroese, M. C. (2013) Can citizen science lead to positive conservation attitudes and behaviors? Human Ecology Review 20(1): 50-62. https://doi.org/10.17816/humeco17333
  104. Tulloch, A.I., H.P. Possingham, L.N. Joseph, J. Szabo and T.G. Martin(2013) Realising the full potential of citizen science monitoring programs. Biological Conservation 165: 128-138. https://doi.org/10.1016/j.biocon.2013.05.025
  105. Van Strien, A.J., C.A. Van Swaay and T. Termaat(2013) Opportunistic citizen science data of animal species produce reliable estimates of distribution trends if analysed with occupancy models. Journal of Applied Ecology 50(6): 1450-1458. https://doi.org/10.1111/1365-2664.12158
  106. Wangyal, J.T., D.S. Bower, S.T. Sherub, D.O.R.J.I. Wangdi, K.A.D.O. Rinchen, S. Phuntsho ... and I. Das(2020) New herpetofaunal records from the Kingdom of Bhutan obtained through citizen science. Herpetological Review 51(4): 790-798.
  107. Wier, L.A. and M.J. Mossman(2005) North American Amphibian Monitoring Program (NAAMP). United States Department of the Interior. United States Geological Survey.
  108. Wiggins, A., G. Newman, R.D. Stevenson and K. Crowston(2011, December) Mechanisms for data quality and validation in citizen science. In 2011 IEEE seventh international conference on e-Science Workshops (pp. 14-19). IEEE.
  109. Wilson, L.D. and J.R. McCranie(2003) Herpetofaunal indicator species as measures of environmental stability in Honduras. Caribbean Journal of Science 39(1): 50-67.
  110. Wyman, R.L.(1990) What's happening to the amphibians? Conservation Biology 4(4): 350-352. https://doi.org/10.1111/j.1523-1739.1990.tb00307.x
  111. Xie, J., M. Towsey, J. Zhang and P. Roe(2016) Acoustic classification of Australian frogs based on enhanced features and machine learning algorithms. Applied Acoustics 113: 193-201. https://doi.org/10.1016/j.apacoust.2016.06.029
  112. Yang, D.S. and B.H. Koo(2016). A study on the improvement plan for a habitat of 'Gold-spotted pond frog (Pelophylax chosenicus)' in danger of regional extinction in the urban area-case on the abandoned railroad site on Su-in Line. Journal of the Korean Society of Environmental Restoration Technology 19(2): 95-107. https://doi.org/10.13087/kosert.2016.19.2.95
  113. Yang, S.Y., B.S. Park and H.J. Son(1981) Species comparison of the genus Hyla in Korea. Bull Inst Basic Sci Inha Univ. 2: 75-83.
  114. Yang, S.Y., M.S. Min, J.B. Kim and J.H. Suh(1997) Intra and inter specific diversity and speciation of two tree frogs in the genus Hyla. Korean Journal of Genetics 19(1): 71-87.