• Journal of the Korea Society of Computer and Information
• /
• v.29 no.11
• /
• pp.49-56
• /
• 2024

In recent years, visualizing time-series data as images for use in vision-based Artificial Intelligence (AI) models has gained significant attention. This approach transforms temporal sequences into images that can be processed by deep learning models, such as Convolutional Neural Network (CNN). Although its effectiveness has been demonstrated in various domains, the impact of plot size on model performance remains underexplored. In this study, we investigate the effect of varying plot sizes on classification accuracy by visualizing natural sounds (e.g., cats, crows) and testing five classes of 2,000 samples each using the YOLO model. While training was conducted on 320x320 plots, test sets were generated at six sizes (112x112 to 640x640). Results show that as the plot size of the test dataset diverged from that of the training dataset, both precision and recall decreased, highlighting the importance of plot size consistency in time-series visualization research.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.27 no.2
• /
• pp.119-125
• /
• 2017

The mud flat in Korea is the geographical feature generated from the sediment of rivers of Korea and China and it is the important topography for pollution purification and fishing industry. The mud flat is difficult to access such that it requires the aerial survey for the high-resolution spatial information of the area. In this study we used drones instead of the conventional aerial and remote sensing approaches which have shortcomings of costs and revisit times. We carried out GPS-based control point survey, temporal image acquisition using drones, bundle adjustment, stereo image processing for DSM and ortho photo generation, followed by co-registration between the spatio-temporal information.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.8
• /
• pp.1248-1254
• /
• 2022

Efforts are being made to prevent traffic accidents in the school zone in advance. However, traffic accidents in school zones continue to occur. If the driver can know the situation information in the child protection area in advance, accidents can be reduced. In this paper, we design a camera that eliminates blind spots in school zones and a number recognition camera system that can collect pre-traffic information. It is designed by improving the LIDAR system that recognizes vehicle speed and pedestrians. It collects and processes pedestrian and vehicle image information recognized by cameras and LIDAR, and applies artificial intelligence time series analysis and artificial intelligence algorithms. The artificial intelligence traffic accident prevention system learned by deep learning proposed in this paper provides a forced push service that delivers school zone information to the driver to the mobile device in the vehicle before entering the school zone. In addition, school zone traffic information is provided as an alarm on the LED signboard.

• Korean Journal of Remote Sensing
• /
• v.38 no.6_3
• /
• pp.1749-1760
• /
• 2022

In modern society, human and social damages caused by natural disasters and frequent disaster accidents have been increased year by year. Prompt access to dangerous disaster sites that are inaccessible or inaccessible using state-of-the-art Earth observation equipment such as satellites, drones, and survey robots, and timely collection and analysis of meaningful disaster information. It can play an important role in protecting people's property and life throughout the entire disaster management cycle, such as responding to disaster sites and establishing mid-to long-term recovery plans. This special issue introduces the National Disaster Management Research Institute (NDMI)'s disaster management technology that utilizes various Earth observation platforms, such as mobile survey vehicles equipped with close-range disaster site survey sensors, drones, and survey robots, as well as satellite technology, which is a tool of remote earth observation. Major research achievements include detection of damage from water disasters using Google Earth Engine, mid- and long-term time series observation, detection of reservoir water bodies using Sentinel-1 Synthetic Aperture Radar (SAR) images and artificial intelligence, analysis of resident movement patterns in case of forest fire disasters, and data analysis of disaster safety research. Efficient integrated management and utilization plan research results are summarized. In addition, research results on scientific investigation activities on the causes of disasters using drones and survey robots during the investigation of inaccessible and dangerous disaster sites were described.

• Korean Journal of Remote Sensing
• /
• v.39 no.5_3
• /
• pp.1031-1042
• /
• 2023

In this study, a deep learning model was developed to predict the yield of cabbage and radish, one of the five major supply and demand management vegetables, using satellite images of Landsat 8. To predict the yield of cabbage and radish in Gangwon-do from 2015 to 2020, satellite images from June to September, the growing period of cabbage and radish, were used. Normalized difference vegetation index, enhanced vegetation index, lead area index, and land surface temperature were employed in this study as input data for the yield model. Crop yields can be effectively predicted using satellite images because satellites collect continuous spatiotemporal data on the global environment. Based on the model developed previous study, a model designed for input data was proposed in this study. Using time series satellite images, convolutional neural network, a deep learning model, was used to predict crop yield. Landsat 8 provides images every 16 days, but it is difficult to acquire images especially in summer due to the influence of weather such as clouds. As a result, yield prediction was conducted by splitting June to July into one part and August to September into two. Yield prediction was performed using a machine learning approach and reference models , and modeling performance was compared. The model's performance and early predictability were assessed using year-by-year cross-validation and early prediction. The findings of this study could be applied as basic studies to predict the yield of field crops in Korea.

• Smart Media Journal
• /
• v.8 no.3
• /
• pp.95-103
• /
• 2019

The global manufacturing industry has reached the limit to growth due to a long-term recession, the rise of labor cost and raw material. As a solution to these difficulties, we promote the 4th Industry Revolution based on ICT and sensor technology. Following this trend, this paper proposes the design of a model using manufacturing data in the protection film process for smart manufacturing innovation. In the protective film process, the manufacturing data of temperature, pressure, humidity, and motion and thermal image are acquired by various sensors for the raw material blending, stirring, extrusion, and inspection processes. While the acquired manufacturing data is stored in mass storage, A.I. platform provides time-series image analysis and its visualization.

• Journal of Korea Society of Industrial Information Systems
• /
• v.28 no.5
• /
• pp.1-14
• /
• 2023

Soybeans are one of the world's top five staple crops and a major source of plant-based protein. Due to their susceptibility to climate change, which can significantly impact grain production, the National Agricultural Science Institute is conducting research on crop phenotypes through growth analysis of various soybean varieties. While the process of capturing growth progression photos of soybeans is automated, the verification, recording, and analysis of growth stages are currently done manually. In this paper, we designed and trained a YOLOv5s model to detect soybean leaf objects from image data of soybean plants and a Convolution Neural Network (CNN) model to judgement the unfolding status of the detected soybean leaves. We combined these two models and implemented an algorithm that distinguishes layers based on the coordinates of detected soybean leaves. As a result, we developed a program that takes time-series data of soybeans as input and performs growth analysis. The program can accurately determine the growth stages of soybeans up to the second or third compound leaves.

• Korean Journal of Remote Sensing
• /
• v.39 no.5_3
• /
• pp.1009-1029
• /
• 2023

Urban trees play a vital role in urban ecosystems,significantly reducing impervious surfaces and impacting carbon cycling within the city. Although previous research has demonstrated the efficacy of employing artificial intelligence in conjunction with airborne light detection and ranging (LiDAR) data to generate urban tree information, the availability and cost constraints associated with LiDAR data pose limitations. Consequently, this study employed freely accessible, high-resolution multispectral satellite imagery (i.e., Sentinel-2 data) to estimate fractional tree canopy cover (FTC) within the urban confines of Suwon, South Korea, employing machine learning techniques. This study leveraged a median composite image derived from a time series of Sentinel-2 images. In order to account for the diverse land cover found in urban areas, the model incorporated three types of input variables: average (mean) and standard deviation (std) values within a 30-meter grid from 10 m resolution of optical indices from Sentinel-2, and fractional coverage for distinct land cover classes within 30 m grids from the existing level 3 land cover map. Four schemes with different combinations of input variables were compared. Notably, when all three factors (i.e., mean, std, and fractional cover) were used to consider the variation of landcover in urban areas(Scheme 4, S4), the machine learning model exhibited improved performance compared to using only the mean of optical indices (Scheme 1). Of the various models proposed, the random forest (RF) model with S4 demonstrated the most remarkable performance, achieving R² of 0.8196, and mean absolute error (MAE) of 0.0749, and a root mean squared error (RMSE) of 0.1022. The std variable exhibited the highest impact on model outputs within the heterogeneous land covers based on the variable importance analysis. This trained RF model with S4 was then applied to the entire Suwon region, consistently delivering robust results with an R² of 0.8702, MAE of 0.0873, and RMSE of 0.1335. The FTC estimation method developed in this study is expected to offer advantages for application in various regions, providing fundamental data for a better understanding of carbon dynamics in urban ecosystems in the future.

• Korean Journal of Remote Sensing
• /
• v.39 no.6_1
• /
• pp.1255-1272
• /
• 2023

Satellite-based chlorophyll-a concentration, produced as a long-term time series, is crucial for global climate change research. The production of data without gaps through the merging of time-synthesized or multi-satellite data is essential. However, studies related to satellite-based chlorophyll-a concentration in the waters around the Korean Peninsula have mainly focused on evaluating seasonal characteristics or proposing algorithms suitable for research areas using a single ocean color sensor. In this study, a merging dataset of remote sensing reflectance from the geostationary sensor GOCI-II and polar-orbiting sensors (MODIS, VIIRS, OLCI) was utilized to achieve high spatial coverage of chlorophyll-a concentration in the waters around the Korean Peninsula. The spatial coverage in the results of this study increased by approximately 30% compared to polar-orbiting sensor data, effectively compensating for gaps caused by clouds. Additionally, we aimed to quantitatively assess accuracy through comparison with global chlorophyll-a composite data provided by Ocean Colour Climate Change Initiative (OC-CCI) and GlobColour, along with in-situ observation data. However, due to the limited number of in-situ observation data, we could not provide statistically significant results. Nevertheless, we observed a tendency for underestimation compared to global data. Furthermore, for the evaluation of practical applications in response to marine disasters such as red tides, we qualitatively compared our results with a case of a red tide in the East Sea in 2013. The results showed similarities to OC-CCI rather than standalone geostationary sensor results. Through this study, we plan to use the generated data for future research in artificial intelligence models for prediction and anomaly utilization. It is anticipated that the results will be beneficial for monitoring chlorophyll-a events in the coastal waters around Korea.