• Korean Journal of Agricultural Science
• /
• v.49 no.4
• /
• pp.785-793
• /
• 2022

In this study, tomato maturity was estimated based on deep learning for a harvesting robot. Tomato images were obtained using a RGB camera installed on a monitoring robot, which was developed previously, and the samples were cropped to 128 × 128 size images to generate a dataset for training the classification model. The classification model was constructed based on convolutional neural networks, and the mean-variance loss was used to learn implicitly the distribution of the data features by class. In the test stage, the tomato maturity was estimated as a continuous index, which has a range of 0 to 1, by calculating the expected class value. The results show that the F1-score of the classification was approximately 0.94, and the performance was similar to that of a deep learning-based classification task in the agriculture field. In addition, it was possible to estimate the distribution in each maturity stage. From the results, it was found that our approach can not only classify the discrete maturation stages of the tomatoes but also can estimate the continuous maturity.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2021.11a
• /
• pp.711-714
• /
• 2021

고정 카메라 환경에서 전경과 배경 간 픽셀값의 차를 이용하여 전경을 추출하기 위해서는 정확한 배경 영상이 필요하다. 또한, 프레임마다 변화하는 실제 배경과 맞추기 위해 배경 영상을 지속해서 갱신할 필요가 있다. 본 논문에서는 정확한 배경 영상을 생성하기 위해 실시간 처리가 가능한 딥러닝 기반 객체 탐지기의 결과를 입력받아 영상 처리에 활용함으로써 배경을 생성 및 지속적으로 갱신하고, 획득한 배경 정보를 이용해 전경을 추출하는 방법을 제안한다. 먼저, 고정 카메라에서 획득되는 비디오 데이터에 딥러닝 기반 객체 탐지기를 적용한 박스 단위 객체 탐지 결과를 지속적으로 입력받아 픽셀 단위의 배경 영상을 갱신하고 개선된 배경 영상을 도출한다. 이후, 획득한 배경 영상을 이용하여 더 정확한 전경 영상을 획득한다. 또한, 본 논문에서는 시설물에 가려진 객체를 더 정확히 탐지하기 위해서 전경 영상을 이용하여 시설물 영상을 추출하는 방법을 제안한다. 실제 돈사에 설치된 카메라로 부터 획득된 12시간 분량의 비디오를 이용하여 실험한 결과, 제안 방법을 이용한 전경과 시설물 추출이 효과적임을 확인하였다.

• International conference on construction engineering and project management
• /
• 2020.12a
• /
• pp.443-452
• /
• 2020

Worker's awkward postures and unreasonable physical load can be corrected by monitoring construction activities, thereby increasing the safety and productivity of construction workers and projects. However, manual identification is time-consuming and contains high human variance. In this regard, an automated activity recognition system based on inertial measurement unit can help in rapidly and precisely collecting motion data. With the acceleration data, the machine learning algorithm will be used to train classifiers for automatically categorizing activities. However, input acceleration data are extracted either from designed experiments or simple construction work in previous studies. Thus, collected data series are discontinuous and activity categories are insufficient for real construction circumstances. This study aims to collect acceleration data during long-term continuous work in a construction project and validate the feasibility of activity recognition algorithm with the continuous motion data. The data collection covers two different workers performing formwork at the same site. An accelerator, as well as portable camera, is attached to the worker during the entire working session for simultaneously recording motion data and working activity. The supervised machine learning-based models are trained to classify activity in hierarchical levels, which reaches a 96.9% testing accuracy of recognizing rest and work and 85.6% testing accuracy of identifying stationary, traveling, and rebar installation actions.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2023.05a
• /
• pp.615-617
• /
• 2023

In recent years, the growing popularity of dogs due to the benefits they bring their owners has contributed to the increase of the number of dogs raised. For owners, it is their responsibility to ensure their dogs' health and safety. However, it is challenging for them to continuously monitor their dogs' activities, which are important to understand and guarantee their wellbeing. In this work, we introduce a camera-based monitoring system to help owners automatically monitor their dogs' activities. The system receives sequences of RGB images and uses YOLOv7 to detect the dog presence, and then applies post-processing to perform dog-centered image cropping on each input sequence. The optical flow is extracted from each sequence, and both sequences of RGB and flow are input to a two-stream EfficientNet to extract their respective features. Finally, the features are concatenated, and a bi-directional LSTM is utilized to retrieve temporal features and recognize the activity. The experiments prove that our system achieves a good performance with the F-1 score exceeding 0.90 for all activities and reaching 0.963 on average.

• International journal of advanced smart convergence
• /
• v.12 no.4
• /
• pp.458-463
• /
• 2023

This study presents a paper on the implementation of a Raspberry Pi-based educational smart farm system. It confirms that in a real smart farm environment, the control of temperature, humidity, soil moisture, and light intensity can be smoothly managed. It also includes remote monitoring and control of sensor information through a web service. Additionally, information about intruders collected by the Pi camera is transmitted to the administrator. Although the cost of existing smart farms varies depending on the location, material, and type of installation, it costs 400 million won for polytunnel and 1.5 billion won for glass greenhouses when constructing 0.5ha (1,500 pyeong) on average. Nevertheless, among the problems of smart farms, there are lax locks, malfunctions to automation, and errors in smart farm sensors (power problems, etc.). We believe that this study can protect crops at low cost if it is complementarily used to improve the security and reliability of expensive smart farms. The cost of using this study is about 100,000 won, so it can be used inexpensively even when applied to the area. In addition, in the case of plant cultivators, cultivators with remote control functions are sold for more than 1 million won, so they can be used as low-cost plant cultivators.

• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.2
• /
• pp.50-58
• /
• 2024

Body temperature plays an important role in medicine, some diseases are characterized by changes in human body temperature. Monitoring body temperature also allows doctors to monitor the effectiveness of medical treatments. Accurate body temperature measurement is key to detecting fevers, especially fevers related to infection with the SARS-CoV-2 virus that caused the recent Covid-19 pandemic in the world. The solution of measuring body temperature using a thermal camera is fast but has a high cost and is not suitable for some organizations with difficult economic conditions today. Use a medical thermometer to measure body temperature directly for a slow rate, making it easier to spread disease from person to person. In this paper, we propose a completely automatic body temperature measurement system that can adjust the height according to the person taking the measurement, has a measurement logging system and is monitored via the internet. Experimental results show that the proposed method has successfully created a fully automatic human body measurement system. Furthermore, this research also helps the school's scientists and students gain more knowledge and experience to apply Internet of Things technology in real life.

• Journal of the Korean Society of Marine Environment & Safety
• /
• v.17 no.4
• /
• pp.307-314
• /
• 2011

This study proposed detection method of Marine debris using unmanned aerial photography. For unmanned aerial photography, a RC(Radio Control) helicopter which has good movability and economics was used. To a camera mounting, a gimbal equipment was attached to the bottom of the RC helicopter. The gimbal equipment is very useful because it is not seriously affected by vibration and rolling. In addition, we invented that digital image processing algorithm using Matlab program for detection of marine debris from photographs. Particularly, background subtraction in invented algorithm was applied. As a result, marine debris of a variety of forms from different sand states of coast were reliably detected. In the future, monitoring using proposed method was expected to contribute that the solution to representative problem of monitoring area selecting and estimate the total litter mass over the beach. Moreover, It is considered a greater application possibility to marine environmental observations.

• 전자공학회논문지 IE
• /
• v.47 no.2
• /
• pp.38-46
• /
• 2010

In this paper, an autonomous surveillance-tracking system for Workers monitoring basing on the stereo vision scheme is proposed. That is, analysing the characteristics of the cross-axis camera system through some experiments, a optimized stereo vision system is constructed and using this system an intelligent worker surveillance-tracking system is implemented, in which a target worker moving through the environments can be detected and tracked, and its resultant stereo location coordinates and moving trajectory in the world space also can be extracted. From some experiments on moving target surveillance-tracking, it is analyzed that the target's center location after being tracked is kept to be very low error ratio of 1.82%, 1.11% on average in the horizontal and vertical directions, respectively. And, the error ratio between the calculation and measurement values of the 3D location coordinates of the target person is found to be very low value of 2.5% for the test scenario on average. Accordingly, in this paper, a possibility of practical implementation of the intelligent stereo surveillance system for real-time tracking of a target worker moving through the environments and robust detection of the target's 3D location coordinates and moving trajectory in the real world is finally suggested.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.30 no.6
• /
• pp.541-547
• /
• 2017

Climate change has become the main cause of the exacerbation in natural disasters. Social Overhead Capital(SOC) structure needs to be checked for displacement and crack periodically to prevent damage and the collapse caused by natural disaster and ensure the safety. For efficient structure maintenance, the optical image technology is applied to the Structure Health Monitoring(SHM). However, optical image is sensitive to environmental factors. So it is necessary to verify its validity. In this paper, the accuracy of estimating the vertical displacement was verified with respect to environmental condition such as natural light, measurement distance, and the number of image sheets. The result of experiments showed that the effect of natural light on accuracy of estimating vertical displacement was the greatest of all. The measurement angle which was affected by the change in measurement distance was also important to check the vertical displacement. These findings will be taken into account by applying appropriate environmental condition to minimize errors when the bridge was measured by camera. It will also enable the application of optical images to the SHM.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.20 no.9
• /
• pp.7-13
• /
• 2019

Unlike a typical video wall system, video wall systems used for integrated monitoring in smart city environments should be able to display various videos, images, and texts simultaneously. In this paper, we propose an Internet Protocol (IP)-based video wall system that has no limit on the number of videos that can be monitored simultaneously, and that can arrange the monitor screen layout without restrictions. The proposed system is composed of multiple display servers, a wall controller, and video source providers, and they communicate with each other through an IP network. Since the display server receives and decodes the video stream directly from the video source devices, and displays it on the attached monitor screens, more videos can be simultaneously displayed on the entire video wall. When one video is displayed over several screens attached to multiple display servers, only one display server receives the video stream and transmits it to the other display servers by using IP multicast communications, thereby reducing the network load and synchronizing the video frames. Experiments show that as the number of videos increases, a system consisting of more display servers shows better decoding and rendering performance, and there is no performance degradation, even if the display server continues to be expanded.