• Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
• /
• v.9 no.11
• /
• pp.1133-1144
• /
• 2019

Recently, the amount of image on the Internet has rapidly increased, due to the advancement of smart devices and various approaches to effective image retrieval have been researched under these situation. Existing image retrieval methods simply detect the objects in a image and carry out image retrieval based on the label of each object. Therefore, the semantic gap occurs between the image desired by a user and the image obtained from the retrieval result. To reduce the semantic gap in image retrievals, we connect the module for multiple objects classification based on deep learning with the module for human behavior classification. And we combine the connected modules with a behavior ontology. That is to say, we propose an image retrieval system considering the relationship between objects by using the combination of deep learning and behavior ontology. We analyzed the experiment results using walking and running data to take into account dynamic behaviors in images. The proposed method can be extended to the study of automatic annotation generation of images that can improve the accuracy of image retrieval results.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.2
• /
• pp.569-574
• /
• 2023

For maintenance of concrete structures, it is necessary to identify and maintain various defects. With the current method, there are problems with efficiency, safety, and reliability when inspecting large-scale social infrastructure, so it is necessary to introduce a new inspection method. Recently, with the development of deep learning technology for images, concrete defect classification research is being actively conducted. However, studies on contamination and spalling other than cracks are limited. In this study, a variety of concrete defect type classification models were developed through transfer learning on a pre-learned deep learning model, factors that reduce accuracy were derived, and future development directions were presented. This is expected to be highly utilized in the field of concrete maintenance in the future.

• Journal of the Institute of Convergence Signal Processing
• /
• v.22 no.4
• /
• pp.149-155
• /
• 2021

In this study, we intend to develop a defective road surface object recognition model that automatically detects road surface defects that restrict the movement of the transportation handicapped using electric mobile devices with deep learning. For this purpose, road surface information was collected from the pedestrian and running routes where the electric mobility aid device is expected to move in five areas within the city of Busan. For data, images were collected by dividing the road surface and surroundings into objects constituting the surroundings. A series of recognition items such as the detection of breakage levels of sidewalk blocks were defined by classifying according to the degree of impeding the movement of the transportation handicapped in traffic from the collected data. A road surface object recognition deep learning model was implemented. In the final stage of the study, the performance verification process of a deep learning model that automatically detects defective road surface objects through model learning and validation after processing, refining, and annotation of image data separated and collected in units of objects through actual driving. proceeded.

• Journal of the Korea Convergence Society
• /
• v.11 no.11
• /
• pp.175-182
• /
• 2020

In this study, we introduced the technique of matching classical music using deep learning to design soundscape that can help the viewer appreciate painting and proposed an evaluation index to evaluate how well matching painting and music. The evaluation index was conducted with suitability evaluation through the Likeard 5-point scale and evaluation in a multimodal aspect. The suitability evaluation score of the 13 test participants for the deep learning based best match between painting and music was 3.74/5.0 and band the average cosine similarity of the multimodal evaluation of 13 participants was 0.79. We expect multimodal evaluation to be an evaluation index that can measure a new user experience. In addition, this study aims to improve the experience of multisensory artworks by proposing the interaction between visual and auditory. The proposed matching of painting and music method can be used in multisensory artwork exhibition and furthermore it will increase the accessibility of visually impaired people to appreciate artworks.

• Journal of Convergence for Information Technology
• /
• v.10 no.12
• /
• pp.9-14
• /
• 2020

Currently, NTIS (National Technology Information Service) is building an interactive search service based on artificial intelligence technology. In order to understand users' search intentions and provide R&D information, an interactive search service is built based on deep learning models and morpheme analyzers. The deep learning model learns based on the log data loaded when using NTIS and interactive search services and understands the user's search intention. And it provides task information through step-by-step search. Understanding the search intent makes exception handling easier, and step-by-step search makes it easier and faster to obtain the desired information than integrated search. For future research, it is necessary to expand the range of information provided to users.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.22 no.4
• /
• pp.171-176
• /
• 2022

CNN is a type of deep learning and is a neural network used to process images or image data. The filter traverses the image and extracts features of the image to distinguish the image. Deep learning has the characteristic that the more data, the better models can be made, and CNN uses a method of artificially increasing the amount of data by means of data augmentation such as rotation, zoom, shift, and flip to compensate for the weakness of less data. When learning CNN, we would like to check whether outline image learning is helpful in improving performance compared to conventional data augmentation techniques.

• Journal of the Society of Disaster Information
• /
• v.18 no.3
• /
• pp.433-443
• /
• 2022

Purpose: In this paper, we propose a study of deep learning algorithms that estimate and predict sarcopenia by exploiting the high penetration rate of smart devices. Method: To utilize deep learning techniques, experimental data were collected by using the inertial sensor embedded in the smart device. We implemented a smart device application for data collection. The data are collected by labeling normal and abnormal gait and five states of running, falling and squat posture. Result: The accuracy was analyzed by comparative analysis of LSTM, CNN, and RNN models, and binary classification accuracy of 99.87% and multiple classification accuracy of 92.30% were obtained using the CNN-LSTM fusion algorithm. Conclusion: A study was conducted using a smart sensoring device, focusing on the fact that gait abnormalities occur for people with sarcopenia. It is expected that this study can contribute to strengthening the safety issues caused by sarcopenia.

• The Journal of the Convergence on Culture Technology
• /
• v.10 no.1
• /
• pp.489-493
• /
• 2024

Happiness index is a measurement system for understanding collective happiness. As values change, studies have been proposed to add the value of behavior to the happiness index. However, there is a lack of studies analyze the relationship using individual emotions. Using a deep learning model, we predicted happiness index using social variables and individual emotional index. First, we collected social and emotional variables from January 2005 to December 2020. Second, we preprocessed the data and identified significant variables. Finally, we trained deep learning-based regression model. Our proposed model was evaluated using 5-fold cross validation. The proposed model showed 90.86% accuracy on test sets. Our model will be expected to analyze the significant factors of country-specific happiness index.

• KIPS Transactions on Software and Data Engineering
• /
• v.10 no.5
• /
• pp.187-194
• /
• 2021

A person's behavioral recognition is the recognition of what a person does according to joint movements. To this end, we utilize computer vision tasks that are utilized in image processing. Human behavior recognition is a safety accident response service that combines deep learning and CCTV, and can be applied within the safety management site. Existing studies are relatively lacking in behavioral recognition studies through human joint keypoint extraction by utilizing deep learning. There were also problems that were difficult to manage workers continuously and systematically at safety management sites. In this paper, to address these problems, we propose a method to recognize risk behavior using only joint keypoints and joint motion information. AlphaPose, one of the pose estimation methods, was used to extract joint keypoints in the body part. The extracted joint keypoints were sequentially entered into the Long Short-Term Memory (LSTM) model to be learned with continuous data. After checking the behavioral recognition accuracy, it was confirmed that the accuracy of the "Lying Down" behavioral recognition results was high.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2020.11a
• /
• pp.159-160
• /
• 2020

카메라, 라이다, RTK-GNSS 등의 센서는 자율주행 YT 기술 개발을 위해 매우 주요한 요소이다. 본 연구에서는 항만 터미널의 무인화에 핵심 기술 중의 하나인 자율주행 YT에서 안전한 자율주행을 실현하기 위한 다중센서 기반의 융합인식 기술을 제안하고자 한다.