• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.7
• /
• pp.262-269
• /
• 2020

Recently, many attempts have been made to reduce the time required for payment in various shopping environments. In addition, for the Fourth Industrial Revolution era, artificial intelligence is advancing, and Internet of Things (IoT) devices are becoming more compact and cheaper. So, by integrating these two technologies, access to building an unmanned environment to save people time has become easier. In this paper, we propose a smart shopping cart system based on low-cost IoT equipment and deep-learning object-detection technology. The proposed smart cart system consists of a camera for real-time product detection, an ultrasonic sensor that acts as a trigger, a weight sensor to determine whether a product is put into or taken out of the shopping cart, an application for smartphones that provides a user interface for a virtual shopping cart, and a deep learning server where learned product data are stored. Communication between each module is through Transmission Control Protocol/Internet Protocol, a Hypertext Transmission Protocol network, a You Only Look Once darknet library, and an object detection system used by the server to recognize products. The user can check a list of items put into the smart cart via the smartphone app, and can automatically pay for them. The smart cart system proposed in this paper can be applied to unmanned stores with high cost-effectiveness.

• International Journal of Internet, Broadcasting and Communication
• /
• v.14 no.3
• /
• pp.22-29
• /
• 2022

Recently, with the development of mobile computing power, mobile-based VR and AR services are being developed. Due to network performance and computing power constraints, VR and AR services using large-capacity 3D content have limitations. A study on an efficient 3D content load method for a mobile device is required. The conventional method downloads all 3D content used for AR services at the same time. In this paper, we propose an active 3D content load according to the user's track. The proposed method is a partitioned 3D object load. Edge servers were installed for each area and connected through the MESH network. Partitioned load the required 3D object in the area referring to the user's location. The location is identified through the edge server information of the connected AP. The performance of the proposed method and the conventional method was compared. As a result of the comparison, the proposed method showed a stable Mobile AR Service. The results of this study, it is expected to contribute to the activation of edge server-based AR mobile services.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2022.11a
• /
• pp.1056-1058
• /
• 2022

본 연구는 항만에서 안전 수칙을 위반하여 발생하는 사고 및 이상행동을 실시간 탐지를 수행한 후 위험 상황을 관리자가 신속하고 정확하게 대처할 수 있도록 지원하는 지능형 CCTV, Smart Eye를 제안한다. Smart Eye는 컴퓨터 비전(Computer Vision) 기반의 다양한 객체 탐지(Object Detection) 모델과 행동 인식(Action Recognition) 모델을 통해 낙하 및 전도사고, 안전 수칙 미준수 인원, 폭력적인 행동을 보이는 인원을 복합적으로 판단하며, 객체 추적(Object Tracking), 관심 영역(Region of Interest), 객체 간의 거리 측정 알고리즘을 구현하여, 제한구역 접근, 침입, 배회, 안전 보호구 미착용 인원 그리고 화재 및 충돌사고 위험도를 측정한다. 해당 연구를 통한 자동화된 24시간 감시체계는 실시간 영상 데이터 분석 및 판단 처리 과정을 거친 후 각 장소에서 수집된 데이터를 관리자에게 신속히 전달하고 항만 내 통합관제센터에 접목함으로써 효율적인 관리 및 운영할 수 있게 하는 '지능형 인프라'를 구축할 수 있다. 이러한 체계는 곧 스마트 항만 시스템 도입에 이바지할 수 있을 것으로 기대된다.

• Journal of the Korea Society of Computer and Information
• /
• v.23 no.1
• /
• pp.41-48
• /
• 2018

Recently, surveillance systems are widely used, and one of the key technologies in this surveillance system is to recognize and track objects. In order to track a moving object robustly and efficiently in a complex environment, it is necessary to extract the feature points in the interesting object and to track the object using the feature points. In this paper, we propose a method to track interesting objects in real time by eliminating unnecessary information from objects, generating feature point descriptors using only key feature points, and reducing computational complexity for object recognition. Experimental results show that the proposed method is faster and more robust than conventional methods, and can accurately track objects in various environments.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2023.05a
• /
• pp.251-252
• /
• 2023

As technology improves with the 4th industrial revolution, smart construction is becoming a key part of safety management in the architecture and civil engineering. By using object detection technology with CCTV data, construction sites can be managed efficiently. In this study, super resolution technology based on deep learning is proposed to improve the accuracy of object detection in construction sites. As the resolution of a train set data and test set data get higher, the accuracy of object detection model gets better. Therefore, according to the scale of construction sites, different object detection models can be considered.

• Smart Media Journal
• /
• v.4 no.1
• /
• pp.16-24
• /
• 2015

In this paper, we propose a method for multi-touch tracking using MRF-based particle filters and gesture likelihood estimation Each touch (of one finger) is considered to be one object. One of frequently occurring issues is the hijacking problem which means that an object tracker can be hijacked by neighboring object. If a predicted particle is close to an adjacent object then the particle's weight should be lowered by analysing the influence of neighboring objects for avoiding hijacking problem. We define a penalty function to lower the weights of those particles. MRF is a graph representation where a node is the location of a target object and an edge describes the adjacent relation of target object. It is easy to utilize MRF as data structure of adjacent objects. Moreover, since MRF graph representation is helpful to analyze multi-touch gestures, we describe how to define gesture likelihoods based on MRF. The experimental results show that the proposed method can avoid the occurrence of hijacking problems and is able to estimate gesture likelihoods with high accuracy.

• International journal of advanced smart convergence
• /
• v.2 no.1
• /
• pp.32-35
• /
• 2013

In this paper we proposed a PTZ camera system which automatically detect and track moving objects in the image. Once a moving object is detected the PTZ camera traces it in real-time. We proposed the control system which does not depend on camera focusing functionality but uses the object's center, moving direction, distance and speed. We implemented the system with the TI DM6446 DSP chip. The experimental result shows that the system has excellent performance for high speed vehicles.

• Journal of the Korean Society of Safety
• /
• v.30 no.3
• /
• pp.93-99
• /
• 2015

Economic burden of work-related musculoskeletal disorder(WMDs) is increasing. Known causes of WMDs include improper posture, repetition, load, and temperature of workplace. Among them, improper postures play an important role. A smart sensor called SensorTag is employed to estimate the trunk postures including flexion-extension, lateral bend, and the trunk rotational speeds. Measuring gravitational acceleration vector in the smart sensor along the tri-orthogonal axes offers an orientation of the object with the smart sensor attached to. The smart sensor is light in weight and has small form factor, making it an ideal wearable sensor for body posture measurement. Measured data from the smart senor is wirelessly transferred for analysis to a smartphone which has enough computing power, data storage and internet-connectivity, removing need for additional hardware for data post-processing. Based on the estimated body postures, WMDs risks can be conviently gauged by using existing WMDs risk assesment methods such as OWAS, RULA, REBA, etc.

• Journal of Korea Multimedia Society
• /
• v.20 no.7
• /
• pp.986-993
• /
• 2017

Object Tracking is a technique for tracking moving objects over time in a video image. Using object tracking technique, many research are conducted such a detecting dangerous situation and recognizing the movement of nearby objects in a smart car. However, it still remains a challenging task such as occlusion, deformation, background clutter, illumination variation, etc. In this paper, we propose a novel deep visual object tracking method that can be operated in robust to many challenging task. For the robust visual object tracking, we proposed a Convolutional Neural Network(CNN) which shares weight of the convolutional layers. Input of the CNN is a three; first frame object image, object image in a previous frame, and current search frame containing the object movement. Also we propose a method to consider the motion of the object when determining the current search area to search for the location of the object. Extensive experimental results on a authorized resource database showed that the proposed method outperformed than the conventional methods.

• Journal of IKEEE
• /
• v.14 no.3
• /
• pp.224-231
• /
• 2010

Automatic detection of objects in images has been one of core challenges in the areas such as computer vision and pattern analysis. Especially, with the recent deployment of personal mobile devices such as smart phone, such technology is required to be transported to them. Usually, these smart phone users are equipped with devices such as camera, GPS, and gyroscope and provide various services through user-friendly interface. However, the smart phones fail to give excellent performance due to limited system resources. In this paper, we propose a new scheme to improve object recognition performance based on pre-computation and simple local features. In the pre-processing, we first find several representative parts from similar type objects and classify them. In addition, we extract features from each classified part and train them using regression functions. For a given query image, we first find candidate representative parts and compare them with trained information to recognize objects. Through experiments, we have shown that our proposed scheme can achieve resonable performance.