• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• 제22권4호
• /
• pp.97-113
• /
• 2023

Swift and appropriate responses in emergency situations like objects falling on the road can bring convenience to road users and effectively reduces secondary traffic accidents. In Korea, current intelligent transportation system (ITS)-based detection systems for emergency road situations mainly rely on loop detectors and CCTV cameras, which only capture road data within detection range of the equipment. Therefore, a new detection method is needed to identify emergency situations in spatially shaded areas that existing ITS detection systems cannot reach. In this study, we propose a ResNet-based algorithm that detects and classifies emergency situations from vehicle camera footage. We collected front-view driving videos recorded on Korean highways, labeling each video by defining the type of emergency, and training the proposed algorithm with the data.

• Journal of the Society of Naval Architects of Korea
• /
• 제61권3호
• /
• pp.143-151
• /
• 2024

In this study, we present a mapping framework for 3D spatial reconstruction of digital twin model using navigation and perception sensors mounted on an Autonomous Surface Vehicle (ASV). For improving the level of realism of digital twin models, 3D spatial information should be reconstructed as a digitalized spatial model and integrated with the components and system models of the ASV. In particular, for the 3D spatial reconstruction, color and 3D point cloud data which acquired from a camera and a LiDAR sensors corresponding to the navigation information at the specific time are required to map without minimizing the noise. To ensure clear and accurate reconstruction of the acquired data in the proposed mapping framework, a image preprocessing was designed to enhance the brightness of low-light images, and a preprocessing for 3D point cloud data was included to filter out unnecessary data. Subsequently, a point matching process between consecutive 3D point cloud data was conducted using the Generalized Iterative Closest Point (G-ICP) approach, and the color information was mapped with the matched 3D point cloud data. The feasibility of the proposed mapping framework was validated through a field data set acquired from field experiments in a inland water environment, and its results were described.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• 제38C권12호
• /
• pp.1196-1206
• /
• 2013

In this paper, based on the information about navigation system of UAV with PTZ camera and 3D topography, algorithm able to show us in real-time UAV's geographical shooting location and automatically calculate superficial measure of the shooting area is proposed. And the method that can automatically estimate whether UAV is allowed to shoot a specific area is shown. In case of an UAV's shooting attempt at the specific area, obtainability of valid image depends on not only UAV's location but also information of 3D topography. As a result of the study, Ground Control Center will have real-time information about whether UAV can shoot the needed topography. Therefore, accurate remote flight control will be possible in real-time. Furthermore, the algorithm and the method of estimating shooting probability can be applied to pre-flight simulation and set of flight route.

• Journal of Internet Computing and Services
• /
• 제23권2호
• /
• pp.53-59
• /
• 2022

After the 3rd level autonomous driving vehicle, the 4th and 5th level of autonomous driving technology is trying to maintain the optimal condition of the passengers as well as the perfect driving of the vehicle. However current autonomous driving technology is too dependent on visual information such as LiDAR and front camera, so it is difficult to fully autonomously drive on roads other than designated roads. Therefore this paper proposes a Braking Strength Calculation System (BSCS), in which a vehicle classifies road conditions using data other than visual information and calculates optimal braking strength according to road conditions and driving conditions. The BSCS consists of RCDM (Road Condition Definition Module), which classifies road conditions based on KNN algorithm, and BSCM (Braking Strength Calculation Module), which calculates optimal braking strength while driving based on current driving conditions and road conditions. As a result of the experiment in this paper, it was possible to find the most suitable number of Ks for the KNN algorithm, and it was proved that the RCDM proposed in this paper is more accurate than the unsupervised K-means algorithm. By using not only visual information but also vibration data applied to the suspension, the BSCS of the paper can make the braking of autonomous vehicles smoother in various environments where visual information is limited.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• 제45권6호
• /
• pp.26-34
• /
• 2008

The information of traversability and path planning is essential for UGV(Unmanned Ground Vehicle) navigation. Such information can be obtained by analyzing 3D terrain. In this paper, we present the method of 3D terrain modeling with color information from a camera, precise distance information from a 2D Laser Range Finder(LRF) and wheel encoder information from mobile robot with less data. And also we present the method of 3B terrain modeling with the information from GPS/IMU and 2D LRF with less data. To fuse the color information from camera and distance information from 2D LRF, we obtain extrinsic parameters between a camera and LRF using planar pattern. We set up such a fused system on a mobile robot and make an experiment on indoor environment. And we make an experiment on outdoor environment to reconstruction 3D terrain with 2D LRF and GPS/IMU(Inertial Measurement Unit). The obtained 3D terrain model is based on points and requires large amount of data. To reduce the amount of data, we use cubic grid-based model instead of point-based model.

• Journal of the Korean Institute of Electrical and Electronic Material Engineers
• /
• 제23권8호
• /
• pp.632-637
• /
• 2010

The measurement of contact wire wear in electric railways is one of the key test parameters to increase speed and maintain safety in electric railways. Wear caused by continuous interaction between pantographs and contact wires has a negative effect on current collection quality and severely damaged contact wires might cause hazardous accidents. This paper introduces a non-contact optical-based contact wire wear measuring system that will replace conventional wear detecting methods conducted by maintenance vehicles or workers. The system is implemented by high-speed cameras that can collect images of contact wires during vehicle operation, a laser used to create images profile of the contact wire surface, and a computer used to process the collected images. The proposed system is designed to assist maintenance of overhead contact lines by creating geometrically plotted images of contact wires to detect contact wire wear during operation on conventional lines or high-speed lines.

• Journal of Biosystems Engineering
• /
• 제37권1호
• /
• pp.65-74
• /
• 2012

Purpose: An autonomous robot was developed for harvesting strawberries cultivated in bench-type systems. Methods: The harvest robot consisted of four main components: an autonomous vehicle, a manipulator with four degrees of freedom (DOF), an end effector with two DOFs, and a color computer vision system. Strawberry detection was performed based on 3D image and distance information obtained from a stereo CCD color camera and a laser device, respectively. Results: In this work, a Cartesian type manipulator system was designed, including an intermediate revolute axis and a double driven arm-based joint axis, so that it could generate collision-free motions during harvesting. A DC servomotor-driven end-effector, consisting of a gripper and a cutter, was designed for gripping and cutting the strawberry stem without damaging the strawberry itself. Real-time position tracking algorithms were developed to detect, recognize, trace, and approach strawberries under natural light conditions. Conclusion: The developed robot system could harvest a strawberry within 7 seconds without damage.

• Proceedings of the Korean Association of Geographic Inforamtion Studies Conference
• /
• 한국GIS학회 2006년도 GIS/RS 공동춘계학술대회
• /
• pp.152-157
• /
• 2006

Satellite imagery is generally used for investigating the damage from natural disaster for wide area and remotely piloted vehicle or aerial photos are used for the local damage. But for more detailed information such as damages of public facilities, these methods are inadequate and so in this case field surveying has been carried out. We tried to estimate the damage of public facilities faster and more accurately using photogrammetric method. We developed a digital stereo camera system by fixing two digital cameras on a frame, and with this system the photos of actually damaged areas were collected. The damages were estimated from these stereo photos. Then the estimated data was compared with field surveying data in order to verify our system.

• Journal of the Ergonomics Society of Korea
• /
• 제31권4호
• /
• pp.577-583
• /
• 2012

Objective: This paper describes the process and results related to the development of gesture recognition-based natural user interface(NUI) for vehicle maintenance e-Training system. Background: E-Training refers to education training that acquires and improves the necessary capabilities to perform tasks by using information and communication technology(simulation, 3D virtual reality, and augmented reality), device(PC, tablet, smartphone, and HMD), and environment(wired/wireless internet and cloud computing). Method: Palm movement from depth camera is used as a pointing device, where finger movement is extracted by using OpenCV library as a selection protocol. Results: The proposed NUI allows trainees to control objects, such as cars and engines, on a large screen through gesture recognition. In addition, it includes the learning environment to understand the procedure of either assemble or disassemble certain parts. Conclusion: Future works are related to the implementation of gesture recognition technology for a multiple number of trainees. Application: The results of this interface can be applied not only in e-Training system, but also in other systems, such as digital signage, tangible game, controlling 3D contents, etc.

• Journal of the Institute of Electronics and Information Engineers
• /
• 제52권2호
• /
• pp.148-161
• /
• 2015

The examples that used camera in the vehicle is increasing with the growth of the automotive market, and the importance of the image processing technique is expanding. In particular, the Lane Departure Warning System (LDWS) and related technologies are under development in various fields. In this paper, in order to improve the lane recognition rate more than the conventional method, we extract a Normalized Luminance Descriptor value and a Normalized Contrast Descriptor value, and adjust image gamma values to modulate Normalized Image Quality by using the correlation between the extracted two values. Then, we apply the Hough transform using the optimized accumulator cells to the four-channel ROI. The proposed algorithm was verified in 27 frame/sec and $640{\times}480$ resolution. As a result, Lane recognition rate was higher than the average 97% in day, night, and late-night road environments. The proposed method also shows successful lane recognition in sections with curves or many lane boundary.