• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.05a
• /
• pp.695-698
• /
• 2014

As most the scanning systems developed until now provide radiation scan plane images of the inspected objects, there has been a limitation in judging exactly the shape of the objects inside a logistics container exactly with only 2-D radiation image information. Two 2-dimensional radiation images which have different disparity values are acquired from a newly designed stereo image acquisition system which has one additional line sensor to the conventional system. Using a matching algorithm the 3D reconstruction process which find the correspondence between the images is progressed. In this paper, we proposed a new volume based 3D reconstruction algorithm and experimental results show the proposed new volume based reconstruction technique can provide more efficient visualization for cargo inspection. The proposed technique can be used for the development of the high speed and more efficient non-destructive auto inspection system.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.10a
• /
• pp.466-468
• /
• 2022

3D reconstruction is important issue in many applications such as Augmented Reality (AR), eXtended Reality (XR), and Metaverse. For 3D reconstruction, depth map can be acquired by stereo camera and time-of-flight (ToF) sensor. We used both sensors complementarily to improve the accuracy of 3D information of the data. First, we applied general multi-camera calibration technique which uses both color and depth information. Next, the depth map of the two sensors are fused by 3D registration and reprojection approach. The fused data is compared with the ground truth data which is reconstructed using RTC360 sensor. We used Geomagic Wrap to analysis the average RMSE of the two data. The proposed procedure was implemented and tested with real-world data.

• Journal of Bio-Environment Control
• /
• v.24 no.3
• /
• pp.210-216
• /
• 2015

Purpose of this study was a development of an image processing algorithm to recognize paprika and acquire it's 3D coordinates from stereo images to precisely control an end-effector of a paprika auto harvester. First, H and S threshold was set using HSI histogram analyze for extracting ROI(region of interest) from raw paprika cultivation images. Next, fundamental matrix of a stereo camera system was calculated to process matching between extracted ROI of corresponding images. Epipolar lines were acquired using F matrix, and $11{\times}11$ mask was used to compare pixels on the line. Distance between extracted corresponding points were calibrated using 3D coordinates of a calibration board. Non linear regression analyze was used to prove relation between each pixel disparity of corresponding points and depth(Z). Finally, the program could calculate horizontal(X), vertical(Y) directional coordinates using stereo camera's geometry. Horizontal directional coordinate's average error was 5.3mm, vertical was 18.8mm, depth was 5.4mm. Most of the error was occurred at 400~450mm of depth and distorted regions of image.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.39 no.4
• /
• pp.429-441
• /
• 2002

This paper concerns extracting 3D motion information from a 3D input device in real time focused to enabling effective human-computer interaction. In particular, we develop a novel algorithm for extracting 6 degrees-of-freedom motion information from a 3D input device by employing an epipolar geometry of stereo camera, color, motion, and structure information, free from requiring the aid of camera calibration object. To extract 3D motion, we first determine the epipolar geometry of stereo camera by computing the perspective projection matrix and perspective distortion matrix. We then incorporate the proposed Motion Adaptive Weighted Unmatched Pixel Count algorithm performing color transformation, unmatched pixel counting, discrete Kalman filtering, and principal component analysis. The extracted 3D motion information can be applied to controlling virtual objects or aiding the navigation device that controls the viewpoint of a user in virtual reality setting. Since the stereo vision-based 3D input device is wireless, it provides users with a means for more natural and efficient interface, thus effectively realizing a feeling of immersion.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.38 no.1
• /
• pp.69-83
• /
• 2020

Signboards are standardized according to national legislation for the safety of pedestrians and disaster prevention in urban areas. Signboards should be installed according to the standard. However, it is not easy to manage the signboards systematically due to the number of signboards that have been installed for a long time and frequently changing stores. In this study, we proposed a methodology for distinguishing signboards that deviated from the standard. To this end, the signboard was photographed using a stereo camera, and then the three-dimensional coordinates of the signboard were determined from the signboard image to calculate the signboard's horizontal and vertical dimensions to determine the signboard's specifications. In order to determine the interior and relative orientation parameters of the stereo camera, an outdoor three-dimensional building was used as the test field. Then, the image coordinates of four vertices of the signboard were extracted from the signboard image taken from about 15m ~ 22m distance using deep learning. After determining the signboard's three-dimensional coordinates by using the interior and relative orientation parameters of the stereo camera and the image coordinates of the four vertices of the signboard, the horizontal and vertical sizes of the signboard were calculated, resulting in an error of about 2.7cm on average. The specifications for the ten flat-type signboards showed that all of the horizontal sizes were compliant with the specifications, but the vertical sizes exceeded about 36.5cm on average. Through this, it was found that maintenance of flat-type signboards is needed overall.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.35 no.3
• /
• pp.145-154
• /
• 2017

In recent years, demand for 1 / 1,000 digital map production has increased in various fields such as construction and urban planning. As a result, the use of low-cost non-metric cameras that replace expensive aerial photogrammetry equipment is required. In Korea, researches are being continuously carried out to produce a large scale digital map by photographing a small target area with a non-metric camera. However, due to the limitation of the accuracy of the non-metric camera, it is difficult to do digital mapping with stereoscopic photographs. In this study, we tried to verify the possibility of large-scale digital mapping to utilize non-metric camera for public survey. For this purpose, the accuracy of the digital mapping results of the non-metric camera and the results of the DMC camera were compared and analyzed. After performing in-situ self-calibration including 8 standard additional parameters, we plotted to a scale of 1/1,000 and confirmed that the RMSE is suitable for public survey accuracy of ${\pm}0.145m$ in horizontal and ${\pm}0.153$ m in vertical.

• Korean Journal of Remote Sensing
• /
• v.30 no.3
• /
• pp.383-397
• /
• 2014

Information technology advances are allowing conventional surveillance systems to be combined with mobile communication technologies, creating ubiquitous monitoring systems. This paper proposes monitoring system that uses smart camera technology. We discuss the dependence of interior orientation parameters on calibration target sheets and compare the accuracy of a three-dimensional monitoring system with camera location calculated by space resectioning using a Digital Surface Model (DSM) generated from stereo images. A monitoring housing is designed to protect a camera from various weather conditions and to provide the camera for power generated from solar panel. A smart camera is installed in the monitoring housing. The smart camera is operated and controlled through an Android application. At last the accuracy of a three-dimensional monitoring system is evaluated using a DSM. The proposed system was then tested against a DSM created from ground control points determined by Global Positioning Systems (GPSs) and light detection and ranging data. The standard deviation of the differences between DSMs are less than 0.12 m. Therefore the monitoring system is appropriate for extracting the information of objects' position and deformation as well as monitoring them. Through incorporation of components, such as camera housing, a solar power supply, the smart camera the system can be used as a ubiquitous monitoring system.

• Journal of KIBIM
• /
• v.7 no.1
• /
• pp.45-53
• /
• 2017

Continuous research efforts have been made on acquiring location data on construction sites. As a result, GPS and RFID are increasingly employed on the site to track the location of equipment and materials. However, these systems are based on radio frequency technologies which require attaching tags on every target entity. Implementing the systems incurs time and costs for attaching/detaching/managing the tags or sensors. For this reason, efforts are currently being made to track construction entities using only cameras. Vision-based 3D tracking has been presented in a previous research work in which the location of construction manpower, vehicle, and materials were successfully tracked. However, the proposed system is still in its infancy and yet to be implemented on practical applications for two reasons. First, it does not involve entity matching across two views, and thus cannot be used for tracking multiple entities, simultaneously. Second, the use of a checker board in the camera calibration process entails a focus-related problem when the baseline is long and the target entities are located far from the cameras. This paper proposes a vision-based method to track multiple workers simultaneously. An entity matching procedure is added to acquire the matching pairs of the same entities across two views which is necessary for tracking multiple entities. Also, the proposed method simplified the calibration process by avoiding the use of a checkerboard, making it more adequate to the realistic deployment on construction sites.

• The Journal of Korea Robotics Society
• /
• v.6 no.2
• /
• pp.118-129
• /
• 2011

In this paper, we suggest a new camera capturing and synthesizing algorithm with the multi-captured left and right images for the better comfortable feeling of 3D depth and also propose 3D image capturing hardware system based on the this new algorithm. We also suggest the simple control algorithm for the calibration of camera capture system with zooming function based on a performance index measure which is used as feedback information for the stabilization of focusing control problem. We also comment on the theoretical mapping theory concerning projection under the assumption that human is sitting 50cm in front of and watching the 3D LCD screen for the captured image based on the modeling of pinhole Camera. We choose 9 segmentations and propose the method to find optimal alignment and focusing based on the measure of alignment and sharpness and propose the synthesizing fusion with the optimized 9 segmentation images for the best 3D depth feeling.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2012.07a
• /
• pp.429-432
• /
• 2012

In this paper, we proposed the algorithm computes the waste volume periodically for the way of waste repository standard. For the construction of safe and clear urban environment, it is necessary that we identify the rubbish waste volume and we know the accuracy volume. After camera calibration, we obtained the point cloud on the surface of the object and took this as the input of the calculation algorithm of the object volume. We proposed the two volume calculation algorithms based on the triangularmeshing methods and verified the validity of the algorithm through simulation and real experiments. The proposed algorithm can be used not only as the volume calculation of the waste repository but also as the general volume calculation of a three dimensional object.