• Journal of the Microelectronics and Packaging Society
• /
• v.19 no.1
• /
• pp.81-87
• /
• 2012

This paper focuses on three-dimensional measurement system of micro balls on micro Ball-Grid-Array(BGA) packages in-line. Most of visual inspection system still suffers from sophisticate reflection characteristics of micro balls. For accurate shape measurement of them, a specially designed visual sensor system is proposed under the sensing principle of phase shifting moire interferometry. The system consists of a pattern projection system with four projection subsystems and an imaging system. In the projection system, four subsystems have spatially different projection directions to make target objects experience the pattern illuminations with different incident directions. For the phase shifting, each grating pattern of subsystem is regularly moved by PZT actuator. To remove specular noise and shadow area of BGA balls efficiently, a compact multiple-pattern projection and imaging system is implemented and tested. Especially, a sensor fusion algorithm to integrate four information sets, acquired from multiple projections, into one is proposed with the basis of Bayesian sensor fusion theory. To see how the proposed system works, a series of experiments is performed and the results are analyzed in detail.

• Korean Journal of Remote Sensing
• /
• v.38 no.6_1
• /
• pp.1125-1139
• /
• 2022

In an unmanned aerial vehicles (UAVs) system, a physical offset can be existed between the global positioning system/inertial measurement unit (GPS/IMU) sensor and the observation sensor such as a hyperspectral sensor, and a lidar sensor. As a result of the physical offset, a misalignment between each image can be occurred along with a flight direction. In particular, in a case of multi-sensor system, an observation sensor has to be replaced regularly to equip another observation sensor, and then, a high cost should be paid to acquire a calibration parameter. In this study, we establish a precise sensor model equation to apply for a multiple sensor in common and propose an independent physical offset estimation method. The proposed method consists of 3 steps. Firstly, we define an appropriate rotation matrix for our system, and an initial sensor model equation for direct-georeferencing. Next, an observation equation for the physical offset estimation is established by extracting a corresponding point between a ground control point and the observed data from a sensor. Finally, the physical offset is estimated based on the observed data, and the precise sensor model equation is established by applying the estimated parameters to the initial sensor model equation. 4 region's datasets(Jeon-ju, Incheon, Alaska, Norway) with a different latitude, longitude were compared to analyze the effects of the calibration parameter. We confirmed that a misalignment between images were adjusted after applying for the physical offset in the sensor model equation. An absolute position accuracy was analyzed in the Incheon dataset, compared to a ground control point. For the hyperspectral image, root mean square error (RMSE) for X, Y direction was calculated for 0.12 m, and for the point cloud, RMSE was calculated for 0.03 m. Furthermore, a relative position accuracy for a specific point between the adjusted point cloud and the hyperspectral images were also analyzed for 0.07 m, so we confirmed that a precise data mapping is available for an observation without a ground control point through the proposed estimation method, and we also confirmed a possibility of multi-sensor fusion. From this study, we expect that a flexible multi-sensor platform system can be operated through the independent parameter estimation method with an economic cost saving.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.5C
• /
• pp.355-364
• /
• 2012

Target processing mechanisms are necessary to collect target information, real-time data fusion, and tactical environment recognition for cooperative engagement ability. Among these mechanisms, the target tracking starts from predicting state of speed, acceleration, and location by using sensors' measurements. However, it can be a problem to give the reliability because the measurements have a certain uncertainty. Thus, a technique which uses multiple sensors is needed to detect the target and increase the reliability. Also, data fusion technique is necessary to process the data which is provided from heterogeneous sensors for target tracking. In this paper, a target tracking algorithm is proposed based on probabilistic data association(PDA) by fusing radar and ESM sensor measurements. The radar sensor's azimuth and range measurements and the ESM sensor's bearing-only measurement are associated by the measurement fusion method. After gating associated measurements, state estimation of the target is performed by PDA filter. The simulation results show that the proposed algorithm provides improved estimation under linear and circular target motions.

• Journal of Institute of Control, Robotics and Systems
• /
• v.7 no.5
• /
• pp.445-453
• /
• 2001

The multiple targets tracking problem has been one of the main issues in the radar applications area in the last decade. Besides the standard Kalman filtering, various methods including the variable dimen-sion filter, input estimation filter, interacting multiple model(IMM) filter, dederated variable dimension filter with input estimation, etc., have proposed to address the tracking and sensor fusion issues. In this pa- per, two existing tracking algorithm, i.e, the IMM filter and the variable dimension filter with input estima-tion(VDIE), are combined for the purpose of improving the tracking performance for maneuvering targets. To evaluate the tracking performance of the proposed algorithm, three typical maneuvering patterns, i.e., waver, pop-up, and high-diver motions, are defined and are applied to the modified IMM filter as well as the standard IMM filter. The smaller RMS tracking errors, in position and velocity, of the modified IMM filter than the standard IMM filter are demonstrated though computer simulations.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.16 no.2
• /
• pp.66-73
• /
• 2008

In this paper, ultrasonic range system which detects parking lot in parking area is studied. The important part for detecting parking lot accurately is to detect the first and second corners of possible parking lot, and for that, new method using multiple echo function is introduced in this paper. Many probabilistic methods have been used to reduce uncertainties of ultrasonic sensor for distance and location of objects. Method using multiple echo, however, gives accurates results as well as simple algorithm. For experiments in parking space, ultrasonic range system was attached to a Pioneer AT-2 and final parking space map was created in a fusion with position information from wheels of a Pioneer AT-2. We will show the results are compared with error of another methods.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2021.10a
• /
• pp.422-424
• /
• 2021

In this paper, it leads the approach of fusing multiple RGB cameras for visual objects recognition based on deep learning with convolution neural network and 3D Light Detection and Ranging (LiDAR) to observe the environment and match into a 3D world in estimating the distance and position in a form of point cloud map. The goal of perception in multiple cameras are to extract the crucial static and dynamic objects around the autonomous vehicle, especially the blind spot which assists the AV to navigate according to the goal. Numerous cameras with object detection might tend slow-going the computer process in real-time. The computer vision convolution neural network algorithm to use for eradicating this problem use must suitable also to the capacity of the hardware. The localization of classified detected objects comes from the bases of a 3D point cloud environment. But first, the LiDAR point cloud data undergo parsing, and the used algorithm is based on the 3D Euclidean clustering method which gives an accurate on localizing the objects. We evaluated the method using our dataset that comes from VLP-16 and multiple cameras and the results show the completion of the method and multi-sensor fusion strategy.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.17 no.1
• /
• pp.96-107
• /
• 2014

Tracking the tactical object is a fundamental affair in network-equipped modern warfare. Geodetic coordinate system based on longitude, latitude, and height is suitable to represent the location of tactical objects considering multi platform data fusion. The motion of tactical object described as a dynamic model requires an appropriate filtering to overcome the system and measurement noise in acquiring information from multiple sensors. This paper introduces the filter suitable for multi-sensor data fusion and tactical object tracking, particularly the unscented transform(UT) and its detail. The UT in Unscented Kalman Filter(UKF) uses a few samples to estimate nonlinear-propagated statistic parameters, and UT has better performance and complexity than the conventional linearization method. We show the effects of UT-based filtering via simulation considering practical tactical object tracking scenario.

• Journal of Korea Multimedia Society
• /
• v.20 no.8
• /
• pp.1271-1281
• /
• 2017

It is essential to collect and analyze target information around the vehicle for autonomous driving of the vehicle. Based on the analysis, environmental information such as location and direction should be analyzed in real time to control the vehicle. In particular, obstruction or cutting of objects in the image must be handled to provide accurate information about the vehicle environment and to facilitate safe operation. In this paper, we propose a method to simultaneously generate 2D and 3D bounding box proposals using LiDAR Edge generated by filtering LiDAR sensor information. We classify the classes of each proposal by connecting them with Region-based Fully-Covolutional Networks (R-FCN), which is an object classifier based on Deep Learning, which uses two-dimensional images as inputs. Each 3D box is rearranged by using the class label and the subcategory information of each class to finally complete the 3D bounding box corresponding to the object. Because 3D bounding boxes are created in 3D space, object information such as space coordinates and object size can be obtained at once, and 2D bounding boxes associated with 3D boxes do not have problems such as occlusion.

• Proceedings of the KSR Conference
• /
• 2011.10a
• /
• pp.226-231
• /
• 2011

This research was done to prove the optimal position to detect a train reader when using a multiple fusion sensor. The experiment was done using four Train installed RFID Readers located on the train. These readers were read by sensors installed at intervals of 50 meters on the up and down sections of the Line 8, from Amsa station to Moran station. We analyze errors in the recognition range according to the Tag's number of recognition due to RFID of train speed, and propose a method of estimation for an accurate estimation of the position of train At this the Least-Squares Method is applied to judge the position of train accurately from the error because of Tag's number of recognition and RFID of train speed. also It is verified through simulation.

• Transactions of the Korean Society of Mechanical Engineers
• /
• v.18 no.7
• /
• pp.1618-1631
• /
• 1994

In this paper, in-process chatter detection methodology which utilizes nondimensional characteristic variables is introduced. To obtain nondimensional chatter detection indexes which are constant regardless of the cutting conditions during machining with the same tool and workpiece material, both the cutting forces and accelerations are measured and processed in time and frequency domain. The indexes are calculated from the present and past value of the acceleration and cutting force signals in time and frequency domain. The chatter is identified when these chatter detection indexes are bigger than the threshold which is decided by preliminary experiments. The experiment shows that these indexes works very well in-process chatter detection.