• Title/Summary/Keyword: Scene Matching

Search Result 157, Processing Time 0.027 seconds

Design of range measurement systems using a sonar and a camera (초음파 센서와 카메라를 이용한 거리측정 시스템 설계)

  • Moon, Chang-Soo;Do, Yong-Tae
    • Journal of Sensor Science and Technology
    • /
    • v.14 no.2
    • /
    • pp.116-124
    • /
    • 2005
  • In this paper range measurement systems are designed using an ultrasonic sensor and a camera. An ultrasonic sensor provides the range measurement to a target quickly and simply but its low resolution is a disadvantage. We tackle this problem by employing a camera. Instead using a stereoscopic sensor, which is widely used for 3D sensing but requires a computationally intensive stereo matching, the range is measured by focusing and structured lighting. In focusing a straightforward focusing measure named as MMDH(min-max difference in histogram) is proposed and compared with existing techniques. In the method of structure lighting, light stripes projected by a beam projector are used. Compared to those using a laser beam projector, the designed system can be constructed easily in a low-budget. The system equation is derived by analysing the sensor geometry. A sensing scenario using the systems designed is in two steps. First, when better accuracy is required, measurements by ultrasonic sensing and focusing of a camera are fused by MLE(maximum likelihood estimation). Second, when the target is in a range of particular interest, a range map of the target scene is obtained by using structured lighting technique. The systems designed showed measurement accuracy up to 0.3[mm] approximately in experiments.

Indoor Semantic Data Dection and Indoor Spatial Data Update through Artificial Intelligence and Augmented Reality Technology

  • Kwon, Sun
    • International conference on construction engineering and project management
    • /
    • 2022.06a
    • /
    • pp.1170-1178
    • /
    • 2022
  • Indoor POI data, an essential component of indoor spatial data, has attribute information of a specific place in the room and is the most critical information necessary for the user. Currently, indoor POI data is manually updated by direct investigation, which is expensive and time-consuming. Recently, research on updating POI using the attribute information of indoor photographs has been advanced to overcome these problems. However, the range of use, such as using only photographs with text information, is limited. Therefore, in this study, and to improvement this, I proposed a new method to update indoor POI data using a smartphone camera. In the proposed method, the POI name is obtained by classifying the indoor scene's photograph into artificial intelligence technology CNN and matching the location criteria to indoor spatial data through AR technology. As a result of creating and experimenting with a prototype application to evaluate the proposed method, it was possible to update POI data that reflects the real world with high accuracy. Therefore, the results of this study can be used as a complement or substitute for the existing methodologies that have been advanced mainly by direct research.

  • PDF

A Grouping Method of Photographic Advertisement Information Based on the Efficient Combination of Features (특징의 효과적 병합에 의한 광고영상정보의 분류 기법)

  • Jeong, Jae-Kyong;Jeon, Byeung-Woo
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.48 no.2
    • /
    • pp.66-77
    • /
    • 2011
  • We propose a framework for grouping photographic advertising images that employs a hierarchical indexing scheme based on efficient feature combinations. The study provides one specific application of effective tools for monitoring photographic advertising information through online and offline channels. Specifically, it develops a preprocessor for advertising image information tracking. We consider both global features that contain general information on the overall image and local features that are based on local image characteristics. The developed local features are invariant under image rotation and scale, the addition of noise, and change in illumination. Thus, they successfully achieve reliable matching between different views of a scene across affine transformations and exhibit high accuracy in the search for matched pairs of identical images. The method works with global features in advance to organize coarse clusters that consist of several image groups among the image data and then executes fine matching with local features within each cluster to construct elaborate clusters that are separated by identical image groups. In order to decrease the computational time, we apply a conventional clustering method to group images together that are similar in their global characteristics in order to overcome the drawback of excessive time for fine matching time by using local features between identical images.

Video Classification Based on Viewer Acceptability of Olfactory Information and Suggestion for Reality Improvement (시청자의 후각정보 수용 특성에 따른 영상분류와 실감증대를 위한 제안)

  • Lee, Guk-Hee;Choi, Ji Hoon;Ahn, Chung Hyun;Li, Hyung-Chul O.;Kim, ShinWoo
    • Science of Emotion and Sensibility
    • /
    • v.16 no.2
    • /
    • pp.207-220
    • /
    • 2013
  • For video reality improvement, there has been much advancement in the methods of providing visual, auditory, and tactile information. On the other hand, there is little research on olfaction for video reality because it is difficult to define and knotty to manipulate. As a first step for video reality improvement using olfactory information, this research investigated users' acceptability of smell when they watch videos of various kinds and then classified the video clips based on their acceptability of different criteria. To do so, we first selected three questions of whether the scene in the video appears to have an odor (odor presence), whether a matching odor is likely to improve a sense of reality (effect on sense of reality), and whether s/he would like a matching odor to be present (preference for the matching odor). Then after collecting 51 video clips of various genres that would receive either high or low ratings for the questions above, we had participants to watch the videos and rate them for the above three questions on 7-point scale. For video classification, we paired each two questions to construct 2D space to draw scatterplot of video clips where the scales of the two questions represent X or Y axis. Clusters of video clips that locate at different quadrants of the 2D space would provide important insights in providing olfactory information for video reality improvement.

  • PDF

A Study on the Construction of Near-Real Time Drone Image Preprocessing System to use Drone Data in Disaster Monitoring (재난재해 분야 드론 자료 활용을 위한 준 실시간 드론 영상 전처리 시스템 구축에 관한 연구)

  • Joo, Young-Do
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.18 no.3
    • /
    • pp.143-149
    • /
    • 2018
  • Recently, due to the large-scale damage of natural disasters caused by global climate change, a monitoring system applying remote sensing technology is being constructed in disaster areas. Among remote sensing platforms, the drone has been actively used in the private sector due to recent technological developments, and has been applied in the disaster areas owing to advantages such as timeliness and economical efficiency. This paper deals with the development of a preprocessing system that can map the drone image data in a near-real time manner as a basis for constructing the disaster monitoring system using the drones. For the research purpose, our system is based on the SURF algorithm which is one of the computer vision technologies. This system aims to performs the desired correction through the feature point matching technique between reference images and shot images. The study area is selected as the lower part of the Gahwa River and the Daecheong dam basin. The former area has many characteristic points for matching whereas the latter area has a relatively low number of difference, so it is possible to effectively test whether the system can be applied in various environments. The results show that the accuracy of the geometric correction is 0.6m and 1.7m respectively, in both areas, and the processing time is about 30 seconds per 1 scene. This indicates that the applicability of this study may be high in disaster areas requiring timeliness. However, in case of no reference image or low-level accuracy, the results entail the limit of the decreased calibration.

Atmospheric correction by Spectral Shape Matching Method (SSMM): Accounting for horizontal inhomogeneity of the atmosphere

  • Shanmugam Palanisamy;Ahn Yu-Hwan
    • Proceedings of the KSRS Conference
    • /
    • 2006.03a
    • /
    • pp.341-343
    • /
    • 2006
  • The current spectral shape matching method (SSMM), developed by Ahn and Shanmugam (2004), relies on the assumption that the path radiance resulting from scattered photons due to air molecules and aerosols and possibly direct-reflected light from the air-sea interface is spatially homogeneous over the sub-scene of interest, enabling the retrieval of water-leaving radiances ($L_w$) from the satellite ocean color image data. This assumption remains valid for the clear atmospheric conditions, but when the distribution of aerosol loadings varies dramatically the above postulation of spatial homogeneity will be violated. In this study, we present the second version of SSMM which will take into account the horizontal variations of aerosol loading in the correction of atmospheric effects in SeaWiFS ocean color image data. The new version includes models for the correction of the effects of aerosols and Raleigh particles and a method fur computation of diffuse transmittance ($t_{os}$) as similar to SeaWiFS. We tested this method over the different optical environments and compared its effectiveness with the results of standard atmospheric correction (SAC) algorithm (Gordon and Wang, 1994) and those from in-situ observations. Findings revealed that the SAC algorithm appeared to distort the spectral shape of water-leaving radiance spectra in suspended sediments (SS) and algal bloom dominated-areas and frequently yielded underestimated or often negative values in the lower green and blue part of the electromagnetic spectrum. Retrieval of water-leaving radiances in coastal waters with very high sediments, for instance = > 8g $m^{-3}$, was not possible with the SAC algorithm. As the current SAC algorithm does not include models for the Asian aerosols, the water-leaving radiances over the aerosol-dominated areas could not be retrieved from the image and large errors often resulted from an inappropriate extrapolation of the estimated aerosol radiance from two IR bands to visible spectrum. In contrast to the above results, the new SSMM enabled accurate retrieval of water-leaving radiances in a various range of turbid waters with SS concentrations from 1 to 100 g $m^{-3}$ that closely matched with those from the in-situ observations. Regardless of the spectral band, the RMS error deviation was minimum of 0.003 and maximum of 0.46, in contrast with those of 0.26 and 0.81, respectively, for SAC algorithm. The new SSMM also remove all aerosol effects excluding areas for which the signal-to-noise ratio is much lower than the water signal.

  • PDF

Iterative Precision Geometric Correction for High-Resolution Satellite Images (고해상도 위성영상의 반복 정밀 기하보정)

  • Son, Jong-Hwan;Yoon, Wansang;Kim, Taejung;Rhee, Sooahm
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.3
    • /
    • pp.431-447
    • /
    • 2021
  • Recently, the use of high-resolution satellites is increasing in many areas. In order to supply useful satellite images stably, it is necessary to establish automatic precision geometric correction technic. Geometric correction is the process that corrected geometric errors of satellite imagery based on the GCP (Ground Control Point), which is correspondence point between accurate ground coordinates and image coordinates. Therefore, in the automatic geometric correction process, it is the key to acquire high-quality GCPs automatically. In this paper, we proposed iterative precision geometry correction method. we constructed an image pyramid and repeatedly performed GCP chip matching, outlier detection, and precision sensor modeling in each layer of the image pyramid. Through this method, we were able to acquire high-quality GCPs automatically. we then improved the performance of geometric correction of high-resolution satellite images. To analyze the performance of the proposed method, we used KOMPSAT-3 and 3A Level 1R 8 scenes. As a result of the experiment, the proposed method showed the geometric correction accuracy of 1.5 pixels on average and a maximum of 2 pixels.

Efficient Image Retrieval using Minimal Spatial Relationships (최소 공간관계를 이용한 효율적인 이미지 검색)

  • Lee, Soo-Cheol;Hwang, Een-Jun;Byeon, Kwang-Jun
    • Journal of KIISE:Databases
    • /
    • v.32 no.4
    • /
    • pp.383-393
    • /
    • 2005
  • Retrieval of images from image databases by spatial relationship can be effectively performed through visual interface systems. In these systems, the representation of image with 2D strings, which are derived from symbolic projections, provides an efficient and natural way to construct image index and is also an ideal representation for the visual query. With this approach, retrieval is reduced to matching two symbolic strings. However, using 2D-string representations, spatial relationships between the objects in the image might not be exactly specified. Ambiguities arise for the retrieval of images of 3D scenes. In order to remove ambiguous description of object spatial relationships, in this paper, images are referred by considering spatial relationships using the spatial location algebra for the 3D image scene. Also, we remove the repetitive spatial relationships using the several reduction rules. A reduction mechanism using these rules can be used in query processing systems that retrieve images by content. This could give better precision and flexibility in image retrieval.

Design of Moving Picture Retrieval System using Scene Change Technique (장면 전환 기법을 이용한 동영상 검색 시스템 설계)

  • Kim, Jang-Hui;Kang, Dae-Seong
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.44 no.3
    • /
    • pp.8-15
    • /
    • 2007
  • Recently, it is important to process multimedia data efficiently. Especially, in case of retrieval of multimedia information, technique of user interface and retrieval technique are necessary. This paper proposes a new technique which detects cuts effectively in compressed image information by MPEG. A cut is a turning point of scenes. The cut-detection is the basic work and the first-step for video indexing and retrieval. Existing methods have a weak point that they detect wrong cuts according to change of a screen such as fast motion of an object, movement of a camera and a flash. Because they compare between previous frame and present frame. The proposed technique detects shots at first using DC(Direct Current) coefficient of DCT(Discrete Cosine Transform). The database is composed of these detected shots. Features are extracted by HMMD color model and edge histogram descriptor(EHD) among the MPEG-7 visual descriptors. And detections are performed in sequence by the proposed matching technique. Through this experiments, an improved video segmentation system is implemented that it performs more quickly and precisely than existing techniques have.

3D Reconstruction and Self-calibration based on Binocular Stereo Vision (스테레오 영상을 이용한 자기보정 및 3차원 형상 구현)

  • Hou, Rongrong;Jeong, Kyung-Seok
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.9
    • /
    • pp.3856-3863
    • /
    • 2012
  • A 3D reconstruction technique from stereo images that requires minimal intervention from the user has been developed. The reconstruction problem consists of three steps of estimating specific geometry groups. The first step is estimating the epipolar geometry that exists between the stereo image pairs which includes feature matching in both images. The second is estimating the affine geometry, a process to find a special plane in the projective space by means of vanishing points. The third step, which includes camera self-calibration, is obtaining a metric geometry from which a 3D model of the scene could be obtained. The major advantage of this method is that the stereo images do not need to be calibrated for reconstruction. The results of camera calibration and reconstruction have shown the possibility of obtaining a 3D model directly from features in the images.