• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.38 no.6
• /
• pp.611-622
• /
• 2020

As the advancement of technologies on indoor positioning systems and measuring devices such as LiDAR (Light Detection And Ranging) and cameras, the demands on analyzing and searching indoor spaces and visualization services via virtual and augmented reality have rapidly increasing. To this end, it is necessary to model 3D objects from measured data from real-world structures. In addition, it is important to store these structured data in standardized formats to improve the applicability and interoperability. In this paper, we propose a method to construct IndoorGML data, which is an international standard for indoor modeling, from point cloud data acquired from LiDAR sensors. After examining considerations that should be addressed in IndoorGML data, we present a construction method, which consists of free space extraction and connectivity detection processes. With experimental results, we demonstrate that the proposed method can effectively reconstruct the 3D model from point cloud.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.6
• /
• pp.807-812
• /
• 2021

In order to be able to interact with the user to experience it as if it were real in virtual reality contents, input/output devices that make them feel the five senses of humans are required . In virtual reality (VR), devices that stimulate sight and hearing are the most representative. For a more realistic experience, suits and gloves that stimulate the sense of touch have recently been released, but there are not many cases applied to actual contents due to the limitation of device . In this paper, we analyze a virtual reality glove that can detect hand movement and touch in a virtual world. Based on the analysis, we propose an algorithm that can sense the intensity of collision with a VR object by tactile sense by improving the UI/UX using the vibration of the feedback method used in the existing virtual reality glove. In addition, the system implemented by the algorithm is applied to an actual case.

• KIPS Transactions on Software and Data Engineering
• /
• v.12 no.2
• /
• pp.83-90
• /
• 2023

Blurred image is an important factor in lowering image recognition rates in Computer vision. This mainly occurs when the camera is unstablely out of focus or the object in the scene moves quickly during the exposure time. Blurred images greatly degrade visual quality, weakening visibility, and this phenomenon occurs frequently despite the continuous development digital camera technology. In this paper, it replace the modified building module based on the Deep multi-patch neural network designed with convolution neural networks to capture details of input images and Attention techniques to focus on objects in blurred images in many ways and strengthen the image. It measures and assigns each weight at different scales to differentiate the blurring of change and restores from rough to fine levels of the image to adjust both global and local region sequentially. Through this method, it show excellent results that recover degraded image quality, extract efficient object detection and features, and complement color constancy.

• Smart Media Journal
• /
• v.11 no.11
• /
• pp.25-31
• /
• 2022

Deep learning-based image processing is essential for autonomous vehicles. To process road images in real-time in a System-on-Chip (SoC) environment, we need to execute deep learning models on a NPU (Neural Procesing Units) specialized for deep learning operations. In this study, we imported seven open-source image processing deep learning models, that were developed on GPU servers, to Texas Instrument Deep Learning (TIDL) NPU environment. We confirmed that the models imported in this study operate normally in the SoC virtual environment through performance evaluation and visualization. This paper introduces the problems that occurred during the migration process due to the limitations of NPU environment and how to solve them, and thereby, presents a reference case worth referring to for developers and researchers who want to port deep learning models to SoC environments.

• The Journal of Bigdata
• /
• v.8 no.1
• /
• pp.73-82
• /
• 2023

Marine debris not only affects the survival of marine life, water pollution, and scenery but also has secondary effects on economic loss and human health. While research on underwater and surface debris is actively ongoing, solutions to marine debris in hard-to-reach blind spots are being developed slowly. To address this problem, we utilize drones to detect and track marine debris in blind spots such as tetrapods. The detected debris is then visualized by calculating its location coordinates using the drone's GPS, altitude, and heading values. The proposed method of using drones for detecting marine debris and matching it with longitude and latitude coordinates provides an effective solution to the problem of marine debris in blind spots.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2022.05a
• /
• pp.6-6
• /
• 2022

최근 수재해에 대응하기 위한 물관리 환경은 기후변화에 따른 홍수 피해 심화와 댐과 하천 시설의 노후화 점증, 하천관리일원화 등 정책적 변화, 그리고 포스트코로나 디지털 혁신 등 복합적 대전환 시대 진입에 따라 복잡다단한 양상을 보이고 있다. 디지털 트윈은 디지털 대전환(digital transformation) 시대 다양한 산업 영역에서 지능화와 생산성 향상을 목적으로 도입되고 있다. 본 국가 시범사업에서는 170 km에 달하는 섬진강 유역 전체를 대상으로 홍수에 대응하기 위한 디지털 트윈 플랫폼(K-Twin SJ)을 구축하고 있다. 본 플랫폼은 국가 인프라 지능정보화 사업의 일환으로 시작되었으며, 공간정보와 시설물 모델링, 홍수 분석 등 수재해에 대응하기 위한 수자원 분야의 다학제적인 강소기업들과 K-water에서 컨소시엄을 구성하여 추진하고 있다. 본 사업의 내용은 섬진강 댐-하천 유역에 대하여 고정밀도 3D 공간정보화, 실시간 물관리 데이터 연계, 홍수 분석 시뮬레이션, AI 댐 운영 최적화, AI 사면 정보 생성, 하천 제방 안전성 평가, AI 지능형 CCTV 영상분석, 간이 침수피해 예측, 드론 제약사항 조사 체계 개발을 포함하고 있다. 물관리 데이터와 하천 시설정보를 트윈 플랫폼 상에서 위치기반으로 시각화 표출하기 위해서는 유역의 공간정보를 3차원으로 구축하는 과정이 필수적이다. 따라서 GIS 기반의 섬진강 하천 중심 공간정보 구축을 위해 유역의 국가 정사영상과 5m 수치표고모형(DEM)은 최신성과를 협조 받아 적용하였으며, 홍수 분석을 위한 하천 중심 공간정보는 신규 헬기에 LiDAR 매핑을 수행하여 0.5m 급 DEM을 신규 구축하였다. 또한 하천 시설물 중 섬진강댐과 79개 주요 하천 횡단 교량과 3개 보 시설을 지상기준점 측량과 드론 매핑, 패턴 방식의 경량화 작업을 통해 트윈에 탑재할 수 있는 시설물 3D 객체 모델을 제작하였다. 홍수 분석을 위해서는 섬진강 유역에 대해 K-Drum, K-River, K-Flood 모델을 구축하였으며, AI 하천 수위 예측 학습 모델을 개발하였다. 섬진강 디지털 트윈 유역 물관리 플랫폼을 통해 데이터 기반의 똑똑한 물관리를 구현하고자 한다.

• Korean Journal of Remote Sensing
• /
• v.39 no.6_1
• /
• pp.1283-1297
• /
• 2023

Mid-wave infrared (MWIR) imagery, due to its ability to capture the temperature of land cover and objects, serves as a crucial data source in various fields including environmental monitoring and defense. The KOMPSAT-3A satellite acquires MWIR imagery with high spatial resolution compared to other satellites. However, the limited spatial resolution of MWIR imagery, in comparison to electro-optical (EO) imagery, constrains the optimal utilization of the KOMPSAT-3A data. This study aims to create a highly visible MWIR fusion image by leveraging the edge information from the KOMPSAT-3A panchromatic (PAN) image. Preprocessing is implemented to mitigate the relative geometric errors between the PAN and MWIR images. Subsequently, we employ a pre-trained pixel difference network (PiDiNet), a deep learning-based edge information extraction technique, to extract the boundaries of objects from the preprocessed PAN images. The MWIR fusion imagery is then generated by emphasizing the brightness value corresponding to the edge information of the PAN image. To evaluate the proposed method, the MWIR fusion images were generated in three different sites. As a result, the boundaries of terrain and objects in the MWIR fusion images were emphasized to provide detailed thermal information of the interest area. Especially, the MWIR fusion image provided the thermal information of objects such as airplanes and ships which are hard to detect in the original MWIR images. This study demonstrated that the proposed method could generate a single image that combines visible details from an EO image and thermal information from an MWIR image, which contributes to increasing the usage of MWIR imagery.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.41 no.2
• /
• pp.113-130
• /
• 2004

Most multimedia data contain text to emphasize the meaning of the data, to present additional explanations about the situation, or to translate different languages. But, the left makes it difficult to reuse the images, and distorts not only the original images but also their meanings. Accordingly, this paper proposes a support vector machines (SVMs) and spatiotemporal restoration-based approach for automatic text detection and removal in video sequences. Given two consecutive frames, first, text regions in the current frame are detected by an SVM-based texture classifier Second, two stages are performed for the restoration of the regions occluded by the detected text regions: temporal restoration in consecutive frames and spatial restoration in the current frame. Utilizing text motion and background difference, an input video sequence is classified and a different temporal restoration scheme is applied to the sequence. Such a combination of temporal restoration and spatial restoration shows great potential for automatic detection and removal of objects of interest in various kinds of video sequences, and is applicable to many applications such as translation of captions and replacement of indirect advertisements in videos.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.30 no.1
• /
• pp.39-48
• /
• 2012

Filtering process that separates ground and non-ground points from LIDAR data is important in order to create the digital elevation model (DEM) or extract objects on the ground. The purpose of this research is to select the most effective filtering algorithm through qualitative and quantitative analysis for the existing filtering method used to extract ground points from LIDAR data. For this, four filtering methods including Adaptive TIN(ATIN), Perspective Center-based filtering method(PC), Elevation Threshold with Expand Window(ETEW) and Progressive Morphology(PM) were applied to mountain area, urban area and the area where building and mountains exist together. Then the characteristics for each method were analyzed. For the qualitative comparison of four filtering methods used for the research, visual method was applied after creating shaded relief image. For the quantitative comparison, an absolute comparison was conducted by using control points observed by GPS and a relative comparison was conducted by the digital elevation model of the National Geographic Information Institute. Through the filtering experiment of the LIDAR data, the Adaptive TIN algorithm extracted the ground points in mountain area and urban area most effectively. In the area where buildings and mountains coexist, progressive morphology algorithm generated the best result. In addition, as a result of qualitative and quantitative comparisons, the applicable filtering algorithm regardless of topographic characteristics appeared to be ATIN algorithm.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.28 no.6
• /
• pp.579-586
• /
• 2010

Due to the recent development of measuring technology and 3D programs, it has become possible to obtain various spatial data. This study utilizes the 2-dimensional data and 3-dimensional data extraction technology based on the existing empirical and statistical DB. The data obtained from geospatial data technology are integrated with civil engineering BIM to conduct the modeling of the topography of the target region and select the optimum location condition by using the cut and fill balance of the volume of earth. The target area is the land around Tamjin River, Jangheong-gun, Jeolla-do. The 3-dimensional topology linked with 3-dimensional mapping technology by using the orth-image and aerial LiDAR that uses aerial photo of the target area is visualized with Civil3D of AutoDesk. By using Civil3D program, the Thanks to the recent development of measuring technology and 3D programs, target area is analyzed through visualization and related data can be obtained for analysis. The method of using civil engineering BIM enables to obtain various and accurate information about the target area which is helpful for addressing the issues risen from the existing methodology. In this regard, it aims at searching for the alternatives and provides suggestions to utilize the information.