• Title/Summary/Keyword: Seam Optimization

Search Result 13, Processing Time 0.019 seconds

Depth-based Image Stitching Using MegaDepth Network (MegaDepth Network를 활용한 깊이 기반 영상 스티칭)

  • Kim, Kahyun;Jang, Hyemin;Choi, Yujin;Rhee, Seongbae;Kim, Kyuheon
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2021.06a
    • /
    • pp.275-278
    • /
    • 2021
  • 영상 스티칭은 다수의 영상을 넓은 시야각을 갖는 하나의 영상으로 합성하여 사용자들에게 몰입감과 현장감을 제공하는 기술이다. 그러나 영상에 시차(Parallax)가 존재하는 경우 스티칭된 영상에서 왜곡이 발생할 수 있는데 이는 사용자의 몰입을 방해할 수 있다. 따라서 스티칭 영상의 다양한 활용을 위해서는 시차로 인한 왜곡을 최소화하여 자연스러운 스티칭 영상을 만드는 것이 중요하다. 기존 호모그래피 추정 방법으로 발생할 수 있는 고스트 현상을 최소화하기 위해서 seam 기반 스티칭 방법이 사용되었지만, 단순히 작은 특징값을 따라 생성된 seam은 사물 영역 정보가 반영되지 않아 seam이 특징이 있는 부분을 지나가면서 시차 왜곡이 발생할 수 있다. 이에 본 논문에서는 딥러닝 기반의 MegaDepth를 활용한 depth 예측 정보를 에너지 함수 기반의 seam 생성 행렬의 가중치로 사용하여 seam이 사물을 피해 생성되면서 시차가 작은 영역으로 유도되도록 하는 seam optimization 기법을 제안한다.

  • PDF

Image Stitching focused on Priority Object using Deep Learning based Object Detection (딥러닝 기반 사물 검출을 활용한 우선순위 사물 중심의 영상 스티칭)

  • Rhee, Seongbae;Kang, Jeonho;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.25 no.6
    • /
    • pp.882-897
    • /
    • 2020
  • Recently, the use of immersive media contents representing Panorama and 360° video is increasing. Since the viewing angle is limited to generate the content through a general camera, image stitching is mainly used to combine images taken with multiple cameras into one image having a wide field of view. However, if the parallax between the cameras is large, parallax distortion may occur in the stitched image, which disturbs the user's content immersion, thus an image stitching overcoming parallax distortion is required. The existing Seam Optimization based image stitching method to overcome parallax distortion uses energy function or object segment information to reflect the location information of objects, but the initial seam generation location, background information, performance of the object detector, and placement of objects may limit application. Therefore, in this paper, we propose an image stitching method that can overcome the limitations of the existing method by adding a weight value set differently according to the type of object to the energy value using object detection based on deep learning.

Fast Content-preserving Seam Estimation for Real-time High-resolution Video Stitching (실시간 고해상도 동영상 스티칭을 위한 고속 콘텐츠 보존 시접선 추정 방법)

  • Kim, Taeha;Yang, Seongyeop;Kang, Byeongkeun;Lee, Hee Kyung;Seo, Jeongil;Lee, Yeejin
    • Journal of Broadcast Engineering
    • /
    • v.25 no.6
    • /
    • pp.1004-1012
    • /
    • 2020
  • We present a novel content-preserving seam estimation algorithm for real-time high-resolution video stitching. Seam estimation is one of the fundamental steps in image/video stitching. It is to minimize visual artifacts in the transition areas between images. Typical seam estimation algorithms are based on optimization methods that demand intensive computations and large memory. The algorithms, however, often fail to avoid objects and results in cropped or duplicated objects. They also lack temporal consistency and induce flickering between frames. Hence, we propose an efficient and temporarily-consistent seam estimation algorithm that utilizes a straight line. The proposed method also uses convolutional neural network-based instance segmentation to locate seam at out-of-objects. Experimental results demonstrate that the proposed method produces visually plausible stitched videos with minimal visual artifacts in real-time.

Numerical simulation of pressure relief in hard coal seam by water jet cutting

  • Song, Dazhao;Wang, Enyuan;Xu, Jiankun;Liu, Xiaofei;Shen, Rongxi;Xu, Wenquan
    • Geomechanics and Engineering
    • /
    • v.8 no.4
    • /
    • pp.495-510
    • /
    • 2015
  • The applications of water jet cutting (WJC) in coal mine have progressed slowly. In this paper, we analyzed the possibility and reasonableness of WJC application to pressure relief in hard coal seam, simulated the distributive characteristics of stress and energy fields suffered by hard coal roadway wallrock and the internal relationships of the fields to the instability due to WJC (including horizontal radial slot and vertical annular slot) on roadway wallrock. The results showed that: (1) WJC can unload hard coal seam effectively by inducing stress release and energy dissipation in coal mass near its slots; its annular slots also can block or weaken stress and energy transfer in coal mass; (2) the two slots may cause "the beam structure" and "the small pillar skeleton", and "the layered energy reservoir structure", respectively, which lead to the increase in stress concentration and energy accumulation in coal element mass near the slots; (3) the reasonable design and optimization of slots' positions and their combination not only can significantly reduce the scope of stress concentration and energy accumulation, but also destroy coal mass structure on a larger scale to force stress to transfer deeper coal mass.

A Study on Development of the Optimization Algorithms to Find the Seam Tracking (용접선 추적을 위한 최적화 알고리즘 개발에 관한 연구)

  • Jin, Byeong-Ju;Lee, Jong-Pyo;Park, Min-Ho;Kim, Do-Hyeong;Wu, Qian-Qian;Kim, Il-Soo;Son, Joon-Sik
    • Journal of Welding and Joining
    • /
    • v.34 no.2
    • /
    • pp.59-66
    • /
    • 2016
  • The Gas Metal Arc(GMA) welding, called Metal Inert Gas(MIG) welding, has been an important component in manufacturing industries. A key technology for robotic welding processes is seam tracking system, which is critical to improve the welding quality and welding capacities. The objectives of this study were to develop the intelligent and cost-effective algorithms for image processing in GMA welding which based on the laser vision sensor. Welding images were captured from the CCD camera and then processed by the proposed algorithm to track the weld joint location. The proposed algorithms that commonly used at the present stage were verified and compared to obtain the optimal one for each step in image processing. Finally, validity of the proposed algorithms was examined by using weld seam images obtained with different welding environments for image processing. The results proved that the proposed algorithm was quite excellent in getting rid of the variable noises to extract the feature points and centerline for seam tracking in GMA welding and could be employed for general industrial application.

An Introduction to the Optimization Method for Weld Seam Positions using SA (SA를 이용한 선박의 용접선 배치 최적화 방법)

  • Kim, Yountae;Han, Myeong-Ki;Beak, Gyeong-Dong;Hwang, Joon-Seok;Lee, Dae-Hyung
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2013.05a
    • /
    • pp.540-543
    • /
    • 2013
  • 선박은 판과 보강재를 효율적으로 조립한 매우 복잡한 구조물이고, 이동하는 구조물로써는 최대규모의 구조물이다. 특히, 선체 구조의 설계란 "예상되는 모든 하중에 충분히 견딜 수 있는 강도(strength)와 강성(stiffness)을 가진 부재의 크기를 결정하고 적절히 배치하는 과정이다." 라고 말할 수 있다. 선체 구조의 설계는 부재의 배치가 얼마나 적절하게 잘되어 있는가에 달려 있다고 하여도 과언이 아닐 정도로 매우 중요하다. 주요 구조 부재의 부재 배치에 대한 기본적인 개념은 판 부재의 용접선(seam line), 종, 횡늑골의 간격, 종거어더 등을 예로 들 수 있으며, 부재의 배치는 최적 설계 및 공작상의 관점으로부터 선정되어야 하며, 또한 선체 전체의 구조적인 연결이 불연속이 되지 않도록 하여야 한다. 특히, 판 부재의 용접선은 여러 가지 표준치수로 생산되는 판 들 중, 판의 기준 폭이 얼마인 것을 사용하는 것이 공작상 또는 배치상 가장 편리한 가를 생각하여야 한다. 이것은 선박의 크기에 따라 다르겠지만, 조선소 크레인의 용량 및 가공상, 강도상의 문제를 고려하여 가능한 한용접선의 수를 줄이는 것이 바람직하다. 용접선을 줄이기 위해서는 판 부재의 폭을 넓게 하면 되나, 철강회사에서 표준으로 생산 판매하는 주판의 폭보다 넓은 판을 주문 구입 한다는 것은 곧 생산비용의 증가로 이어지는 것으로 이는 주판 구입 경비 측면에서는 바람직하지 않다. 따라 서, 주판 구입경비의 최소화를 유도하면서도 주판 폭의 적정 및 용접선 개수 최소화를 유지할 수 있도록 설계하는 것은 중요하지만, 용접선 배치의 문제는 다양한 입력 변수를 고려해야 하는 복잡한 문제이기 때문에 그간 최적화 관점에서 접근하지 못하고 시니어급 엔지니어가 가진 경험과 조선소의 지침서에 기재된 절차에 따라 대략적인 해를 결정하여 왔다. 본 연구는 이러한 복잡한 문제를 최적화 방법인 당금질(Simulated Annealing) 방법을 이용하여 해결한 결과를 소개하며, 그 결과와 효용성에 대해 논하도록 하겠다.

  • PDF

Parallax Distortion Detection and Correction Method for Video Stitching by using LDPM Image Assessment (LDPM 영상 평가를 활용한 동영상 스티칭의 시차 왜곡 검출 및 정정 방법)

  • Rhee, Seongbae;Kang, Jeonho;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.25 no.5
    • /
    • pp.685-697
    • /
    • 2020
  • Immersive media videos, such as panorama and 360-degree videos, must provide a sense of realism as if the user visited the space in the video, so they should be able to represent the reality of the real world. However, in panorama and 360-degree videos, objects appear to overlap or disappear due to parallax between cameras, and such parallax distortion may interfere with immersion of the user's content. Accordingly, although many video stitching algorithms have been proposed to overcome parallax distortion, parallax distortion still occurs due to the low performance of the Object detection module and limitations of the Seam generation method. Therefore, this paper analyzes the limitations of the existing video stitching technology and proposes a method for detecting and correcting parallax distortion of video stitching using the LDPM (Local Differential Pixel Mean) image evaluation method that overcomes the limitations of the video stitching technique.

Establishment of the roof model and optimization of the working face length in top coal caving mining

  • Chang-Xiang Wang;Qing-Heng Gu;Meng Zhang;Cheng-Yang Jia;Bao-Liang Zhang;Jian-Hang Wang
    • Geomechanics and Engineering
    • /
    • v.36 no.5
    • /
    • pp.427-440
    • /
    • 2024
  • This study concentrates on the 301 comprehensive caving working face, notable for its considerable mining height. The roof model is established by integrating prior geological data and the latest borehole rock stratum's physical and mechanical parameters. This comprehensive approach enables the determination of lithology, thickness, and mechanical properties of the roof within 50 m of the primary mining coal seam. Utilizing the transfer rock beam theory and incorporating mining pressure monitoring data, the study delves into the geometric parameters of the direct roof, basic roof movement, and roof pressure during the initial mining process of the 301 comprehensive caving working face. The direct roof of the mining working face is stratified into upper and lower sections. The lower direct roof consists of 6.0 m thick coarse sandstone, while the upper direct roof comprises 9.2 m coarse sandstone, 2.6 m sandy mudstone, and 2.8 m medium sandstone. The basic roof stratum, totaling 22.1 m in thickness, includes layers such as silty sand, medium sandstone, sandy mudstone, and coal. The first pressure step of the basic roof is 61.6 m, with theoretical research indicating a maximum roof pressure of 1.62 MPa during periodic pressure. Extensive simulations and analyses of roof subsidence and advanced abutment pressure under varying working face lengths. Optimal roof control effect is observed when the mining face length falls within the range of 140 m-155 m. This study holds significance as it optimizes the working face length in thick coal seams, enhancing safety and efficiency in coal mining operations.