• Title/Summary/Keyword: Image-to-image Translation

Search Result 306, Processing Time 0.035 seconds

Application of Deep Learning to Solar Data: 1. Overview

  • Moon, Yong-Jae;Park, Eunsu;Kim, Taeyoung;Lee, Harim;Shin, Gyungin;Kim, Kimoon;Shin, Seulki;Yi, Kangwoo
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.44 no.1
    • /
    • pp.51.2-51.2
    • /
    • 2019
  • Multi-wavelength observations become very popular in astronomy. Even though there are some correlations among different sensor images, it is not easy to translate from one to the other one. In this study, we apply a deep learning method for image-to-image translation, based on conditional generative adversarial networks (cGANs), to solar images. To examine the validity of the method for scientific data, we consider several different types of pairs: (1) Generation of SDO/EUV images from SDO/HMI magnetograms, (2) Generation of backside magnetograms from STEREO/EUVI images, (3) Generation of EUV & X-ray images from Carrington sunspot drawing, and (4) Generation of solar magnetograms from Ca II images. It is very impressive that AI-generated ones are quite consistent with actual ones. In addition, we apply the convolution neural network to the forecast of solar flares and find that our method is better than the conventional method. Our study also shows that the forecast of solar proton flux profiles using Long and Short Term Memory method is better than the autoregressive method. We will discuss several applications of these methodologies for scientific research.

  • PDF

3D Orientation and Position Tracking System of Surgical Instrument with Optical Tracker and Internal Vision Sensor (광추적기와 내부 비전센서를 이용한 수술도구의 3차원 자세 및 위치 추적 시스템)

  • Joe, Young Jin;Oh, Hyun Min;Kim, Min Young
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.22 no.8
    • /
    • pp.579-584
    • /
    • 2016
  • When surgical instruments are tracked in an image-guided surgical navigation system, a stereo vision system with high accuracy is generally used, which is called optical tracker. However, this optical tracker has the disadvantage that a line-of-sight between the tracker and surgical instrument must be maintained. Therefore, to complement the disadvantage of optical tracking systems, an internal vision sensor is attached to a surgical instrument in this paper. Monitoring the target marker pattern attached on patient with this vision sensor, this surgical instrument is possible to be tracked even when the line-of-sight of the optical tracker is occluded. To verify the system's effectiveness, a series of basic experiments is carried out. Lastly, an integration experiment is conducted. The experimental results show that rotational error is bounded to max $1.32^{\circ}$ and mean $0.35^{\circ}$, and translation error is in max 1.72mm and mean 0.58mm. Finally, it is confirmed that the proposed tool tracking method using an internal vision sensor is useful and effective to overcome the occlusion problem of the optical tracker.

A study on development of automatic welding system for corrugated membranes of the LNG tank (LNG 탱크의 주름진 내벽박판용 자동용접시스템의 개발에 관한 연구)

  • 유제용;유원상;나석주;강계형;한용섭
    • Journal of Welding and Joining
    • /
    • v.14 no.1
    • /
    • pp.99-106
    • /
    • 1996
  • Development of an automatic TIG welding system incorporating a vision sensor and torch control mechanism leads to an improved welding quality and greater production efficiency. The automatic welding system should be greatly restricted in its size and weight for the LNG(Liquefied Natural Gas) storage tank and also provide a unique torch rotating mechanism which keeps the torch tip in the constant position while the angle is changed continuously to maintain the welding torch substantially perpendicular to the weld line. The developed system is driven by two translation axes X, Z and one rotational axis. A moving line window method is adopted to the image recognition of the corrugated membranes with specular reflection. This method decides original laser stripe patterns in image which is affected by multi-reflection. A self-teaching algorithm, which guides the automatic welding machine with the information provided by the CCD camera without any previous learning of a reference trajectory, was developed for tracking the corrugated membrane of the LNG tank along the weld line.

  • PDF

A Comparison of PCA, LDA, and Matching Methods for Face Recognition (얼굴인식을 위한 PCA, LDA 및 정합기법의 비교)

  • 박세제;박영태
    • Journal of KIISE:Software and Applications
    • /
    • v.30 no.3_4
    • /
    • pp.372-378
    • /
    • 2003
  • Limitations on the linear discriminant analysis (LDA) for face rerognition, such as the loss of generalization and the computational infeasibility, are addressed and illustrated for a small number of samples. The principal component analysis (PCA) followed by the LDA mapping may be an alternative that ran overcome these limitations. We also show that any schemes based on either mappings or template matching are vulnerable to image variations due to rotation, translation, facial expressions, or local illumination conditions. This entails the importance of a proper preprocessing that can compensate for such variations. A simple template matching, when combined with the geometrically correlated feature-based detection as a preprocessing, is shown to outperform mapping techniques in terms of both the accuracy and the robustness to image variations.

A Study of Measurement of In-plane Displacement by CW Laser Speckle Photography and Image Processing (연속파 레이저 스페클 사진법(寫眞法)과 화상처리(畵像處理)에 의한 면내섭위(面內燮位) 측정(測定)에 관한 연구(硏究))

  • Kim, K.S.;Na, G.D.;Kim, T.H.;Chung, N.K.;Kim, C.W.
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.10 no.1
    • /
    • pp.47-55
    • /
    • 1990
  • This paper presents experimental results which explore the capability of a CW laser speckle photography for tile measurement of in-plane displacement at high temperature. The serious restrictions on the application of the method seem to be the ambient air turbulence and the change of surface texture caused by the oxidation, as they tend to decorrelate the double exposured speckle patterns. In order to assess only the effect of air turbulence, a ceramics-coated stainless steel plate is heated in air and Ar-laser specklegrams are made with combination of temperature and lateral translation displacement. The slight reduction in visibility of Young's fringes is observed at $1000^{\circ}C$. The analyses of Young's fringes are carried out by a image processing system using a TV-camera and computers, and the result agrees well with the micrometer reading. Futhermore, uncoated stainless steel and Hastelloy X plates are tested and the effect of oxidation is also evaluated. The experimental results demonstrate that a CW laser speckle photography is applicable at temperatures up to $1000^{\circ}C$.

  • PDF

A Head-Eye Calibration Technique Using Image Rectification (영상 교정을 이용한 헤드-아이 보정 기법)

  • Kim, Nak-Hyun;Kim, Sang-Hyun
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.37 no.8
    • /
    • pp.11-23
    • /
    • 2000
  • Head-eye calibration is a process for estimating the unknown orientation and position of a camera with respect to a mobile platform, such as a robot wrist. We present a new head-eye calibration technique which can be applied for platforms with rather limited motion capability In particular, the proposed calibration technique can be applied to find the relative orientation of a camera mounted on a linear translation platform which does not have rotation capability. The algorithm find the rotation using a calibration data obtained from pure Translation of a camera along two different axes We have derived a calibration algorithm exploiting the rectification technique in such a way that the rectified images should satisfy the epipolar constraint. We present the calibration procedure for both the rotation and the translation components of a camera relative to the platform coordinates. The efficacy of the algorithm is demonstrated through simulations and real experiments.

  • PDF

Object Recogniton for Markerless Augmented Reality Embodiment (마커 없는 증강 현실 구현을 위한 물체인식)

  • Paul, Anjan Kumar;Lee, Hyung-Jin;Kim, Young-Bum;Islam, Mohammad Khairul;Baek, Joong-Hwan
    • Journal of Advanced Navigation Technology
    • /
    • v.13 no.1
    • /
    • pp.126-133
    • /
    • 2009
  • In this paper, we propose an object recognition technique for implementing marker less augmented reality. Scale Invariant Feature Transform (SIFT) is used for finding the local features from object images. These features are invariant to scale, rotation, translation, and partially invariant to illumination changes. Extracted Features are distinct and have matched with different image features in the scene. If the trained image is properly matched, then it is expected to find object in scene. In this paper, an object is found from a scene by matching the template images that can be generated from the first frame of the scene. Experimental results of object recognition for 4 kinds of objects showed that the proposed technique has a good performance.

  • PDF

Block Based Blind & Secure Gray Image Watermarking Technique Based on Discrete Wavelet Transform and Singular Value Decomposition

  • Imran, Muhammad;Harvey, Bruce A.
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.2
    • /
    • pp.883-900
    • /
    • 2017
  • In this paper block based blind secure gray image watermarking scheme based on discrete wavelet transform and singular value decomposition is proposed. In devising the proposed scheme, security is given high importance along with other two requirements: robustness and imperceptibility. The use of discrete wavelet transform not only improves robustness but the selection of bands with high tolerance towards noise caused an improvement in terms of imperceptibility. The robustness further improved due to the involvement of singular vectors along with singular values in watermark embedding and extraction process. Finally, to achieve security, the selected DWT band is decomposed into smaller blocks and random blocks are chosen for modification. Furthermore, the elements of left and right singular vectors of selected blocks are chosen based on their dependence upon each other for watermark embedding. Various experiments using different images as host and watermark were conducted to examine and validate the proposed technique. Additionally, the proposed technique is tested against various attacks like compression, affine transformation, cropping, translation, X shearing, scaling, Y shearing, filtering, blurring, different kinds of noises, histogram equalization, rotation, etc. Lastly, the proposed technique is compared with state-of-the-art watermarking techniques and their comparison shows significant improvement of proposed scheme over existing techniques.

The Visual Guide to over 800 species of the Cyber Sea-Shell Museum on the Web using an Animation Technology

  • Lim, Eun-Im;Hong, Sung-Soo
    • Annual Conference of KIPS
    • /
    • 2000.10b
    • /
    • pp.1345-1348
    • /
    • 2000
  • Computers and communication technologies have been brought tremendous change to various aspects of an ever-fast changing world at present. Particularly, the use of internet and cyberspace is widespread in every comer of our life. We developed a cyber shell museum using an animation technology. It was developed for educational purposes, and accessible through the world wide web of internet. Cyber shell museum is consisted of five compartment including rare shells, marvelous shells, shell of the world, the shell of Korea and its story of shells. The database contains the pictures and related information of the shell and it implies not only animation display but also text information. The files of database were classified depending on the species, genus, family, order, and class and division of the shell. Picture of shells is displayed and user may reach the image and virtual view information by clicking through the object displayed. This provides multiple techniques to user may manipulate, visualize and interact with image on the web. And every such transformation as translation, rotation, and scaling can be applied in the picture interactively for the convenient and effective viewing.

  • PDF

Registration between High-resolution Optical and SAR Images Using linear Features (선형정보를 이용한 고해상도 광학영상과 SAR 영상 간 기하보정)

  • Han, You-Kyung;Kim, Duk-Jin;Kim, Yong-Il
    • Korean Journal of Remote Sensing
    • /
    • v.27 no.2
    • /
    • pp.141-150
    • /
    • 2011
  • Precise image-to-image registration is required to process multi-sensor data together. The purpose of this paper is to develop an algorithm that register between high-resolution optical and SAR images using linear features. As a pre-processing step, initial alignment was fulfilled using manually selected tie points to remove any dislocations caused by scale difference, rotation, and translation of images. Canny edge operator was applied to both images to extract linear features. These features were used to design a cost function that finds matching points based on their similarity. Outliers having larger geometric differences than general matching points were eliminated. The remaining points were used to construct a new transformation model, which was combined the piecewise linear function with the global affine transformation, and applied to increase the accuracy of geometric correction.