• Title/Summary/Keyword: Image-to-image Translation

Search Result 306, Processing Time 0.03 seconds

Image Translation: Verifiable Image Transformation Networks for Face Sketch-Photo and Photo-Sketch (영상변형:얼굴 스케치와 사진간의 증명가능한 영상변형 네트워크)

  • Sung, Thai-Leang;Lee, Hyo-Jong
    • Annual Conference of KIPS
    • /
    • 2019.05a
    • /
    • pp.451-454
    • /
    • 2019
  • In this paper, we propose a verifiable image transformation networks to transform face sketch to photo and vice versa. Face sketch-photo is very popular in computer vision applications. It has been used in some specific official departments such as law enforcement and digital entertainment. There are several existing face sketch-photo synthesizing methods that use feed-forward convolution neural networks; however, it is hard to assure whether the results of the methods are well mapped by depending only on loss values or accuracy results alone. In our approach, we use two Resnet encoder-decoder networks as image transformation networks. One is for sketch-photo and another is for photo-sketch. They depend on each other to verify their output results during training. For example, using photo-sketch transformation networks to verify the photo result of sketch-photo by inputting the result to the photo-sketch transformation networks and find loss between the reversed transformed result with ground-truth sketch. Likely, we can verify the sketch result as well in a reverse way. Our networks contain two loss functions such as sketch-photo loss and photo-sketch loss for the basic transformation stages and the other two-loss functions such as sketch-photo verification loss and photo-sketch verification loss for the verification stages. Our experiment results on CUFS dataset achieve reasonable results compared with the state-of-the-art approaches.

Verify Image-Guided Shifts for 6DoF Couch using Yonsei Cancer Center QA Set (Yonsei Cancer Center QA Set을 이용한 6DoF Couch의 이동 정확성 검증)

  • Jung, Dongmin;Park, Hyokuk;Yoon, Jongwon;Lee, Sangkyu;Kim, Jooho;Cho, Jeonghee
    • The Journal of Korean Society for Radiation Therapy
    • /
    • v.29 no.1
    • /
    • pp.7-18
    • /
    • 2017
  • Purpose: A QA Set was established to verify the movement accuracy of image-guided 6DoF Couch and to evaluate its usefulness. Materials and Methods: Two sets of linear accelerators equipped with 6DoF Couch and CBCT were used. Using the established QA Set, each CBCT image was obtained over 15 times through the Penta-Guide Phantom installed with off-set shift values along six translational (Translation; TX, TY, TZ) and rotational (Rotation, Pitch; RX, Roll; RY, Yaw; RZ) directions. Using this method, we compared the reference image and the registration image, and we analyzed the error calculated by measuring the positional accuracy of the modified 6DoF Couch. Results: The Air Cavity corresponding to the Pixel of the reference image and the registration image were all contained between 30 and 66, and the revealing high registration accuracy. Error between the modified off-set value of 6DoF Couch and the measured value along translational directions were $0.25{\pm}0.18mm$ in the TX direction, $0.25{\pm}0.25mm$ in the TY direction, and $0.36{\pm}0.2mm$ in the TZ direction. Misalignments along the rotational axis were $0.18{\pm}0.08^{\circ}$ in the RX direction, $0.26{\pm}0.09^{\circ}$ in the RY direction, and $0.11{\pm}0.08^{\circ}$ in the RZ direction, it was corrected precisely for any value. Conclusion: Using the YCC QA Set, we were able to verify the error of 6DoF Couch along both the translational and rotational directions in a very simple method. This system would be useful in performing Daily IGRT QA of 6DoF Couch.

  • PDF

Measurement of object depth information using two CCD camera (두 대의 CCD 카메라를 이용한 물체의 깊이정보 측정)

  • 전정희;노경완;김충원
    • Proceedings of the IEEK Conference
    • /
    • 1998.06a
    • /
    • pp.693-696
    • /
    • 1998
  • For camera calibration, this paper describes two steps to camera constants and camera parameters. The former is the radial distortion of lens, image center and focal length etc.. The latter is translation, rotation etc.. Camera calibration use tsai's algorithm. In this paper, the solutions are introduced into overdetermined system as matching points that are acquired from two CCD and measured object depth information.

  • PDF

Shear Band Formation in Granular Materials with Different Particle Shapes behind a Retaining Wall

  • Zhuang, Li;Kim, Ukgie
    • Journal of the Korean GEO-environmental Society
    • /
    • v.14 no.9
    • /
    • pp.39-47
    • /
    • 2013
  • Local deformations in back filling materials of two sands and one glass bead with different particle shapes behind a rigid retaining wall were studied. Two kinds of boundary conditions were compared: active wall translation and active rotation of the wall about its toe. Effect of the speed of active wall translation was also investigated. The digital image correlation method was used to analyze local deformation developments inside the materials. Test results showed that particle shape and density mainly influence the inclination angle and width of the shear band. The general shear band pattern is strongly dependent on the wall movement mode, while it was little influenced by particle shape. Within a limited range of wall speed in this study, shear band became wider and local deformation became larger with increase of wall speed.

A Study on Auto Inspection System of Cross Coil Movement Using Machine Vision (머신비젼을 이용한 Cross Coil Movement 자동검사 시스템에 관한 연구)

  • Lee, Chul-Hun;Seol, Sung-Wook;Joo, Jae-Heum;Lee, Sang-Chan;Nam, Ki-Gon
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.36S no.11
    • /
    • pp.79-88
    • /
    • 1999
  • In this paper we address the tracking method which tracks only target object in image sequence including moving object. We use a contour tracking algorithm based on intensity and motion boundaries. The motion of the moving object contour in the image is assumed to be well describable by an affine motion model with a translation, a change in scale and a rotation. The moving object contour is represented by B-spline, the position and motion of which is estimated along the image sequence. we use pattern recognition to identify target object. In order to use linear Kalman Filters we decompose the estimation process into two filters. One is estimating the affine motion parameters and the other the shape of moving object contour. In some experiments with dial plate we show that this method enables us to obtain the robust motion estimates and tracking trajectories even in case of including obstructive object.

  • PDF

A Novel Multi-focus Image Fusion Technique Using Directional Multiresolution Transform (방향성 다해상도 변환을 사용한 새로운 다중초점 이미지 융합 기법)

  • Park, Dae-Chul;Atole, Ronnel R.
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.9 no.4
    • /
    • pp.59-68
    • /
    • 2009
  • This paper addresses a hybrid multi-focus image fusion scheme using the recent curvelet transform constructions. Hybridization is obtained by combining the MS fusion rule with a novel "copy" method. The proposed scheme use MS rule to fuse the m most significant terms in spectrum of an image at each decomposition level. The scheme is dubbed in this work as m-term fusion in adherence to its use of the MSC (most significant coefficients) in the transform set at any given scale, orientation, and translation. We applied the edge-sensitive objective quality measure proposed by Xydeas and Petrovic to evaluate the method. Experimental results show that the proposed scheme is a potential alternative to the redundant, shift-invariant Dual-Tree Complex Wavelet transforms. In particular, it was confirmed that a 50% m-term fusion produces outputs with no visible quality degradation.

  • PDF

Cycle-Consistent Generative Adversarial Network: Effect on Radiation Dose Reduction and Image Quality Improvement in Ultralow-Dose CT for Evaluation of Pulmonary Tuberculosis

  • Chenggong Yan;Jie Lin;Haixia Li;Jun Xu;Tianjing Zhang;Hao Chen;Henry C. Woodruff;Guangyao Wu;Siqi Zhang;Yikai Xu;Philippe Lambin
    • Korean Journal of Radiology
    • /
    • v.22 no.6
    • /
    • pp.983-993
    • /
    • 2021
  • Objective: To investigate the image quality of ultralow-dose CT (ULDCT) of the chest reconstructed using a cycle-consistent generative adversarial network (CycleGAN)-based deep learning method in the evaluation of pulmonary tuberculosis. Materials and Methods: Between June 2019 and November 2019, 103 patients (mean age, 40.8 ± 13.6 years; 61 men and 42 women) with pulmonary tuberculosis were prospectively enrolled to undergo standard-dose CT (120 kVp with automated exposure control), followed immediately by ULDCT (80 kVp and 10 mAs). The images of the two successive scans were used to train the CycleGAN framework for image-to-image translation. The denoising efficacy of the CycleGAN algorithm was compared with that of hybrid and model-based iterative reconstruction. Repeated-measures analysis of variance and Wilcoxon signed-rank test were performed to compare the objective measurements and the subjective image quality scores, respectively. Results: With the optimized CycleGAN denoising model, using the ULDCT images as input, the peak signal-to-noise ratio and structural similarity index improved by 2.0 dB and 0.21, respectively. The CycleGAN-generated denoised ULDCT images typically provided satisfactory image quality for optimal visibility of anatomic structures and pathological findings, with a lower level of image noise (mean ± standard deviation [SD], 19.5 ± 3.0 Hounsfield unit [HU]) than that of the hybrid (66.3 ± 10.5 HU, p < 0.001) and a similar noise level to model-based iterative reconstruction (19.6 ± 2.6 HU, p > 0.908). The CycleGAN-generated images showed the highest contrast-to-noise ratios for the pulmonary lesions, followed by the model-based and hybrid iterative reconstruction. The mean effective radiation dose of ULDCT was 0.12 mSv with a mean 93.9% reduction compared to standard-dose CT. Conclusion: The optimized CycleGAN technique may allow the synthesis of diagnostically acceptable images from ULDCT of the chest for the evaluation of pulmonary tuberculosis.

A Object-Based Image Retrieval Using Feature Analysis and Fractal Dimension (특징 분석과 프랙탈 차원을 이용한 객체 기반 영상검색)

  • 이정봉;박장춘
    • Journal of Korea Multimedia Society
    • /
    • v.7 no.2
    • /
    • pp.173-186
    • /
    • 2004
  • This paper proposed the content-based retrieval system as a method for performing image retrieval through the effective feature extraction of the object of significant meaning based on the characteristics of man's visual system. To allow the object region of interest to be primarily detected, the region, being comparatively large size, greatly different from the background color and located in the middle of the image, was judged as the major object with a meaning. To get the original features of the image, the cumulative sum of tile declination difference vector the segment of the object contour had and the signature of the bipartite object were extracted and used in the form of being applied to the rotation of the object and the change of the size after partition of the total length of the object contour of the image into the normalized segment. Starting with this form feature, it was possible to make a retrieval robust to any change in translation, rotation and scaling by combining information on the texture sample, color and eccentricity and measuring the degree of similarity. It responded less sensitively to the phenomenon of distortion of the object feature due to the partial change or damage of the region. Also, the method of imposing a different weight of similarity on the image feature based on the relationship of complexity between measured objects using the fractal dimension by the Boxing-Counting Dimension minimized the wrong retrieval and showed more efficient retrieval rate.

  • PDF

Image Retrieval Using the Fusion of Spatial Histogram and Wavelet Moments (공간 히스토그램과 웨이브렛 모멘트의 융합에 의한 영상검색)

  • Seo, Sang-Yong;Kim, Nam-Cheol
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.38 no.4
    • /
    • pp.434-441
    • /
    • 2001
  • We present an image retrieval method for improving retrieval performance by the effective fusion of spatial histogram and wavelet moments. In this method, the similarity for spatial histograms and the similarity for wavelet moment are effectively fused in the computation of the similarity between a query image and DB image. That is, the wavelet moments feature represented in multi-resolution and the spatial histogram feature robust to translation and rotation are used to improve retrieval performance. In order to evaluate the performance of the proposed method, we use Brodatz texture DB, MPEG-7 T1 DB, and Corel Draw Photo DB. Experimental results show that the proposed method yields 5.3% and 13.8% better Performances for Brodatz DB, and 15.5% and 3.2% better Performances for Corel Draw Photo DB over the histogram method and the wavelet moment method, respectively.

  • PDF

CNN-based Online Sign Language Translation Counseling System (CNN기반의 온라인 수어통역 상담 시스템에 관한 연구)

  • Park, Won-Cheol;Park, Koo-Rack
    • Journal of Convergence for Information Technology
    • /
    • v.11 no.5
    • /
    • pp.17-22
    • /
    • 2021
  • It is difficult for the hearing impaired to use the counseling service without sign language interpretation. Due to the shortage of sign language interpreters, it takes a lot of time to connect to sign language interpreters, or there are many cases where the connection is not available. Therefore, in this paper, we propose a system that captures sign language as an image using OpenCV and CNN (Convolutional Neural Network), recognizes sign language motion, and converts the meaning of sign language into textual data and provides it to users. The counselor can conduct counseling by reading the stored sign language translation counseling contents. Consultation is possible without a professional sign language interpreter, reducing the burden of waiting for a sign language interpreter. If the proposed system is applied to counseling services for the hearing impaired, it is expected to improve the effectiveness of counseling and promote academic research on counseling for the hearing impaired in the future.