• Title/Summary/Keyword: TimeGan

Search Result 138, Processing Time 0.026 seconds

A New Image Processing Scheme For Face Swapping Using CycleGAN (순환 적대적 생성 신경망을 이용한 안면 교체를 위한 새로운 이미지 처리 기법)

  • Ban, Tae-Won
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.9
    • /
    • pp.1305-1311
    • /
    • 2022
  • With the recent rapid development of mobile terminals and personal computers and the advent of neural network technology, real-time face swapping using images has become possible. In particular, the cycle generative adversarial network made it possible to replace faces using uncorrelated image data. In this paper, we propose an input data processing scheme that can improve the quality of face swapping with less training data and time. The proposed scheme can improve the image quality while preserving facial structure and expression information by combining facial landmarks extracted through a pre-trained neural network with major information that affects the structure and expression of the face. Using the blind/referenceless image spatial quality evaluator (BRISQUE) score, which is one of the AI-based non-reference quality metrics, we quantitatively analyze the performance of the proposed scheme and compare it to the conventional schemes. According to the numerical results, the proposed scheme obtained BRISQUE scores improved by about 4.6% to 14.6%, compared to the conventional schemes.

The Novel Label Free Staining Algorithm in Digital Pathology (차세대 디지털 병리를 위한 Label Free 디지털염색 알고리즘 비교 연구)

  • Seok-Min Hwang;Yeun-Woo Jung;Dong-Bum Kim;Seung Ah Lee;Nam Hoon Cho;Jong-Ha Lee
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.24 no.1
    • /
    • pp.76-81
    • /
    • 2023
  • To distinguish cancer cells from normal cells, H&E (Hematoxylin & Eosin) staining is required. Pathological staining requires a lot of money and time. Recently, a digital dyeing method has been introduced to reduce such cost and time. In this paper, we propose a novel digital pathology algorithms. The first algorithm is the Pair method. This method learns the dyed phase image and unstained amplitude image taken by FPM (Fourier Ptychographic Microscopy) and converts it into a dyed amplitude image. The second algorithm is the unpair method. This method use the stained and unstained fluorescence microscopic images for modeling. In this study, digital staining was performed using a generative adversarial network (GAN). From the experimental results, we noticed that both the pair and unpair algorithms shows the excellent performance.

Design and Implementation of Advanced Traffic Monitoring System based on Integration of Data Stream Management System and Spatial DBMS

  • Xia, Ying;Gan, Hongmei;Kim, Gyoung-Bae
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.2
    • /
    • pp.162-169
    • /
    • 2009
  • The real-time traffic data is generated continuous and unbounded stream data type while intelligent transport system (ITS) needs to provide various and high quality services by combining with spatial information. Traditional database techniques in ITS has shortage for processing dynamic real-time stream data and static spatial data simultaneously. In this paper, we design and implement an advanced traffic monitoring system (ATMS) with the integration of existed data stream management system (DSMS) and spatial DBMS using IntraMap. Besides, the developed ATMS can deal with the stream data of DSMS, the trajectory data of relational DBMS, and the spatial data of SDBMS concurrently. The implemented ATMS supports historical and one time query, continuous query and combined query. Application programmer can develop various intelligent services such as moving trajectory tracking, k-nearest neighbor (KNN) query and dynamic intelligent navigation by using components of the ATMS.

  • PDF

Real-time line control system for automated robotic assembly line for multi-PCB models

  • Park, Jong-Oh;Hyun, Kwang-Ik;Um, Doo-Gan;Kim, Byoung-Doo;Cho, Sung-Jong;Park, In-Gyu;Kim, Young-Sik
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1991.10b
    • /
    • pp.1915-1919
    • /
    • 1991
  • The efficiency of automated assembly line is increased by realizing the automation of each assembly cell, monitoring the line information and developing the real-time line control system it. which production flow is controllable. In this paper, the several modules which are important factors when constructing automated real-time control system, such as, line control S/W module, real-time model change module, error handling module and line production management S/W module, are developed. For developing these important programming modules, real-time control and multi-tasking techniques are integrated. In this paper, operating method of real-time line control in PCB automated assembly line is proposed and for effective control of production line by using multi-tasking technique, proper operating method for relating real-time line control with multi-tasking is proposed by defining the levels of signals and tasks. CIM-Oriented modular programming method considering expandability and flexibility will be added for further research in the future.

  • PDF

A Study on the Optimal Routing Problem for a Transfer Crane (컨테이너 터미널에서의 트랜스퍼 크레인의 최적 운영 방안에 관한 연구)

  • Kim, Hu-Gan;Kim, Chul-Han
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.33 no.1
    • /
    • pp.35-49
    • /
    • 2008
  • To load a container in a yard block onto a ship, a Transfer Crane (TC) moves to a target yard bay, then its hoist picks up a selected container and loads it onto a waiting Yard Truck (YT). An optimal routing problem of Transfer Crane is a decision problem which determines a given TC's the visiting sequence of yard-bays and the number of containers to transfer from each yard-bay. The objective is to minimize the travel time of the TC between yard-bays and setup time for the TC in a visiting yard. In this paper, we shows that the problem is NP-complete, and suggests a new formulation for it. Using the new formulation for the problem, we investigate some characteristics of solutions, a lower and upper bounds for it. Moreover, our lower and upper bound is very efficient to applying some instances suggested in a previous work.

Face Recognition Research Based on Multi-Layers Residual Unit CNN Model

  • Zhang, Ruyang;Lee, Eung-Joo
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.11
    • /
    • pp.1582-1590
    • /
    • 2022
  • Due to the situation of the widespread of the coronavirus, which causes the problem of lack of face image data occluded by masks at recent time, in order to solve the related problems, this paper proposes a method to generate face images with masks using a combination of generative adversarial networks and spatial transformation networks based on CNN model. The system we proposed in this paper is based on the GAN, combined with multi-scale convolution kernels to extract features at different details of the human face images, and used Wasserstein divergence as the measure of the distance between real samples and synthetic samples in order to optimize Generator performance. Experiments show that the proposed method can effectively put masks on face images with high efficiency and fast reaction time and the synthesized human face images are pretty natural and real.

Pharmacokinetic Scaling of SJ-8029. a Novel Anticancer Agent Possessing Microtubule and Topoisomerase Inhibiting Activities. by Species-Invariant Time Methods

  • Kim, Dong-Hwan;Shin, Beom-Soo;Cho, Chang-Youn;Park, Si-Koung;Chung, Sung-Gan;Cho, Eui-Hwan;Lee, Sun-Hwan;Joo, Jeong-Ho;Kwon, Ho-Suk
    • Proceedings of the PSK Conference
    • /
    • 2002.10a
    • /
    • pp.422.1-422.1
    • /
    • 2002
  • This study examined the pharmacokinetic disposition of SJ-8029. a novel anticancer agent possessing microtubule and topoisomerase inhibiting activities. in mice. rats. rabbits and dogs after i.v. administration. The serum concentration-time curves of SJ-8029 were best described by tri-exponential equations in all these animal species. The mean CI. $V_{ss}$ and $t_{1/2}$ were 0.3 L/h. 0.1 Land 63.2 min in mice. 1.5 L/h. 1.6 Land 247.7 min in rats. 13.8 L/h. 39.6 Land 245.9 min in rabbits. and 29.2 L/h. 44.6 Land 117.4 min in dogs. respectively. (omitted)

  • PDF

Crack Detection on Bridge Deck Using Generative Adversarial Networks and Deep Learning (적대적 생성 신경망과 딥러닝을 이용한 교량 상판의 균열 감지)

  • Ji, Bongjun
    • Journal of the Korean Recycled Construction Resources Institute
    • /
    • v.9 no.3
    • /
    • pp.303-310
    • /
    • 2021
  • Cracks in bridges are important factors that indicate the condition of bridges and should be monitored periodically. However, a visual inspection conducted by a human expert has problems in cost, time, and reliability. Therefore, in recent years, researches to apply a deep learning model are started to be conducted. Deep learning requires sufficient data on the situations to be predicted, but bridge crack data is relatively difficult to obtain. In particular, it is difficult to collect a large amount of crack data in a specific situation because the shape of bridge cracks may vary depending on the bridge's design, location, and construction method. This study developed a crack detection model that generates and trains insufficient crack data through a Generative Adversarial Network. GAN successfully generated data statistically similar to the given crack data, and accordingly, crack detection was possible with about 3% higher accuracy when using the generated image than when the generated image was not used. This approach is expected to effectively improve the performance of the detection model as it is applied when crack detection on bridges is required, though there is not enough data, also when there is relatively little or much data f or one class.

Makeup transfer by applying a loss function based on facial segmentation combining edge with color information (에지와 컬러 정보를 결합한 안면 분할 기반의 손실 함수를 적용한 메이크업 변환)

  • Lim, So-hyun;Chun, Jun-chul
    • Journal of Internet Computing and Services
    • /
    • v.23 no.4
    • /
    • pp.35-43
    • /
    • 2022
  • Makeup is the most common way to improve a person's appearance. However, since makeup styles are very diverse, there are many time and cost problems for an individual to apply makeup directly to himself/herself.. Accordingly, the need for makeup automation is increasing. Makeup transfer is being studied for makeup automation. Makeup transfer is a field of applying makeup style to a face image without makeup. Makeup transfer can be divided into a traditional image processing-based method and a deep learning-based method. In particular, in deep learning-based methods, many studies based on Generative Adversarial Networks have been performed. However, both methods have disadvantages in that the resulting image is unnatural, the result of makeup conversion is not clear, and it is smeared or heavily influenced by the makeup style face image. In order to express the clear boundary of makeup and to alleviate the influence of makeup style facial images, this study divides the makeup area and calculates the loss function using HoG (Histogram of Gradient). HoG is a method of extracting image features through the size and directionality of edges present in the image. Through this, we propose a makeup transfer network that performs robust learning on edges.By comparing the image generated through the proposed model with the image generated through BeautyGAN used as the base model, it was confirmed that the performance of the model proposed in this study was superior, and the method of using facial information that can be additionally presented as a future study.

Deep Learning Based Digital Staining Method in Fourier Ptychographic Microscopy Image (Fourier Ptychographic Microscopy 영상에서의 딥러닝 기반 디지털 염색 방법 연구)

  • Seok-Min Hwang;Dong-Bum Kim;Yu-Jeong Kim;Yeo-Rin Kim;Jong-Ha Lee
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.23 no.2
    • /
    • pp.97-106
    • /
    • 2022
  • In this study, H&E staining is necessary to distinguish cells. However, dyeing directly requires a lot of money and time. The purpose is to convert the phase image of unstained cells to the amplitude image of stained cells. Image data taken with FPM was created with Phase image and Amplitude image using Matlab's parameters. Through normalization, a visually identifiable image was obtained. Through normalization, a visually distinguishable image was obtained. Using the GAN algorithm, a Fake Amplitude image similar to the Real Amplitude image was created based on the Phase image, and cells were distinguished by objectification using MASK R-CNN with the Fake Amplitude image As a result of the study, D loss max is 3.3e-1, min is 6.8e-2, G loss max is 6.9e-2, min is 2.9e-2, A loss max is 5.8e-1, min is 1.2e-1, Mask R-CNN max is 1.9e0, and min is 3.2e-1.