• Title/Summary/Keyword: dynamic image generation

Search Result 55, Processing Time 0.023 seconds

Generation of He I 1083 nm Images from SDO/AIA 19.3 and 30.4 nm Images by Deep Learning

  • Son, Jihyeon;Cha, Junghun;Moon, Yong-Jae;Lee, Harim;Park, Eunsu;Shin, Gyungin;Jeong, Hyun-Jin
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.46 no.1
    • /
    • pp.41.2-41.2
    • /
    • 2021
  • In this study, we generate He I 1083 nm images from Solar Dynamic Observatory (SDO)/Atmospheric Imaging Assembly (AIA) images using a novel deep learning method (pix2pixHD) based on conditional Generative Adversarial Networks (cGAN). He I 1083 nm images from National Solar Observatory (NSO)/Synoptic Optical Long-term Investigations of the Sun (SOLIS) are used as target data. We make three models: single input SDO/AIA 19.3 nm image for Model I, single input 30.4 nm image for Model II, and double input (19.3 and 30.4 nm) images for Model III. We use data from 2010 October to 2015 July except for June and December for training and the remaining one for test. Major results of our study are as follows. First, the models successfully generate He I 1083 nm images with high correlations. Second, the model with two input images shows better results than those with one input image in terms of metrics such as correlation coefficient (CC) and root mean squared error (RMSE). CC and RMSE between real and AI-generated ones for the model III with 4 by 4 binnings are 0.84 and 11.80, respectively. Third, AI-generated images show well observational features such as active regions, filaments, and coronal holes. This work is meaningful in that our model can produce He I 1083 nm images with higher cadence without data gaps, which would be useful for studying the time evolution of chromosphere and coronal holes.

  • PDF

Efficient Hyperplane Generation Techniques for Human Activity Classification in Multiple-Event Sensors Based Smart Home (다중 이벤트 센서 기반 스마트 홈에서 사람 행동 분류를 위한 효율적 의사결정평면 생성기법)

  • Chang, Juneseo;Kim, Boguk;Mun, Changil;Lee, Dohyun;Kwak, Junho;Park, Daejin;Jeong, Yoosoo
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.14 no.5
    • /
    • pp.277-286
    • /
    • 2019
  • In this paper, we propose an efficient hyperplane generation technique to classify human activity from combination of events and sequence information obtained from multiple-event sensors. By generating hyperplane efficiently, our machine learning algorithm classify with less memory and run time than the LSVM (Linear Support Vector Machine) for embedded system. Because the fact that light weight and high speed algorithm is one of the most critical issue in the IoT, the study can be applied to smart home to predict human activity and provide related services. Our approach is based on reducing numbers of hyperplanes and utilizing robust string comparing algorithm. The proposed method results in reduction of memory consumption compared to the conventional ML (Machine Learning) algorithms; 252 times to LSVM and 34,033 times to LSTM (Long Short-Term Memory), although accuracy is decreased slightly. Thus our method showed outstanding performance on accuracy per hyperplane; 240 times to LSVM and 30,520 times to LSTM. The binarized image is then divided into groups, where each groups are converted to binary number, in order to reduce the number of comparison done in runtime process. The binary numbers are then converted to string. The test data is evaluated by converting to string and measuring similarity between hyperplanes using Levenshtein algorithm, which is a robust dynamic string comparing algorithm. This technique reduces runtime and enables the proposed algorithm to become 27% faster than LSVM, and 90% faster than LSTM.

Synthesis of Expressive Talking Heads from Speech with Recurrent Neural Network (RNN을 이용한 Expressive Talking Head from Speech의 합성)

  • Sakurai, Ryuhei;Shimba, Taiki;Yamazoe, Hirotake;Lee, Joo-Ho
    • The Journal of Korea Robotics Society
    • /
    • v.13 no.1
    • /
    • pp.16-25
    • /
    • 2018
  • The talking head (TH) indicates an utterance face animation generated based on text and voice input. In this paper, we propose the generation method of TH with facial expression and intonation by speech input only. The problem of generating TH from speech can be regarded as a regression problem from the acoustic feature sequence to the facial code sequence which is a low dimensional vector representation that can efficiently encode and decode a face image. This regression was modeled by bidirectional RNN and trained by using SAVEE database of the front utterance face animation database as training data. The proposed method is able to generate TH with facial expression and intonation TH by using acoustic features such as MFCC, dynamic elements of MFCC, energy, and F0. According to the experiments, the configuration of the BLSTM layer of the first and second layers of bidirectional RNN was able to predict the face code best. For the evaluation, a questionnaire survey was conducted for 62 persons who watched TH animations, generated by the proposed method and the previous method. As a result, 77% of the respondents answered that the proposed method generated TH, which matches well with the speech.

Prevalence of Decreased Myocardial Blood Flow in Symptomatic Patients with Patent Coronary Stents: Insights from Low-Dose Dynamic CT Myocardial Perfusion Imaging

  • Yuehua Li;Mingyuan Yuan;Mengmeng Yu;Zhigang Lu;Chengxing Shen;Yining Wang;Bin Lu;Jiayin Zhang
    • Korean Journal of Radiology
    • /
    • v.20 no.4
    • /
    • pp.621-630
    • /
    • 2019
  • Objective: To study the prevalence and clinical characteristics of decreased myocardial blood flow (MBF) quantified by dynamic computed tomography (CT) myocardial perfusion imaging (MPI) in symptomatic patients without in-stent restenosis. Materials and Methods: Thirty-seven (mean age, 71.3 ± 10 years; age range, 48-88 years; 31 males, 6 females) consecutive symptomatic patients with patent coronary stents and without obstructive de novo lesions were prospectively enrolled to undergo dynamic CT-MPI using a third-generation dual-source CT scanner. The shuttle-mode acquisition technique was used to image the complete left ventricle. A bolus of contrast media (50 mL; iopromide, 370 mg iodine/mL) was injected into the antecubital vein at a rate of 6 mL/s, followed by a 40-mL saline flush. The mean MBF value and other quantitative parameters were measured for each segment of both stented-vessel territories and reference territories. The MBFratio was defined as the ratio of the mean MBF value of the whole stent-vessel territory to that of the whole reference territory. An MBFratio of 0.85 was used as the cut-off value to distinguish hypoperfused from non-hypoperfused segments. Results: A total of 629 segments of 37 patients were ultimately included for analysis. The mean effective dose of dynamic CT-MPI was 3.1 ± 1.2 mSv (range, 1.7-6.3 mSv). The mean MBF of stent-vessel territories was decreased in 19 lesions and 81 segments. Compared to stent-vessel territories without hypoperfusion, the mean MBF and myocardial blood volume were markedly lower in hypoperfused stent-vessel territories (77.5 ± 16.6 mL/100 mL/min vs. 140.4 ± 24.1 mL/100 mL/min [p < 0.001] and 6.4 ± 3.7 mL/100 mL vs. 11.5 ± 4 mL/100 mL [p < 0.001, respectively]). Myocardial hypoperfusion in stentvessel territories was present in 48.6% (18/37) of patients. None of clinical parameters differed statistically significantly between hypoperfusion and non-hypoperfusion subgroups. Conclusion: Decreased MBF is commonly present in patients who are symptomatic after percutaneous coronary intervention, despite patent stents and can be detected by dynamic CT-MPI using a low radiation dose.

A sequence-based personalized service for the short life cycle products (수명주기가 짧은 상품들에 대한 시퀀스 기반 개인화 서비스)

  • Choi, Ju-Choel
    • Journal of Digital Convergence
    • /
    • v.15 no.12
    • /
    • pp.293-301
    • /
    • 2017
  • Most new products not only suddenly disappear in the market but also quickly cannibalize older products. Under such a circumstance, retailers may have too much stock, and customers may be faced with difficulties discovering products suitable to their preferences among short life cycle products. To address these problems, recommender systems are good solutions. However, most previous recommender systems had difficulty in reflecting changes in customer preferences because the systems employ static customer preferences. In this paper, we propose a recommendation methodology that considers dynamic customer preferences. The proposed methodology consists of dynamic customer profile creation, neighborhood formation, and recommendation list generation. For the experiments, we employ a mobile image transaction dataset that has a short product life cycle. Our experimental results demonstrate that the proposed methodology has a higher quality of recommendation than a typical collaborative filtering-based system. From these results, we conclude that the proposed methodology is effective under conditions where most new products have short life cycles. The proposed methodology need to be verified in the physical environment at a future time.

Reliability of Exterior Orientation in Bundle Adjustment for SPOT Imagery (SPOT 영상을 위한 번들조성에서 외부표정의 신뢰성)

  • Park, Hong Gi
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.12 no.1
    • /
    • pp.151-158
    • /
    • 1992
  • Topographic mapping from economic SPOT stereo imagery than aerial photographs has become possible. Many of authors have studied the possibility of base map revisions and the accuracy of results. They have concluded that the SPOT image is suitable for 1/50,000 to 1/100,000 topographic map. For topographic map, orthophoto and DTM generation from SPOT imagery, accurate exterior orientation parameters are needed. But since the geometric characteristic of SPOT image is dynamic linear array imagery, the conventional bundle adjustment for photogrammetry can not be directly applied. Reliability is the ability to detect gross error, which is called the internal reliability, and the effect of non-detectable gross error on the results of exterior orientation, which is called the external reliability. This paper shows how the reliability of SPOT imagery depends on the different coordinate systems, presentations of coordinate for flight direction, orders of exterior orientation parameters and distribution of control points, and thus analyses the theoretical reliability of the exterior orientation, which can provide a basis for the planning of SPOT projects.

  • PDF

Study as to Formative Characteristics of High Tech Furniture Design -Laying Stress on Correlation between Technology Art and Furniture Design-

  • Kim, Kyoung-Soo
    • Journal of the Korea Furniture Society
    • /
    • v.19 no.6
    • /
    • pp.439-446
    • /
    • 2008
  • High Tech Design manner is a design concept that had been constantly discussed in constitution process of the West art history and modem ideology and had been experimented in industry, having started from futurism and structuralism in the early 20th century through Kinetic Art & Technology Art and up to now. High Tech Design had a great influence also on Post Modernism and more important is that this manner of design will be existing continually in the future too. From the modem times when machine civilization started, the artist and designers expressed a utopia will showing the future world with help of High Tech Design and modem people are realizing technology images as a utopia, in the space and material presented by this high tech design. And this utopia imply the images of dynamic power, speed making a voyage in universe, dream of future, hope, mass production, earth's environment, wealth etc. High Tech furniture was lightly designed by using thin steel wire, structure stressing the metallic characteristic and tempered glass, and it was used for presenting a convenient interior space visually, and with that it can make a unified sense in High Tech interior space, and a contrary effect compared with minimal space. High Tech Design equipped with glass and metal materials looking inappropriate for our interior space due to their sharp and cold image has been regularly used as living furniture, not only decoration function, and then there must be reasons for that. This study intends to research how High Tech Design has been changed and developed in the design history & West art history from the early 20th century, and to present it's value of development as data orienting, namely a direction for the industry of the next-generation and furniture design.

  • PDF

A Black and White Comics Generation Procedure for the Video Frame Image using Region Extension based on HSV Color Model (HSV 색상 모델과 영역 확장 기법을 이용한 동영상 프레임 이미지의 흑백 만화 카투닝 알고리즘)

  • Ryu, Dong-Sung;Cho, Hwan-Gue
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.35 no.12
    • /
    • pp.560-567
    • /
    • 2008
  • In this paper, we discuss a simple and straightforward binarization procedure which can generate black/white comics from the video frame image. Generally, the region of human's skin is colored white or light gray, while the dark region is filled with the irregular but regular patterns like hatching in most of the black/white comics. Note that it is not enough for simple threshold method to perform this work. Our procedure is decoupled into four processes. First, we use bilateral filter to suppress noise color variation and reserve boundaries. Then, we perform mean-shift segmentation for each similar colored pixels to be clustered. Third, the clustered regions are merged and extended by our region extension algorithm considering each color of their regions. Finally, we decide which pixels are on or off using by our dynamic binarization method based on the HSV color model. Our novel black/white cartooning procedure was so successful to render comic cuts from a well-known cinema in a resonable time and manual intervention.

A Study on Mapping 3-D River Boundary Using the Spatial Information Datasets (공간정보를 이용한 3차원 하천 경계선 매핑에 관한 연구)

  • Choung, Yun-Jae;Park, Hyen-Cheol;Jo, Myung-Hee
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.15 no.1
    • /
    • pp.87-98
    • /
    • 2012
  • A river boundary is defined as the intersection between a main stream of a river and the land. Mapping of the river boundary is important for the protection of the properties in river areas, the prevention of flooding and the monitoring of the topographic changes in river areas. However, the utilization of the ground surveying technologies is not efficient for the mapping of the river boundary due to the irregular surfaces of river zones and the dynamic changes of water level of a river stream. Recently, the spatial information data sets such as the airborne LiDAR and aerial images are widely used for coastal mapping due to the acquisition of the topographic information without human accessibility. Due to these advantages, this research proposes a semi-automatic method for mapping of the river boundary using the spatial information data set such as the airborne LiDAR and the aerial photographs. Multiple image processing technologies such as the image segmentation algorithm and the edge detection algorithm are applied for the generation of the 3D river boundary using the aerial photographs and airborne topographic LiDAR data. Check points determined by the experienced expert are used for the measurement of the horizontal and vertical accuracy of the generated 3D river boundary. Statistical results show that the generated river boundary has a high accuracy in horizontal and vertical direction.

An Automatic ROI Extraction and Its Mask Generation based on Wavelet of Low DOF Image (피사계 심도가 낮은 이미지에서 웨이블릿 기반의 자동 ROI 추출 및 마스크 생성)

  • Park, Sun-Hwa;Seo, Yeong-Geon;Lee, Bu-Kweon;Kang, Ki-Jun;Kim, Ho-Yong;Kim, Hyung-Jun;Kim, Sang-Bok
    • Journal of the Korea Society of Computer and Information
    • /
    • v.14 no.3
    • /
    • pp.93-101
    • /
    • 2009
  • This paper suggests a new algorithm automatically searching for Region-of-Interest(ROI) with high speed, using the edge information of high frequency subband transformed with wavelet. The proposed method executes a searching algorithm of 4-direction object boundary by the unit of block using the edge information, and detects ROIs. The whole image is splitted by $64{\times}64$ or $32{\times}32$ sized blocks and the blocks can be ROI block or background block according to taking the edges or not. The 4-directions searche the image from the outside to the center and the algorithm uses a feature that the low-DOF image has some edges as one goes to center. After searching all the edges, the method regards the inner blocks of the edges as ROI, and makes the ROI masks and sends them to server. This is one of the dynamic ROI method. The existing methods have had some problems of complicated filtering and region merge, but this method improved considerably the problems. Also, it was possible to apply to an application requiring real-time processing caused by the process of the unit of block.