• 제목/요약/키워드: Missing Values

검색결과 440건 처리시간 0.027초

딥러닝 기법을 활용한 위성 관측 해수면 온도 자료의 결측부 복원에 관한 연구 (Restoration of Missing Data in Satellite-Observed Sea Surface Temperature using Deep Learning Techniques)

  • 박원빈;최흥배;한명수;엄호식;송용식
    • 해양환경안전학회지
    • /
    • 제29권6호
    • /
    • pp.536-542
    • /
    • 2023
  • 인공위성은 최첨단 기술로써 시공간적 관측제약이 적어 해양 사고에 효과적 대응과 해양 변동 특성 분석 등으로 각국의 국가기관들이 위성 정보를 활용하고 있다. 하지만 고해상도 위성 관측 기반 해수면 온도 자료(Operational Sea Surface Temperature and Sea Ice Analysis, OSTIA)는 위성의 기기적, 또는 지리적 오류와 구름으로 인해 낮게 관측되거나 공백으로 처리되며 이를 복원하기까지 수 시간이 소요된다. 본 연구는 최신 딥러닝 기반 알고리즘인 LaMa 기법을 활용하여 결측된 OSTIA 자료를 복원하고, 그 성능을 기존에 이용되어 온 세 가지 영상처리 기법들의 성능과 비교하여 평가하였다. 결정계수(R2)와 평균절대오차(MAE) 값을 이용하여 각 기법의 위성 영상 복원 성능을 평가한 결과, LaMa 알고리즘을 적용하였을 때의 R2과 MAE 값이 각각 0.9 이상, 0.5℃ 이하로, 기존에 사용되어 온 쌍 선형보간법, 쌍삼차보간법, DeepFill v1 기법을 적용한 것보다 더 우수한 성능을 보였다. 향후에는 현업 위성 자료 제공 시스템에 LaMa 기법을 적용하여 그 가능성을 평가해 보고자 한다.

GOSAT 기반의 동북아시아 CO2 분포도에 적용된 크리깅 기법의 비교평가 (Comparative Evaluation among Different Kriging Techniques applied to GOSAT CO2 Map for North East Asia)

  • 최진호;엄정섭
    • 환경영향평가
    • /
    • 제20권6호
    • /
    • pp.879-890
    • /
    • 2011
  • The GOSAT (Greenhouse gases Observing SATellite) data provide new opportunities the most regionally complete and up-to-date assessment of $CO_2$. However, in practice, GOSAT records often suffer from missing data values mainly due to unfavorable meteorological condition in specific time periods of data acquisition. The aim of this research was to identify optimal spatial interpolation techniques to ensure the continuity of $CO_2$ from samples taken in the North East Asia. The accuracy among ordinary kriging (OK), universal kriging (UK) and simple kriging (SK) was compared based on the combined consideration of $R^2$ values, Root Mean Square Error (RMSE), Mean Error (ME) for variogram models. Cross validation for 1312 random sampling points indicate that the (UK) kriging is the best geostatistical method for spatial predictions of $CO_2$ in the East Asia region. The results from this study can be useful for selecting optimal kriging algorithm to produce $CO_2$ map of various landscapes. Also, data users may benefit from a statistical approach that would allow them to better understand the uncertainty and limitations of the GOSAT sample data.

근전도 측정시 검사시간에 따른 신뢰도 연구 (Study on the Reliability of Electromygraphic Examine according to the Measurement Timing in a Day)

  • Woo-Cheon Kee;Byung-Guk Kim;Sook-Hee Choi
    • Journal of Oral Medicine and Pain
    • /
    • 제14권1호
    • /
    • pp.19-24
    • /
    • 1989
  • The purpose of this study was to investigate the reliability of electromyographic examination in a day and detect the objective measurement timing of electromyography. 18 normal students who were in dental collage of C national university were selected for this study. They had no symptoms on temporomandibular joint area, no restorations and missing tooth on dentition. Their molar relationship was normal or class I of Angle's classification. Electromyography had been taken every one hour from 9:00 A.M. to 5:00 P.M. in the state of clenching and rest by using Bioelectric processor EM2 interfaced with mandibular kinesiograph K-6 diagnostic system. We compared and analyzed the variances of electromyography values of each subjects. The obtained results were as follows : There were no significant differences on variability of electromyography values in each state clenching and rest. In the aspect of this circumstances, the use of electromyography could be a good objective procedure to diagnose the temporomandibular disorders and to detect the effect to the treatment of temporomandibular disorders at any time in a day from 9:00 A.M. to 5:00 P.M.

  • PDF

원자로 제어봉구동장치 제어시스템의 전력변환기 사이리스터 고장 검출 (Fault Detection for thyristors of Power Converter Module in Control Rod Control System)

  • 김춘경;천종민;이종무;정순현;권순만
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2003년도 학술회의 논문집 정보 및 제어부문 B
    • /
    • pp.559-562
    • /
    • 2003
  • In this paper, we introduce a new method detecting thyristor faults of the power converter module in Control Rod Control System. When we control the currents in each coil of Control Rod Drive Mechanism by using the current control method, the current value can follow the current reference despite the faults like the missing phase or the diode acting. Comparing the fault current values with the normal current values, the bad transient characteristics of the abnormal current can make the operations of control rods incorrect. In this case, the information from the current trends cannot be enough to detect the fault occurrence in thyristors. Instead of the coil currents, the state of thyristors can be watched by measuring the coil voltages. In the existing system of Westinghouse type, the ripple detector takes charge of this task. But this detector has some shortcomings in the point of time for fault detection, we come to devise a new fault detection method solving the problems which belong to the ripple detector.

  • PDF

아파치 스파크에서의 PARAFAC 분해 기반 텐서 재구성을 이용한 추천 시스템 (PARAFAC Tensor Reconstruction for Recommender System based on Apache Spark)

  • 임어진;용환승
    • 한국멀티미디어학회논문지
    • /
    • 제22권4호
    • /
    • pp.443-454
    • /
    • 2019
  • In recent years, there has been active research on a recommender system that considers three or more inputs in addition to users and goods, making it a multi-dimensional array, also known as a tensor. The main issue with using tensor is that there are a lot of missing values, making it sparse. In order to solve this, the tensor can be shrunk using the tensor decomposition algorithm into a lower dimensional array called a factor matrix. Then, the tensor is reconstructed by calculating factor matrices to fill original empty cells with predicted values. This is called tensor reconstruction. In this paper, we propose a user-based Top-K recommender system by normalized PARAFAC tensor reconstruction. This method involves factorization of a tensor into factor matrices and reconstructs the tensor again. Before decomposition, the original tensor is normalized based on each dimension to reduce overfitting. Using the real world dataset, this paper shows the processing of a large amount of data and implements a recommender system based on Apache Spark. In addition, this study has confirmed that the recommender performance is improved through normalization of the tensor.

Newton 차분법을 이용한 개선된 디인터레이싱 연구 (A study on Improved De-Interlacing Applying Newton Difference Interpolation)

  • 백경훈
    • 문화기술의 융합
    • /
    • 제6권1호
    • /
    • pp.449-454
    • /
    • 2020
  • 본 논문에서는 하나의 필드만을 사용하여 비월 주사 영상을 순차 주사 영상으로 변환하는 개선된 디인터레이싱 방법을 제안한다. 먼저, 구하고자 하는 화소의 위와 아래 각각 5개 화소를 이용하여 세분화된 화소 사이의 값들을 Newton의 전향차분과 후향차분을 이용하여 구한다. 이렇게 얻어진 화소 사이의 값과 5개의 알려진 화소값들을 이용하여 구하고자하는 화소를 중심으로 위와 아래화소의 방향을 세분화하여 각각의 상관관계를 구한다. 구하고자 하는 화소에서의 에지의 방향성은 위와 아래 상관관계가 가장 최소가 되는 방향으로 예측한다. 구하고자 하는 화소값 결정은 예측된 방향에 따라 위와 아래 화소값의 평균값으로 결정한다. 모의실험 결과 기존의 제시된 여러 디인터레이싱 방법에 비해 엣지에서의 주관적 화질이 개선되었으며 또한 객관적 화질에 있어서 정량적으로 PSNR 계산결과 0.2~0.3dB정도의 화질개선이 이루어졌다.

Estimation of effective population size using single-nucleotide polymorphism (SNP) data in Jeju horse

  • Do, Kyoung-Tag;Lee, Joon-Ho;Lee, Hak-Kyo;Kim, Jun;Park, Kyung-Do
    • Journal of Animal Science and Technology
    • /
    • 제56권8호
    • /
    • pp.28.1-28.6
    • /
    • 2014
  • This study was conducted to estimate the effective population size using SNPs data of 240 Jeju horses that had raced at the Jeju racing park. Of the total 61,746 genotyped autosomal SNPs, 17,320 (28.1%) SNPs (missing genotype rate of >10%, minor allele frequency of <0.05 and Hardy-Weinberg equilibrium test P-value of < $10^{-6}$) were excluded after quality control processes. SNPs on the X and Y chromosomes and genotyped individuals with missing genotype rate over 10% were also excluded, and finally, 44,426 (71.9%) SNPs were selected and used for the analysis. The measures of the LD, square of correlation coefficient ($r^2$) between SNP pairs, were calculated for each allele and the effective population size was determined based on $r^2$ measures. The polymorphism information contents (PIC) and expected heterozygosity (HE) were 0.27 and 0.34, respectively. In LD, the most rapid decline was observed over the first 1 Mb. But $r^2$ decreased more slowly with increasing distance and was constant after 2 Mb of distance and the decline was almost linear with log-transformed distance. The average $r^2$ between adjacent SNP pairs ranged from 0.20 to 0.31 in each chromosome and whole average was 0.26, while the whole average $r^2$ between all SNP pairs was 0.02. We observed an initial pattern of decreasing $N_e$ and estimated values were closer to 41 at 1 ~ 5 generations ago. The effective population size (41 heads) estimated in this study seems to be large considering Jeju horse's population size (about 2,000 heads), but it should be interpreted with caution because of the technical limitations of the methods and sample size.

Comparison of three boosting methods in parent-offspring trios for genotype imputation using simulation study

  • Mikhchi, Abbas;Honarvar, Mahmood;Kashan, Nasser Emam Jomeh;Zerehdaran, Saeed;Aminafshar, Mehdi
    • Journal of Animal Science and Technology
    • /
    • 제58권1호
    • /
    • pp.1.1-1.6
    • /
    • 2016
  • Background: Genotype imputation is an important process of predicting unknown genotypes, which uses reference population with dense genotypes to predict missing genotypes for both human and animal genetic variations at a low cost. Machine learning methods specially boosting methods have been used in genetic studies to explore the underlying genetic profile of disease and build models capable of predicting missing values of a marker. Methods: In this study strategies and factors affecting the imputation accuracy of parent-offspring trios compared from lower-density SNP panels (5 K) to high density (10 K) SNP panel using three different Boosting methods namely TotalBoost (TB), LogitBoost (LB) and AdaBoost (AB). The methods employed using simulated data to impute the un-typed SNPs in parent-offspring trios. Four different datasets of G1 (100 trios with 5 k SNPs), G2 (100 trios with 10 k SNPs), G3 (500 trios with 5 k SNPs), and G4 (500 trio with 10 k SNPs) were simulated. In four datasets all parents were genotyped completely, and offspring genotyped with a lower density panel. Results: Comparison of the three methods for imputation showed that the LB outperformed AB and TB for imputation accuracy. The time of computation were different between methods. The AB was the fastest algorithm. The higher SNP densities resulted the increase of the accuracy of imputation. Larger trios (i.e. 500) was better for performance of LB and TB. Conclusions: The conclusion is that the three methods do well in terms of imputation accuracy also the dense chip is recommended for imputation of parent-offspring trios.

BLS 무응답 보정법을 이용한 대체법과 이월대체법에 관한 연구 (A Comparison of BLS Non-Response Adjustment and Cross-Wave Regression Imputation Methods)

  • 이상은;신기일
    • 응용통계연구
    • /
    • 제23권5호
    • /
    • pp.909-921
    • /
    • 2010
  • 패널 자료에서 무응답이 발생한 경우에는 횡시점회귀대체법(cross-wave regression imputation) 등과 같은 대체법을 이용하여 무응답 문제를 해결한다. 최근 표본 틀(sampling frame) 자료를 이용하여 무응답 가중치 보정을 하는 BLS 무응답 보정법은 패널 자료에도 적용 가능한 방법으로 알려져있다. 본 논문에서는 패널자료에서 BLS 무응답 보정법을 이용한 대체법을 연구하였으며 자료가 경향이 있는 비정상시계열(nonstationary process with drift)을 따른 다는 조건하에서 BLS 무응답 보정법과 횡시점회귀대체법의 하나인 이월대체법(carry-over imputation)과의 이론적 관계를 살펴보았다. 모의실험을 통하여 이론적인 결과를 확인하였으며, 2007년 매월노동통계 자료를 이용하여 두 방법의 우수성을 비교하였다.

The clinical prognosis of implants that are placed against super-erupted opposing dentition

  • Kim, Young-Kyun;Ahn, Kyo-Jin;Yun, Pil-Young;Yi, Yang-Jin;Kim, Su-Gwan
    • Journal of the Korean Association of Oral and Maxillofacial Surgeons
    • /
    • 제42권3호
    • /
    • pp.139-143
    • /
    • 2016
  • Objectives: If teeth are missing, super-eruption of teeth in the opposing arch can occur in the area and can change the occlusal plane. When missing teeth are replaced with implants, the oral surgeon must determine whether or not the super-erupted teeth need to be treated in order to normalize the occlusal plane. In this study, we evaluated the clinical prognosis of dentition after implant placement and prosthetic treatment were completed in an occlusal plane altered by super-erupted teeth in the opposing arch without additional treatment of the super-erupted teeth. Materials and Methods: Twenty-two patients (9 males, 13 females) were treated with implants and prosthetics without addressing the super-erupted opposing dentition from April 2004 to August 2012 at Seoul National University Bundang Hospital. A total of 33 implants were placed. Values of crestal bone loss, survival rates, and surgical and prosthetic complications for an average of 29.6 months after prosthetic loading were recorded. Results: In one case, the cover screw was exposed after implant surgery. The mean crestal bone loss was $0.09{\pm}0.30mm$. Of the 33 implants, 31 survived, a survival rate of 93.94%. A prosthetic complication occurred in one case but functioned well after correction. Conclusion: Favorable clinical results from prosthetic complications, crestal bone loss, and implant survival rates were exhibited in implants next to a super-erupted opposing tooth.