• 제목/요약/키워드: temporal expression

검색결과 226건 처리시간 0.026초

수어 동작 키포인트 중심의 시공간적 정보를 강화한 Sign2Gloss2Text 기반의 수어 번역 (Sign2Gloss2Text-based Sign Language Translation with Enhanced Spatial-temporal Information Centered on Sign Language Movement Keypoints)

  • 김민채;김정은;김하영
    • 한국멀티미디어학회논문지
    • /
    • 제25권10호
    • /
    • pp.1535-1545
    • /
    • 2022
  • Sign language has completely different meaning depending on the direction of the hand or the change of facial expression even with the same gesture. In this respect, it is crucial to capture the spatial-temporal structure information of each movement. However, sign language translation studies based on Sign2Gloss2Text only convey comprehensive spatial-temporal information about the entire sign language movement. Consequently, detailed information (facial expression, gestures, and etc.) of each movement that is important for sign language translation is not emphasized. Accordingly, in this paper, we propose Spatial-temporal Keypoints Centered Sign2Gloss2Text Translation, named STKC-Sign2 Gloss2Text, to supplement the sequential and semantic information of keypoints which are the core of recognizing and translating sign language. STKC-Sign2Gloss2Text consists of two steps, Spatial Keypoints Embedding, which extracts 121 major keypoints from each image, and Temporal Keypoints Embedding, which emphasizes sequential information using Bi-GRU for extracted keypoints of sign language. The proposed model outperformed all Bilingual Evaluation Understudy(BLEU) scores in Development(DEV) and Testing(TEST) than Sign2Gloss2Text as the baseline, and in particular, it proved the effectiveness of the proposed methodology by achieving 23.19, an improvement of 1.87 based on TEST BLEU-4.

Temporal expression profiling of long noncoding RNA and mRNA in the peripheral blood during porcine development

  • Gu, Yiren;Zhou, Rui;Jin, Long;Tao, Xuan;Zhong, Zhijun;Yang, Xuemei;Liang, Yan;Yang, Yuekui;Wang, Yan;Chen, Xiaohui;Gong, Jianjun;He, Zhiping;Li, Mingzhou;Lv, Xuebin
    • Asian-Australasian Journal of Animal Sciences
    • /
    • 제33권5호
    • /
    • pp.836-847
    • /
    • 2020
  • Objective: We investigated the temporal expression profiles of long noncoding RNA (lncRNA) and mRNA in the peripheral blood of pigs during development and identified the lncRNAs that are related to the blood-based immune system. Methods: Peripheral blood samples were obtained from the pigs at 0, 7, 28, and 180 days and 2 years of age. RNA sequencing was performed to survey the lncRNA and mRNA transcriptomes in the samples. Short time-series expression miner (STEM) was used to show temporal expression patterns in the mRNAs and lncRNAs. Gene ontology and Kyoto encyclopedia of genes and genomes analyses were performed to assess the genes' biological relevance. To predict the functions of the identified lncRNAs, we extracted mRNAs that were nearby loci and highly correlated with the lncRNAs. Results: In total of 5,946 lncRNA and 12,354 mRNA transcripts were identified among the samples. STEM showed that most lncRNAs and mRNAs had similar temporal expression patterns during development, indicating the expressional correlation and functional relatedness between them. The five stages were divided into two classes: the suckling period and the late developmental stage. Most genes were expressed at low level during the suckling period, but at higher level during the late stages. Expression of several T-cell-related genes increased continuously during the suckling period, indicating that these genes are crucial for establishing the adaptive immune system in piglets at this stage. Notably, lncRNA TCONS-00086451 may promote blood-based immune system development by upregulating nuclear factor of activated T-cells cytoplasmic 2 expression. Conclusion: This study provides a catalog of porcine peripheral blood-related lncRNAs and mRNAs and reveals the characteristics and temporal expression profiles of these lncRNAs and mRNAs during peripheral blood development from the newborn to adult stages in pigs.

표정 HMM과 사후 확률을 이용한 얼굴 표정 인식 프레임워크 (A Recognition Framework for Facial Expression by Expression HMM and Posterior Probability)

  • 김진옥
    • 한국정보과학회논문지:컴퓨팅의 실제 및 레터
    • /
    • 제11권3호
    • /
    • pp.284-291
    • /
    • 2005
  • 본 연구에서는 학습한 표정 패턴을 기반으로 비디오에서 사람의 얼굴을 검출하고 표정을 분석하여 분류하는 프레임워크를 제안한다. 제안 프레임워크는 얼굴 표정을 인식하는데 있어 공간적 정보 외시간에 따라 변하는 표정의 패턴을 표현하기 위해 표정 특성을 공간적으로 분석한 PCA와 시공간적으로 분석한 Hidden Markov Model(HMM) 기반의 표정 HMM을 이용한다. 표정의 공간적 특징 추출은 시간적 분석 과정과 밀접하게 연관되어 있기 때문에 다양하게 변화하는 표정을 검출하여 추적하고 분류하는데 HMM의 시공간적 접근 방식을 적용하면 효과적이기 때문이다. 제안 인식 프레임워크는 현재의 시각적 관측치와 이전 시각적 결과간의 사후 확률 방법에 의해 완성된다. 결과적으로 제안 프레임워크는 대표적인 6개 표정뿐만 아니라 표정의 정도가 약한 프레임에 대해서도 정확하고 강건한 표정 인식 결과를 보인다. 제안 프레임 워크를 이용하면 표정 인식, HCI, 키프레임 추출과 같은 응용 분야 구현에 효과적이다

Temporal and Spatial Expression of Homeotic Genes Is Important for Segment-specific Neuroblast 6-4 Lineage Formation in Drosophila

  • Kang, Sun-Young;Kim, Su-Na;Kim, Sang Hee;Jeon, Sang-Hak
    • Molecules and Cells
    • /
    • 제21권3호
    • /
    • pp.436-442
    • /
    • 2006
  • Different proliferation of neuroblast 6-4 (NB6-4) in the thorax and abdomen produces segmental specific expression pattern of several neuroblast marker genes. NB6-4 is divided to form four medialmost cell body glia (MM-CBG) per segment in thorax and two MM-CBG per segment in abdomen. As homeotic genes determine the identities of embryonic segments along the A/P axis, we investigated if temporal and specific expression of homeotic genes affects MM-CBG patterns in thorax and abdomen. A Ubx loss-of-function mutation was found to hardly affect MM-CBG formation, whereas abd-A and Abd-B caused the transformation of abdominal MM-CBG to their thoracic counterparts. On the other hand, gain-of-function mutants of Ubx, abd-A and Abd-B genes reduced the number of thoracic MM-CBG, indicating that thoracic MM-CBG resembled abdominal MM-CBG. However, mutations in Polycomb group (PcG) genes, which are negative transregulators of homeotic genes, did not cause the thoracic to abdominal MM-CBG pattern transformation although the number of MM-CBG in a few percent of embryos were partially reduced or abnormally patterned. Our results indicate that temporal and spatial expression of the homeotic genes is important to determine segmental-specificity of NB6-4 daughter cells along the anterior-posterior (A/P) axis.

Over-Expression of Ephrin-A5 in Mice Results in Decreasing the Size of Progenitor Pool through Inducing Apoptosis

  • Noh, Hyuna;Park, Soochul
    • Molecules and Cells
    • /
    • 제39권2호
    • /
    • pp.136-140
    • /
    • 2016
  • Eph receptors and their ligands, ephrins, mediate cell-to-cell contacts in a specific brain region and their bidirectional signaling is implicated in the regulation of apoptosis during early brain development. In this report, we used the alpha(${\alpha}$)-Cre transgenic line to induce ephrin-A5 over-expression in the distal region of the neural retina. Using this double transgenic embryo, we show that the over-expression of ephrin-A5 was responsible for inducing massive apoptosis in both the nasal and temporal retinas. In addition, the number of differentiated retinal neurons with the exception of the bipolar neuron was significantly reduced, whereas the laminar organization of the mature retina remained intact. Consistent with this finding, an analysis of the mature retina revealed that the size of the whole retina-particularly the nasal and temporal regions-is markedly reduced. These results strongly suggest that the level of ephrin-A5 expression plays a role in the regulation of the size of the retinal progenitor pool in the neural retina.

기간변수(期間變數)에 의거한 시간추출방식 (An Interval-based Temporal Reasoning Scheme)

  • 윤완철
    • 대한산업공학회지
    • /
    • 제16권2호
    • /
    • pp.63-70
    • /
    • 1990
  • This paper presents a new temporal reasoning scheme based on explicit expression of time intervals. The proposed scheme deals with the general problem of temporal knowledge representation and temporal reasoning and may be used in rule-based systems and qualitative models. Time intervals, not time points, are defined in terms of orders and/or numbers in a quantity space. As a result, the system behavior is represented in the form of partially ordered networks. Such explicit and qualitative description of temporal quantities enables both reduction of ambiguity and parsimonious used of temporal information. Based on the proposed temporal reasoning scheme, a new rule-based qualitative simulation system is being built and evaluated.

  • PDF

ExoTime: Temporal Information Extraction from Korean Texts Using Knowledge Base

  • Jeong, Young-Seob;Lim, Chae-Gyun;Choi, Ho-Jin
    • 한국컴퓨터정보학회논문지
    • /
    • 제22권12호
    • /
    • pp.35-48
    • /
    • 2017
  • Extracting temporal information from documents is becoming more important, because it can be used to various applications such as Question-Answering (QA) systems, Recommendation systems, or Information Retrieval (IR) systems. Most previous studies only focus on English documents, and they are not applicable to the other languages due to the inherent characteristics of languages. In this paper, we propose a new system, named ExoTime, designed to extract temporal information from Korean documents. The ExoTime adopts an external Knowledge Base (KB) in order to achieve better prediction performance, and it also applies a bagging method to the temporal relation prediction. We show that the effectiveness of the proposed approaches by empirical results using Korean TimeBank. The ExoTime system works as a part of ExoBrain that is an artificial intelligent QA system.

동영상 검색을 위한 템포럴 텍스처 모델링 (Temporal Texture modeling for Video Retrieval)

  • 김도년;조동섭
    • 대한전기학회논문지:시스템및제어부문D
    • /
    • 제50권3호
    • /
    • pp.149-157
    • /
    • 2001
  • In the video retrieval system, visual clues of still images and motion information of video are employed as feature vectors. We generate the temporal textures to express the motion information whose properties are simple expression, easy to compute. We make those temporal textures of wavelet coefficients to express motion information, M components. Then, temporal texture feature vectors are extracted using spatial texture feature vectors, i.e. spatial gray-level dependence. Also, motion amount and motion centroid are computed from temporal textures. Motion trajectories provide the most important information for expressing the motion property. In our modeling system, we can extract the main motion trajectory from the temporal textures.

  • PDF

Coordinated Spatial and Temporal Expression of Voltage-sensitive calcium Channel ${\alpha}_{1A}$ and $\beta_4$ Subunit mRNAs in Rat Cerebellum

  • Kim, Dong-Sun;Chin, Hemin
    • Animal cells and systems
    • /
    • 제1권4호
    • /
    • pp.589-594
    • /
    • 1997
  • The neuronal voltage-sensitive calcium channels (VSCCs) are multisubunit complexes consisting of $\alpha_1,\;\alpha_2-\delta$ and $\beta$ subunits. Heterologous expression and biochemical studies have shown that the activity of VSCCs is regulated by their $\beta$ subunits in a $\beta$ subunit isoform-specific manner. To elucidate the $\beta$ subunit identity of the P/Q-type calcium channel encoded by an $\alpha_{1A}$ subunit, which is exclusively expressed in the Purkinje and granule cell of the cerebellum, we have examined the spatial and temporal expression patterns of $\beta$ subunits and compared them with those of $\alpha_{1A}$ subunit in the developing rat cerebellum. Reverse transcriptase- polymerase chain reaction (RT-PCR) and Northern blot analysis have shown that $\beta_4$ subunit mRNA was prominently expressed in the cerebellum and much more abundant than any other distinct $\beta$ subunits. RNase protection assay has further demonstrated that the expression of $\alpha_{1A}$ and $\beta_4$ subunits increased during cerebellar development, while the amount of $\beta_2$ and $\beta_3$ mRNAs did not significantly change. In addition, a $\beta_4$ transcript was present in cultured cerebellar granule cells, but not in astrocyte cells, and the level of $\beta_4$ mRNA expression increased gradually in vitro seen as in vivo. Based on the spatial and temporal expression patterns of $\beta_4$ subunit, we conclude that $\beta_4$ may predominantly associate, but probably not exclusively, with the $\alpha_{1A}$ subunit in rat cerebellar granule cells.

  • PDF

A Fuzzy Spatiotemporal Data Model and Dynamic Query Operations

  • Nhan, Vu Thi Hong;Kim, Sang-Ho;Ryu, Keun-Ho
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2003년도 Proceedings of ACRS 2003 ISRS
    • /
    • pp.564-566
    • /
    • 2003
  • There are no immutable phenomena in reality. A lot of applications are dealing with data characterized by spatial and temporal and/or uncertain features. Currently, there has no any data model accommodating enough those three elements of spatial objects to directly use in application systems. For such reasons, we introduce a fuzzy spatio -temporal data model (FSTDM) and a method of integrating temporal and fuzzy spatial operators in a unified manner to create fuzzy spatio -temporal (FST) operators. With these operators, complex query expression will become concise. Our research is feasible to apply to the management systems and query processor of natural resource data, weather information, graphic information, and so on.

  • PDF