• Title/Summary/Keyword: Frame Extraction

Search Result 324, Processing Time 0.024 seconds

Structural health monitoring data anomaly detection by transformer enhanced densely connected neural networks

  • Jun, Li;Wupeng, Chen;Gao, Fan
    • Smart Structures and Systems
    • /
    • v.30 no.6
    • /
    • pp.613-626
    • /
    • 2022
  • Guaranteeing the quality and integrity of structural health monitoring (SHM) data is very important for an effective assessment of structural condition. However, sensory system may malfunction due to sensor fault or harsh operational environment, resulting in multiple types of data anomaly existing in the measured data. Efficiently and automatically identifying anomalies from the vast amounts of measured data is significant for assessing the structural conditions and early warning for structural failure in SHM. The major challenges of current automated data anomaly detection methods are the imbalance of dataset categories. In terms of the feature of actual anomalous data, this paper proposes a data anomaly detection method based on data-level and deep learning technique for SHM of civil engineering structures. The proposed method consists of a data balancing phase to prepare a comprehensive training dataset based on data-level technique, and an anomaly detection phase based on a sophisticatedly designed network. The advanced densely connected convolutional network (DenseNet) and Transformer encoder are embedded in the specific network to facilitate extraction of both detail and global features of response data, and to establish the mapping between the highest level of abstractive features and data anomaly class. Numerical studies on a steel frame model are conducted to evaluate the performance and noise immunity of using the proposed network for data anomaly detection. The applicability of the proposed method for data anomaly classification is validated with the measured data of a practical supertall structure. The proposed method presents a remarkable performance on data anomaly detection, which reaches a 95.7% overall accuracy with practical engineering structural monitoring data, which demonstrates the effectiveness of data balancing and the robust classification capability of the proposed network.

Complete genome and phylogenetic analysis of bovine papillomavirus type 15 in Southern Xinjiang dairy cow

  • Hu, Jianjun;Zhang, Wanqi;Chauhan, Surinder Singh;Shi, Changqing;Song, Yumeng;Zhao, Yubing;Wang, Zhehong;Cheng, Long;Zhang, Yingyu
    • Journal of Veterinary Science
    • /
    • v.21 no.6
    • /
    • pp.73.1-73.10
    • /
    • 2020
  • Background: Bovine papilloma is a neoplastic disease caused by bovine papillomaviruses (BPVs), which were recently divided into 5 genera and at least 24 genotypes. Objectives: The complete genome sequence of BPV type 15 (BPV Aks-02), a novel putative BPV type from skin samples from infected cows in Southern Xinjiang China, was determined by collecting warty lesions, followed by DNA extraction and amplicon sequencing. Methods: DNA was analyzed initially by polymerase chain reaction (PCR) using the degenerate primers FAP59 and FAP64. The complete genome sequences of the BPV Aks-02 were amplified by PCR using the amplification primers and sequencing primers. Sequence analysis and phylogenetic analysis were performed using bio-informatic software. Results: The nucleotide sequence of the L1 open reading frame (ORF) of BPV Aks-02 was 75% identity to the L1 ORF of BPV-9 reference strain from GenBank. The complete genome consisted of 7,189 base pairs (G + C content of 42.50%) that encoded 5 early (E8, E7, E1, E2, and E4) and 2 late (L1 and L2) genes. The E7 protein contained a consensus CX2CX29CX2C zinc-binding domain and a LxCxE motif. Among the different members of this group, the percentages of the complete genome and ORFs (including 5 early and 2 late ORFs) sequence identity of BPV Aks-02 were closer to the genus Xipapillomavirus 1 of the Xipapillomavirus genus. Phylogenetic analysis and sequence similarities based on the L1 ORF of BPV Aks-02 revealed the same cluster. Conclusions: The results suggest that BPV type (BPV Aks-02) clustered with members of the Xipapillomavirus genus as BPV 15 and were closely related to Xipapillomavirus 1.

Frontal Face Video Analysis for Detecting Fatigue States

  • Cha, Simyeong;Ha, Jongwoo;Yoon, Soungwoong;Ahn, Chang-Won
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.6
    • /
    • pp.43-52
    • /
    • 2022
  • We can sense somebody's feeling fatigue, which means that fatigue can be detected through sensing human biometric signals. Numerous researches for assessing fatigue are mostly focused on diagnosing the edge of disease-level fatigue. In this study, we adapt quantitative analysis approaches for estimating qualitative data, and propose video analysis models for measuring fatigue state. Proposed three deep-learning based classification models selectively include stages of video analysis: object detection, feature extraction and time-series frame analysis algorithms to evaluate each stage's effect toward dividing the state of fatigue. Using frontal face videos collected from various fatigue situations, our CNN model shows 0.67 accuracy, which means that we empirically show the video analysis models can meaningfully detect fatigue state. Also we suggest the way of model adaptation when training and validating video data for classifying fatigue.

Automatic analysis of golf swing from single-camera video sequences (단일 카메라 영상으로부터 골프 스윙의 자동 분석)

  • Kim, Pyeoung-Kee
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.14 no.5
    • /
    • pp.139-148
    • /
    • 2009
  • In this paper, I propose an automatic analysis method of golf swine from single-camera video sequences. I define necessary swing features for automatic swing analysis in 2-dimensional environment and present efficient swing analysis methods using various image processing techniques including line and edge detection. The proposed method has two characteristics compared with previous swing analysis systems and related studies. First, the proposed method enables an automatic swing analysis in 2-dimension while previous systems require 3-dimensional environment which is relatively complex and expensive to run. Second, swing analysis is done automatically without human intervention while other 2-dimensional systems necessarily need analysis by a golf expert. I tested the method on 20 swing video sequences and found the proposed method works effective for automatic analysis of golf swing.

Cloning of a Glutathione S-Transferase Decreasing During Differentiation of HL60 Cell Line (HL6O 세포주의 분화 시 감소 특성을 보이는 Glutathione S-Transferase의 클로닝)

  • Kim Jae Chul;Park In Kyu;Lee Kyu Bo;Sohn Sang Kyun;Kim Moo Kyu;Kim Jung Chul
    • Radiation Oncology Journal
    • /
    • v.17 no.2
    • /
    • pp.151-157
    • /
    • 1999
  • Purpose : By sequencing the Erpressed Sequence Tags of human 걸ermal papilla CDNA library, we identified a clone named K872 of which the expression decreased during differentiation of HL6O cell line. Materials and Methods : K872 plasmid DNA was isolated according to QIA plasmid extraction kit (Qiagen GmbH, Germany). The nucleotide sequencing was performed by Sanger's method with K872 plasmid DNA. The most updated GenBank EMBL necleic acid banks were searched through the internet by using BLAST (Basic Local Alignment Search Tools) program. Nothern bots were performed using RNA isolated from various human tissues and cancer cell lines. The gene expression of the fusion protein was achieved by His-Patch Thiofusicn expression system and the protein product was identified on SDS-PAGE. Results : K872 clone is 1006 nucleotides long, and has a coding region of 675 nucleotides and a 3' non-coding region of 280 nucleotides. The presumed open reading frame starting at the 5' terminus of K872 encodes 226 amino acids, including the initiation methionine residue. The amino acid sequence deduced from the open reading frame of K872 shares $70\%$, identity with that of rat glutathione 5-transferase kappa 1 (rGSTKl). The transcripts were expressed in a variety of human tissues and cancer cells. The levels of transcript were relatively high in those tissues such as heart, skeletal muscle, and peripheral blood leukocyte. It is noteworthy that K872 was found to be abundantly expressed in coloreetal cancer and melanoma cell lines. Conclusion : Homology search result suggests that K872 clone is the human homolog of the rGSTK1 which is known to be involved in the resistance of cytotoxic therapy. We propose that meticulous functional analysis should be followed to confirm that.

  • PDF

BoF based Action Recognition using Spatio-Temporal 2D Descriptor (시공간 2D 특징 설명자를 사용한 BOF 방식의 동작인식)

  • KIM, JinOk
    • Journal of Internet Computing and Services
    • /
    • v.16 no.3
    • /
    • pp.21-32
    • /
    • 2015
  • Since spatio-temporal local features for video representation have become an important issue of modeless bottom-up approaches in action recognition, various methods for feature extraction and description have been proposed in many papers. In particular, BoF(bag of features) has been promised coherent recognition results. The most important part for BoF is how to represent dynamic information of actions in videos. Most of existing BoF methods consider the video as a spatio-temporal volume and describe neighboring 3D interest points as complex volumetric patches. To simplify these complex 3D methods, this paper proposes a novel method that builds BoF representation as a way to learn 2D interest points directly from video data. The basic idea of proposed method is to gather feature points not only from 2D xy spatial planes of traditional frames, but from the 2D time axis called spatio-temporal frame as well. Such spatial-temporal features are able to capture dynamic information from the action videos and are well-suited to recognize human actions without need of 3D extensions for the feature descriptors. The spatio-temporal BoF approach using SIFT and SURF feature descriptors obtains good recognition rates on a well-known actions recognition dataset. Compared with more sophisticated scheme of 3D based HoG/HoF descriptors, proposed method is easier to compute and simpler to understand.

Fast Natural Feature Tracking Using Optical Flow (광류를 사용한 빠른 자연특징 추적)

  • Bae, Byung-Jo;Park, Jong-Seung
    • The KIPS Transactions:PartB
    • /
    • v.17B no.5
    • /
    • pp.345-354
    • /
    • 2010
  • Visual tracking techniques for Augmented Reality are classified as either a marker tracking approach or a natural feature tracking approach. Marker-based tracking algorithms can be efficiently implemented sufficient to work in real-time on mobile devices. On the other hand, natural feature tracking methods require a lot of computationally expensive procedures. Most previous natural feature tracking methods include heavy feature extraction and pattern matching procedures for each of the input image frame. It is difficult to implement real-time augmented reality applications including the capability of natural feature tracking on low performance devices. The required computational time cost is also in proportion to the number of patterns to be matched. To speed up the natural feature tracking process, we propose a novel fast tracking method based on optical flow. We implemented the proposed method on mobile devices to run in real-time and be appropriately used with mobile augmented reality applications. Moreover, during tracking, we keep up the total number of feature points by inserting new feature points proportional to the number of vanished feature points. Experimental results showed that the proposed method reduces the computational cost and also stabilizes the camera pose estimation results.

A Study on ACFBD-MPC in 8kbps (8kbps에 있어서 ACFBD-MPC에 관한 연구)

  • Lee, See-Woo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.7
    • /
    • pp.49-53
    • /
    • 2016
  • Recently, the use of signal compression methods to improve the efficiency of wireless networks have increased. In particular, the MPC system was used in the pitch extraction method and the excitation source of voiced and unvoiced to reduce the bit rate. In general, the MPC system using an excitation source of voiced and unvoiced would result in a distortion of the synthesis speech waveform in the case of voiced and unvoiced consonants in a frame. This is caused by normalization of the synthesis speech waveform in the process of restoring the multi-pulses of the representation segment. This paper presents an ACFBD-MPC (Amplitude Compensation Frequency Band Division-Multi Pulse Coding) using amplitude compensation in a multi-pulses each pitch interval and specific frequency to reduce the distortion of the synthesis speech waveform. The experiments were performed with 16 sentences of male and female voices. The voice signal was A/D converted to 10kHz 12bit. In addition, the ACFBD-MPC system was realized and the SNR of the ACFBD-MPC estimated in the coding condition of 8kbps. As a result, the SNR of ACFBD-MPC was 13.6dB for the female voice and 14.2dB for the male voice. The ACFBD-MPC improved the male and female voice by 1 dB and 0.9 dB, respectively, compared to the traditional MPC. This method is expected to be used for cellular telephones and smartphones using the excitation source with a low bit rate.

A Study on the Development of Dynamic Models under Inter Port Competition (항만의 경쟁상황을 고려한 동적모형 개발에 관한 연구)

  • 여기태;이철영
    • Journal of the Korean Institute of Navigation
    • /
    • v.23 no.1
    • /
    • pp.75-84
    • /
    • 1999
  • Although many studies on modelling of port competitive situation have been conducted, both theoretical frame and methodology are still very weak. In this study, therefore, a new algorithm called ESD (Extensional System Dynamics) for the evaluation of port competition was presented, and applied to simulate port systems in northeast asia. The detailed objectives of this paper are to develop Unit fort Model by using SD(System Dynamics) method; to develop Competitive Port Model by ESD method; to perform sensitivity analysis by altering parameters, and to propose port development strategies. For these the algorithm for the evaluation of part's competition was developed in two steps. Firstly, SD method was adopted to develop the Unit Port models, and secondly HFP(Hierarchical Fuzzy Process) method was introduced to expand previous SD method. The proposed models were then developed and applied to the five ports - Pusan, Kobe, Yokohama, Kaoshiung, Keelung - with real data on each ports, and several findings were derived. Firstly, the extraction of factors for Unit Port was accomplished by consultation of experts such as research worker, professor, research fellows related to harbor, and expert group, and finally, five factor groups - location, facility, service, cargo volumes, and port charge - were obtained. Secondly, system's structure consisting of feedback loop was found easily by location of representative and detailed factors on keyword network of STGB map. Using these keyword network, feedback loop was found. Thirdly, for the target year of 2003, the simulation for Pusan port revealed that liner's number would be increased from 829 ships to 1,450 ships and container cargo volumes increased from 4.56 million TEU to 7.74 million TEU. It also revealed that because of increased liners and container cargo volumes, length of berth should be expanded from 2,162m to 4,729m. This berth expansion was resulted in the decrease of congested ship's number from 97 to 11. It was also found that port's charge had a fluctuation. Results of simulation for Kobe, Yokohama, Kaoshiung, Keelung in northeast asia were also acquired. Finally, the inter port competition models developed by ESB method were used to simulate container cargo volumes for Pusan port. The results revealed that under competitive situation container cargo volume was smaller than non-competitive situation, which means Pusan port is lack of competitive power to other ports. Developed models in this study were then applied to estimate change of container cargo volumes in competitive relation by altering several parameters. And, the results were found to be very helpful for port mangers who are in charge of planning of port development.

  • PDF

High-resolution 3D Object Reconstruction using Multiple Cameras (다수의 카메라를 활용한 고해상도 3차원 객체 복원 시스템)

  • Hwang, Sung Soo;Yoo, Jisung;Kim, Hee-Dong;Kim, Sujung;Paeng, Kyunghyun;Kim, Seong Dae
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.10
    • /
    • pp.150-161
    • /
    • 2013
  • This paper presents a new system which produces high resolution 3D contents by capturing multiview images of an object using multiple cameras, and estimating geometric and texture information of the object from the captured images. Even though a variety of multiview image-based 3D reconstruction systems have been proposed, it was difficult to generate high resolution 3D contents because multiview image-based 3D reconstruction requires a large amount of memory and computation. In order to reduce computational complexity and memory size for 3D reconstruction, the proposed system predetermines the regions in input images where an object can exist to extract object boundaries fast. And for fast computation of a visual hull, the system represents silhouettes and 3D-2D projection/back-projection relations by chain codes and 1D homographies, respectively. The geometric data of the reconstructed object is compactly represented by a 3D segment-based data format which is called DoCube, and the 3D object is finally reconstructed after 3D mesh generation and texture mapping are performed. Experimental results show that the proposed system produces 3D object contents of $800{\times}800{\times}800$ resolution with a rate of 2.2 seconds per frame.