• 제목/요약/키워드: Automated Feature Extraction

검색결과 61건 처리시간 0.034초

트랜잭션 기반 머신러닝에서 특성 추출 자동화를 위한 딥러닝 응용 (A Deep Learning Application for Automated Feature Extraction in Transaction-based Machine Learning)

  • 우덕채;문현실;권순범;조윤호
    • 한국IT서비스학회지
    • /
    • 제18권2호
    • /
    • pp.143-159
    • /
    • 2019
  • Machine learning (ML) is a method of fitting given data to a mathematical model to derive insights or to predict. In the age of big data, where the amount of available data increases exponentially due to the development of information technology and smart devices, ML shows high prediction performance due to pattern detection without bias. The feature engineering that generates the features that can explain the problem to be solved in the ML process has a great influence on the performance and its importance is continuously emphasized. Despite this importance, however, it is still considered a difficult task as it requires a thorough understanding of the domain characteristics as well as an understanding of source data and the iterative procedure. Therefore, we propose methods to apply deep learning for solving the complexity and difficulty of feature extraction and improving the performance of ML model. Unlike other techniques, the most common reason for the superior performance of deep learning techniques in complex unstructured data processing is that it is possible to extract features from the source data itself. In order to apply these advantages to the business problems, we propose deep learning based methods that can automatically extract features from transaction data or directly predict and classify target variables. In particular, we applied techniques that show high performance in existing text processing based on the structural similarity between transaction data and text data. And we also verified the suitability of each method according to the characteristics of transaction data. Through our study, it is possible not only to search for the possibility of automated feature extraction but also to obtain a benchmark model that shows a certain level of performance before performing the feature extraction task by a human. In addition, it is expected that it will be able to provide guidelines for choosing a suitable deep learning model based on the business problem and the data characteristics.

Improved Algorithm for Fully-automated Neural Spike Sorting based on Projection Pursuit and Gaussian Mixture Model

  • Kim, Kyung-Hwan
    • International Journal of Control, Automation, and Systems
    • /
    • 제4권6호
    • /
    • pp.705-713
    • /
    • 2006
  • For the analysis of multiunit extracellular neural signals as multiple spike trains, neural spike sorting is essential. Existing algorithms for the spike sorting have been unsatisfactory when the signal-to-noise ratio(SNR) is low, especially for implementation of fully-automated systems. We present a novel method that shows satisfactory performance even under low SNR, and compare its performance with a recent method based on principal component analysis(PCA) and fuzzy c-means(FCM) clustering algorithm. Our system consists of a spike detector that shows high performance under low SNR, a feature extractor that utilizes projection pursuit based on negentropy maximization, and an unsupervised classifier based on Gaussian mixture model. It is shown that the proposed feature extractor gives better performance compared to the PCA, and the proposed combination of spike detector, feature extraction, and unsupervised classification yields much better performance than the PCA-FCM, in that the realization of fully-automated unsupervised spike sorting becomes more feasible.

Automated Markerless Analysis of Human Gait Motion for Recognition and Classification

  • Yoo, Jang-Hee;Nixon, Mark S.
    • ETRI Journal
    • /
    • 제33권2호
    • /
    • pp.259-266
    • /
    • 2011
  • We present a new method for an automated markerless system to describe, analyze, and classify human gait motion. The automated system consists of three stages: I) detection and extraction of the moving human body and its contour from image sequences, ii) extraction of gait figures by the joint angles and body points, and iii) analysis of motion parameters and feature extraction for classifying human gait. A sequential set of 2D stick figures is used to represent the human gait motion, and the features based on motion parameters are determined from the sequence of extracted gait figures. Then, a k-nearest neighbor classifier is used to classify the gait patterns. In experiments, this provides an alternative estimate of biomechanical parameters on a large population of subjects, suggesting that the estimate of variance by marker-based techniques appeared generous. This is a very effective and well-defined representation method for analyzing the gait motion. As such, the markerless approach confirms uniqueness of the gait as earlier studies and encourages further development along these lines.

강건한 특징점 추출을 이용한 철강제품 정보 검출을 위한 전처리 알고리즘 (Pre-processing Algorithm for Detection of Slab Information on Steel Process using Robust Feature Points extraction)

  • 최종현;윤종필;최성후;구근휘;김상우
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2008년도 제39회 하계학술대회
    • /
    • pp.1819-1820
    • /
    • 2008
  • Steel slabs are marked with slab management numbers (SMNs). To increase efficiency, automated identification of SMNs from digital images is desirable. Automatic extraction of SMNs is a prerequisite for automatic character segmentation and recognition. The images include complex background, and the position of the text region of the slabs is variable. This paper describes an pre-processing algorithm for detection of slab information using robust feature points extraction. Using SIFT(Scale Invariant Feature Transform) algorithm, we can reduce the search region for extraction of SMNs from the slab image.

  • PDF

Development of Digital Surface Model and Feature Extraction by Integrating Laser Scanner and CCD sensor

  • Nagai, Masahiko;Shibasaki, Ryosuke;Zhao, Huijing;Manandhar, Dinesh
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2003년도 Proceedings of ACRS 2003 ISRS
    • /
    • pp.859-861
    • /
    • 2003
  • In order to present a space in details, it is indispensable to acquire 3D shape and texture simultaneously from the same platform. 3D shape is acquired by Laser Scanner as point cloud data, and texture is acquired by CCD sensor. Positioning data is acquired by IMU (Inertial Measurement Unit). All the sensors and equipments are assembled on a hand-trolley. In this research, a method of integrating the 3D shape and texture for automated construction of Digital Surface Model is developed. This Digital Surface Model is applied for efficient feature extraction. More detailed extraction is possible , because 3D Digital Surface Model has both 3D shape and texture information.

  • PDF

A Novel Model for Smart Breast Cancer Detection in Thermogram Images

  • Kazerouni, Iman Abaspur;Zadeh, Hossein Ghayoumi;Haddadnia, Javad
    • Asian Pacific Journal of Cancer Prevention
    • /
    • 제15권24호
    • /
    • pp.10573-10576
    • /
    • 2015
  • Background: Accuracy in feature extraction is an important factor in image classification and retrieval. In this paper, a breast tissue density classification and image retrieval model is introduced for breast cancer detection based on thermographic images. The new method of thermographic image analysis for automated detection of high tumor risk areas, based on two-directional two-dimensional principal component analysis technique for feature extraction, and a support vector machine for thermographic image retrieval was tested on 400 images. The sensitivity and specificity of the model are 100% and 98%, respectively.

Road Extraction Based on Watershed Segmentation for High Resolution Satellite Images

  • Chang, Li-Yu;Chen, Chi-Farn
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2003년도 Proceedings of ACRS 2003 ISRS
    • /
    • pp.525-527
    • /
    • 2003
  • Recently, the spatial resolution of earth observation satellites is significantly increased to a few meters. Such high spatial resolution images definitely will provide lots of information for detail-thirsty remote sensing users. However, it is more difficult to develop automated image algorithms for automated image feature extraction and pattern recognition. In this study, we propose a two-stage procedure to extract road information from high resolution satellite images. At first stage, a watershed segmentation technique is developed to classify the image into various regions. Then, a knowledge is built for road and used to extract the road regions. In this study, we use panchromatic and multi-spectral images of the IKONOS satellite as test dataset. The experiment result shows that the proposed technique can generate suitable and meaningful road objects from high spatial resolution satellite images. Apparently, misclassified regions such as parking lots are recognized as road needed further refinement in future research.

  • PDF

신경회로망을 이용한 냉연 표면흠 분류를 위한 계층적 분류기의 설계 (Design of Hierarchical Classifier for Classifying Defects of Cold Mill Strip using Neural Networks)

  • 김경민;류경;정우용;박귀태;박중조
    • 제어로봇시스템학회논문지
    • /
    • 제4권4호
    • /
    • pp.499-505
    • /
    • 1998
  • In developing an automated surface inspect algorithm, we have designed a hierarchical classifier using neural network. The defects which exist on the surface of cold mill strip have a scattering or singular distribution. We have considered three major problems, that is preprocessing, feature extraction and defect classification. In preprocessing, Top-hit transform, adaptive thresholding, thinning and noise rejection are used Especially, Top-hit transform using local minimax operation diminishes the effect of bad lighting. In feature extraction, geometric, moment, co-occurrence matrix, and histogram ratio features are calculated. The histogram ratio feature is taken from the gray-level image. For defect classification, we suggest a hierarchical structure of which nodes are multilayer neural network classifiers. The proposed algorithm reduced error rate by comparing to one-stage structure.

  • PDF

방향성 특징을 이용한 이미지 검색 (Image Retrieval Using Directional Features)

  • 정호영;황환규
    • 산업기술연구
    • /
    • 제20권B호
    • /
    • pp.207-211
    • /
    • 2000
  • For efficient massive image retrieval, an image retrieval requires that several important objectives are satisfied, namely: automated extraction of features, efficient indexing and effective retrieval. In this work, we present a technique for extracting the 4-dimension directional feature. By directional detail, we imply strong directional activity in the horizontal, vertical and diagonal direction present in region of the image texture. This directional information also present smoothness of region. The 4-dimension feature is only indexed in the 4-D space so that complex high-dimensional indexing can be avoided.

  • PDF

Design and Implementation of an Automated Fruit Quality Classification System

  • Choi, Han Suk
    • 스마트미디어저널
    • /
    • 제7권4호
    • /
    • pp.37-43
    • /
    • 2018
  • Most of fruit quality classification has been done by time consuming, inaccurate and intensive manual labor. This study proposed an automated fruit grading system based on appearances and internal flavors. In this study, image processing technique and a weight checker were used to measure the value of appearance features and the near infrared spectroscopy analysis method was used to estimate the value of internal flavors. Additionally, I suggested 8x8x5x5 ANN based fruit quality classifier model to grade fruits quality. The proposed automated fruit quality classification system is expected to be very beneficial for many farms where heavy manual labor is usually needed for fruit quality classification.