• Title/Summary/Keyword: Preprocessing Process

Search Result 422, Processing Time 0.03 seconds

An Implementation of Preprocessing for Interior Point Methods for Linear Programming (내부점 방법을 위한 사전처리의 구현)

  • 성명기;임성묵;박순달
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.24 no.1
    • /
    • pp.1-11
    • /
    • 1999
  • We classified preprocessing methods into (1) analytic methods, (2) methods for removing implied free variables, (3) methods using pivot or elementary row operations, (4) methods for removing linearly dependent rows and columns and (5) methods for dense columns. We noted some considerations to which should be paid attention when preprocessing methods are applied to interior point methods for linear programming. We proposed an efficient order of preprocessing methods and data structures. We also noted the recovery process for dual solutions. We implemented the proposed preprocessing methods. and tested it with 28 large scale problems of NETLIB. We compared the results of it with those of preprocessing routines of HOPDM, BPDPM and CPLEX.

  • PDF

The Tracing Algorithm for Center Pixel of Character Image and the Design of Neural Chip (문자영상의 중심화소 추적 알고리즘 및 신경칩 설계)

  • 고휘진;여진경;정호선
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.29B no.8
    • /
    • pp.35-43
    • /
    • 1992
  • We have presented the tracing algorithm for center pixel of character image. Character image was read by scanner device. Performing the tracing process, it can be possible to detect feature points, such as branch point, stroke of 4 directions. So, the tracing process covers the thinning and feature point detection process for improving the processing time. Usage of suggested tracing algorithm instead of thinning that is the preprocessing of character recognition increases speed up to 5 times. The preprocessing chip has been designed by using single layer perceptron algorithm.

  • PDF

Data Management and Analysis in Foundry Industry (1) (주조공정 데이터 처리 및 분석 (1))

  • Cho, In-Sung
    • Journal of Korea Foundry Society
    • /
    • v.42 no.1
    • /
    • pp.35-41
    • /
    • 2022
  • In the present paper, the data management of casting processes has been discussed. In order to construct a smart factory in the foundry industry, understanding of the whole casting processes has to be in the first place. Casting process data can be obtained at the kiosk operated by casting engineers and data acquired by sensors in the foundry facility. However, preprocessing of the casting process data must be carried out in order to analyze the casting process by the data. Techniques and some examples for data preprocessing in the foundry was introduced.

Analyzing Preprocessing for Correcting Lighting Effects in Hyperspectral Images (초분광영상의 조명효과 보정 전처리기법 분석)

  • Yeong-Sun Song
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.26 no.5
    • /
    • pp.785-792
    • /
    • 2023
  • Because hyperspectral imaging provides detailed spectral information across a broad range of wavelengths, it can be utilized in numerous applications, including environmental monitoring, food quality inspection, medical diagnosis, material identification, art authentication, and crime scene analysis. However, hyperspectral images often contain various types of distortions due to the environmental conditions during image acquisition, which necessitates the proper removal of these distortions through a data preprocessing process. In this study, a preprocessing method was investigated to effectively correct the distortion caused by artificial light sources used in indoor hyperspectral imaging. For this purpose, a halogen-tungsten artificial light source was installed indoors, and hyperspectral images were acquired. The acquired images were then corrected for distortion using a preprocessing that does not require complex auxiliary equipment. After the corrections were made, the results were analyzed. According to the analysis, a statistical transformation technique using mean and standard deviation with reference to a reference signal was found to be the most effective in correcting distortions caused by artificial light sources.

Effects of Preprocessing on Text Classification in Balanced and Imbalanced Datasets

  • Mehmet F. Karaca
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.18 no.3
    • /
    • pp.591-609
    • /
    • 2024
  • In this study, preprocessings with all combinations were examined in terms of the effects on decreasing word number, shortening the duration of the process and the classification success in balanced and imbalanced datasets which were unbalanced in different ratios. The decreases in the word number and the processing time provided by preprocessings were interrelated. It was seen that more successful classifications were made with Turkish datasets and English datasets were affected more from the situation of whether the dataset is balanced or not. It was found out that the incorrect classifications, which are in the classes having few documents in highly imbalanced datasets, were made by assigning to the class close to the related class in terms of topic in Turkish datasets and to the class which have many documents in English datasets. In terms of average scores, the highest classification was obtained in Turkish datasets as follows: with not applying lowercase, applying stemming and removing stop words, and in English datasets as follows: with applying lowercase and stemming, removing stop words. Applying stemming was the most important preprocessing method which increases the success in Turkish datasets, whereas removing stop words in English datasets. The maximum scores revealed that feature selection, feature size and classifier are more effective than preprocessing in classification success. It was concluded that preprocessing is necessary for text classification because it shortens the processing time and can achieve high classification success, a preprocessing method does not have the same effect in all languages, and different preprocessing methods are more successful for different languages.

Dedicated hardware implementation for real time noise elimination of 2-valued image (실시간 처리를 위한 2차 화상의 잡음 제거 전용 하드웨어 구성)

  • Park, In-Jung;Lee, Dong-Chan
    • Proceedings of the KIEE Conference
    • /
    • 1988.07a
    • /
    • pp.243-246
    • /
    • 1988
  • A lot of time is required in order to the process of loop repeating the preprocessing operated in the software. Specially in the preprocessing, most of the time is used for the noise elimination such a software algorithm component of a noise elimination hardware, this can operate quickly the process.

  • PDF

Real-Time Generation of City Map for Games in Unity with View-dependent Refinement and Pattern Synthesis Algorithm

  • Kim, Jong-Hyun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.4
    • /
    • pp.51-56
    • /
    • 2019
  • In this paper, we propose an algorithm that can quickly generate and synthesize city maps in racing games. Racing games are characterized by moving a wide map rather than a fixed map, but designing and developing a wide map requires a lot of production time. This problem can be mitigated by creating a large map in the preprocessing step, but a fixed map makes the game tedious. It is also inefficient to process all the various maps in the preprocessing step. In order to solve this problem, we propose a technique to create a terrain pattern in the preprocessing process, to generate a map in real time, and to synthesize various maps randomly. In addition, we reduced unnecessary rendering computations by integrating view-dependent techniques into the proposed framework. This study was developed in Unity3D and can be used for various contents as well as racing game.

A Study on Development Environments for Machine Learning (머신러닝 자동화를 위한 개발 환경에 관한 연구)

  • Kim, Dong Gil;Park, Yong-Soon;Park, Lae-Jeong;Chung, Tae-Yun
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.15 no.6
    • /
    • pp.307-316
    • /
    • 2020
  • Machine learning model data is highly affected by performance. preprocessing is needed to enable analysis of various types of data, such as letters, numbers, and special characters. This paper proposes a development environment that aims to process categorical and continuous data according to the type of missing values in stage 1, implementing the function of selecting the best performing algorithm in stage 2 and automating the process of checking model performance in stage 3. Using this model, machine learning models can be created without prior knowledge of data preprocessing.

A Study on Real-time Data Preprocessing Technique for Small Millimeter Wave Radar (소형 밀리미터파 레이더를 위한 실시간 데이터 전처리 방법 연구)

  • Choi, Jinkyu;Shin, Youngcheol;Hong, Soonil;Park, Changhyun;Kim, Younjin;Kim, Hongrak;Kwon, Junbeom
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.19 no.6
    • /
    • pp.79-85
    • /
    • 2019
  • Recently, small radar require the development of small millimeter wave radar with high distance resolution to disable the target's system with a single strike. Small millimeter wave radar with high distance resolution need to process large amounts of data in real time to acquire and track target. In this paper, we summarized the real-time data preprocessing method to process the large amount of data required for small millimeter wave radar. In addition, the digital IF(Intermediate Frequency) receiver, Window processing, and, DFT(Discrete Fourier Transform) functions presented by real-time data preprocessing are implemented using FPGA(Field Programmable Gate Array). Finally the implemented real-time data preprocessing module was applied to the signal processor for small millimeter wave radar and verified by performance test related to the real-time preprocessing function.

Effect of Plasma Treatment Times on the Adhesion of Cu/Ni Thin Film to Polyimide (폴리이미드와 Cu/Ni층과의 계면결합력에 미치는 플라즈마 처리 시간 효과)

  • Woo, Tae-Gyu;Park, Il-Song;Jung, Kwang-Hee;Jeon, Woo-Yong;Seol, Kyeong-Won
    • Korean Journal of Metals and Materials
    • /
    • v.49 no.8
    • /
    • pp.657-663
    • /
    • 2011
  • This study represents the results of the peel strength and surface morphology according to the preprocessing times of polyimide (PI) in a Cu/Ni/PI structure flexible copper clad laminate production process based on the polyimide. Field emission scanning electron microscopy, X-ray diffraction, and X-ray photoelectron spectroscopy were used to analyze the surface morphology, crystal structure, and interface binding structure of sputtered Ni, Cu, and electrodeposited copper foil layers. The surface roughness of Ni, Cu deposition layers and the crystal structure of electrodeposited Cu layers were varied according to the preprocessing times. In the RF plasma times that were varied by 100-600 seconds in a preprocessing process, the preprocessing applied by about 300-400 seconds showed a homogeneous surface morphology in the metal layers and that also represented high peel strength for the polyimide. Considering the effect of peel strength on plastic deformation, preprocessing times can reasonably be at about 400 seconds.