• Title/Summary/Keyword: batch processing

Search Result 297, Processing Time 0.024 seconds

An Adaptive Workflow Scheduling Scheme Based on an Estimated Data Processing Rate for Next Generation Sequencing in Cloud Computing

  • Kim, Byungsang;Youn, Chan-Hyun;Park, Yong-Sung;Lee, Yonggyu;Choi, Wan
    • Journal of Information Processing Systems
    • /
    • v.8 no.4
    • /
    • pp.555-566
    • /
    • 2012
  • The cloud environment makes it possible to analyze large data sets in a scalable computing infrastructure. In the bioinformatics field, the applications are composed of the complex workflow tasks, which require huge data storage as well as a computing-intensive parallel workload. Many approaches have been introduced in distributed solutions. However, they focus on static resource provisioning with a batch-processing scheme in a local computing farm and data storage. In the case of a large-scale workflow system, it is inevitable and valuable to outsource the entire or a part of their tasks to public clouds for reducing resource costs. The problems, however, occurred at the transfer time for huge dataset as well as there being an unbalanced completion time of different problem sizes. In this paper, we propose an adaptive resource-provisioning scheme that includes run-time data distribution and collection services for hiding the data transfer time. The proposed adaptive resource-provisioning scheme optimizes the allocation ratio of computing elements to the different datasets in order to minimize the total makespan under resource constraints. We conducted the experiments with a well-known sequence alignment algorithm and the results showed that the proposed scheme is efficient for the cloud environment.

Finite Element Analysis of Continuous Rotary-Die Equal Channel Angular Pressing (연속 회전 등통로각압축 공정의 유한요소해석)

  • Yoon, Seung-Chae;Seo, Min-Hong;Kim, Hyoung-Seop
    • Transactions of Materials Processing
    • /
    • v.15 no.7 s.88
    • /
    • pp.524-528
    • /
    • 2006
  • Although equal channel angular pressing (ECAP), imposing large plastic shear strain deformation by moving a workpiece through two intersecting channels, is a promising severe plastic deformation method for grain refinement of metallic materials, its batch type characteristic makes ECAP inefficient for multiple-passing. Rotary-die ECAP (RDECAP) proposed by Nishida et al. can achieve high productivity by using continuous processing without taking out the samples from the channel. However, plastic deformation behavior during RD-ECAP has not been investigated. In this study, material plastic flow and strain hardening behavior of the workpiece during RD-ECAP was investigated using the finite element method. It was found that plastic deformation becomes inhomogeneous with the number of passes due to an end effect, which was not found seriously in ECAP. Especially, decreasing corner gap with increasing the number of passes was observed and explained by the strain hardening effect.

A Scheduling Support System for Non-identical Parallel Machine Lines (이종병렬기계생산의 일정계획지원 시스템)

  • 정남기;정민영
    • Korean Management Science Review
    • /
    • v.17 no.2
    • /
    • pp.67-73
    • /
    • 2000
  • This paper describes a scheduling support system for a plant where the machine environment may be modeled as non-identical parallel machine lines (NPML). That is, there are a number of stages in series with various different-capability-machines at each stage. Arriving continuously are jobs with their specific due dates, processing times and candidate processing machines. We’ve developed a real-time scheduling module in conjunction with a supporting production information system which supplies necessary data to the module. This scheduling module is one of the 9 modules in this system, and is composed of both a scheduling interface and a production monitoring interface. This module allows users to generate many candidate schedules by selecting their business policies. The selective arguments which are available consist of allocation costs, batch sizes and machine selection intervals. They are now being implemented at a powder metallurgy plant.

  • PDF

Operation-sequence-based Approach for Designing a U-shaped Independent-Cell System with Machine Requirement Incorporated (설비능력과 작업순서를 고려한 U-라인상에서의 셀 시스템 설계)

  • 박연기;성창섭;정병호
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.26 no.1
    • /
    • pp.71-85
    • /
    • 2001
  • This paper considers a cost model for a U-shaped manufacturing cell formation which incorporates a required number of machines and various material flows together under multi-part multi-cell environment. The model is required to satisfy both the specified operation sequence of each part and the total part demand volume, which are considered to derive material handling cost in U-shaped flow line cells. In the model several cost-incurring factors including set-up for batch change-over, processing time for operations of each part, and machine failures are also considered in association with processing load and capacity of each cell. Moreover, a heuristic for a good machine layout in each cell is newly proposed based on the material handling cost of each alternative sequence layout. These all are put together to present an efficient heuristic for the U-shaped independent-cell formation problem, numerical problems are solved to illustrate the algorithm.

  • PDF

Sophorolipid Production by Candida bombicola ATCC 22214 from a Corn-Oil Processing Byproduct

  • KIM , HYUN-SOO;KIM, YOUNG-BUM;LEE, BAEK-SEOK;KIM, EUN-KI
    • Journal of Microbiology and Biotechnology
    • /
    • v.15 no.1
    • /
    • pp.55-58
    • /
    • 2005
  • Sophorolipid was produced by Candida bombicola ATCC 22214 from soybean dark oil, a byproduct of soybean oil processing. With a fed-batch culture of C. bombicola for 7 days, 90 g/l of sophorolipid was obtained. The CMC (critical micelle concentration) and minimum surface tension of the sophorolipid in aqueous solution were found to be 150 mg/l and 48 mN/m, respectively. The dispersion capability of sophorolipid was higher than that of the chemical surfactants such as SDS and Brij30. The molar solubility ratio (MSR) of 4-methylnaphthalene was 0.2. Linoleic and oleic acids were the main constituents of the fatty acid composition of the sophorolipid. The sophorolipid showed antimicrobial activity against Propionibacterium acne and Bacillus subtilis.

Development of Efficient and Flexible Sensor Reaction System based on Node.js, MQTT and MongoDB (Node.js, MQTT 및 MongoDB를 이용한 효율적이고 유연한 센서 리액션 시스템 개발)

  • Min, Kyung-Hyun;Igorevich, Rustam Rakhimov
    • Annual Conference of KIPS
    • /
    • 2016.10a
    • /
    • pp.797-800
    • /
    • 2016
  • IoT가 다양한 형태로 IT 기술을 이용하는 사물의 서비스를 제공하고 있다. 보다 스마트한 IoT 환경을 만들기 위하여 센서 데이터를 효율적으로 컨트롤하는 시스템이 필요하다. 본 논문은 계속적으로 생성되는 IoT 센서 데이터 를 효율적으로 처리하는 시스템을 Loosely Coupled 하고 확장 가능한 Sensor Reaction System의 아키텍처로 구성하고 있다. 본 논문에서는 Node.js, MQTT, MongoDB 기술을 사용함으로써 이벤트 기반한 stream 및 batch 처리를 할 수 있도록 센서 데이터를 메시지 큐에서 효율적으로 처리한다. 본 논문에서는 아두이노 보드에 온도 및 빛 센서를 부착한 센서 디바이스로부터 센서 테이터를 받아서 PC 기반의 MQTT Broker / Sensor Reactor / MongoDB 서버 시스템을 구축하고 성능을 분석하였다.

Hash Batch Rekeying Scheme for Reducing the Server Cost in Multicast Key Management System (멀티캐스트 키 관리 시스템에서 서버 계산 비용 향상을 위한 해쉬 일괄 키 갱신 기법)

  • Lee, Gyu-Won;Lee, Su-Youn;Park, Chang-Seop
    • Annual Conference of KIPS
    • /
    • 2005.05a
    • /
    • pp.1115-1118
    • /
    • 2005
  • 많은 인터넷 응용 프로그램들은 멀티캐스트 기반의 그룹 통신에 기반을 두고 있으며, 사용자들의 빈번한 가입과 탈퇴에 따른 효율적인 키 관리를 필요로 하게 된다. 본 논문에서는 기존의 개별 키 갱신 및 일괄 키 갱신 기법보다 서버의 계산 비용을 줄이는 일방향 해쉬 함수와 그룹별 해쉬 함수를 적용한 일괄 키 갱신 기법을 제안한다. 제안 방식과 기존 방식의 average case 값을 계산하여 서버의 계산 비용을 분석한 결과 제안한 방식이 효율적임을 나타내었다.

  • PDF

Comparison of incremental learning method and batch learning method in Cyber ISR (사이버 ISR에서의 점진적 학습 방법과 일괄 학습 방법 비교)

  • Shin, Gyeong-Il;Yooun, Hosang;Shin, DongIl;Shin, DongKyoo
    • Annual Conference of KIPS
    • /
    • 2017.11a
    • /
    • pp.861-864
    • /
    • 2017
  • 사이버 ISR을 통하여 정보를 획득하는 과정에서 데이터를 추출하고 이를 스스로 가공하여 의사결정에 도움을 줄 수 있는 에이전트를 연구하는 과정에서 폐쇄망에 침투했을 경우 이를 효과적으로 감시 정찰할 수 있는 방법을 논의한다. 폐쇄망으로 인하여 침투한 컴퓨터에 심어진 에이전트는 C&C서버와 원활한 교류가 불가능하게 되는데, 이때 스스로 살아남아 지속적으로 데이터를 수집하며, 분석을 하기 위해서는 한정된 자원과 시간을 활용하여야 발각되지 않고 계속하여 임무를 수행할 수 있다. 특히 분석하는 과정에서 많은 자원과 시간을 활용하는 때 이를 해결하기 위해 본인은 점진적 학습방법을 이용하는 것을 제안하며, 일괄학습 방법과 함께 비교하는 실험을 해보았다.

Online Blind Channel Normalization Using BPF-Based Modulation Frequency Filtering

  • Lee, Yun-Kyung;Jung, Ho-Young;Park, Jeon Gue
    • ETRI Journal
    • /
    • v.38 no.6
    • /
    • pp.1190-1196
    • /
    • 2016
  • We propose a new bandpass filter (BPF)-based online channel normalization method to dynamically suppress channel distortion when the speech and channel noise components are unknown. In this method, an adaptive modulation frequency filter is used to perform channel normalization, whereas conventional modulation filtering methods apply the same filter form to each utterance. In this paper, we only normalize the two mel frequency cepstral coefficients (C0 and C1) with large dynamic ranges; the computational complexity is thus decreased, and channel normalization accuracy is improved. Additionally, to update the filter weights dynamically, we normalize the learning rates using the dimensional power of each frame. Our speech recognition experiments using the proposed BPF-based blind channel normalization method show that this approach effectively removes channel distortion and results in only a minor decline in accuracy when online channel normalization processing is used instead of batch processing

Carbon Dioxide Mitigation by Microalgal Photosynthesis

  • Lee Jeong, Mi-Jeong;Gillis, James M.;Hwang, Jiann-Yang
    • Bulletin of the Korean Chemical Society
    • /
    • v.24 no.12
    • /
    • pp.1763-1766
    • /
    • 2003
  • Algal growth studies of Chlorella strains were conducted in a batch mode with bench type experiments. Carbon dioxide fixation rates of the following green microalgae were determined: Chlorella sp. H84, Chlorella sp. A2, Chlorella sorokiniana UTEX 1230, Chlorella vulgaris, and Chlorella pyrenoidosa. C. vulgaris, among other strains of microalgae, showed the highest growth rate (1.17 optical density/5 days). Cultivating conditions for C. vulgaris that produced the highest growth rate were at concentrations of 243 ${\mu}g\;CO_2$/mL, 10 mM ammonia, and 1 mM phosphate, with an initial pH range of 7-8.