• Title/Summary/Keyword: I/O Processing

Search Result 568, Processing Time 0.024 seconds

Design of a Large-scale Task Dispatching & Processing System based on Hadoop (하둡 기반 대규모 작업 배치 및 처리 기술 설계)

  • Kim, Jik-Soo;Cao, Nguyen;Kim, Seoyoung;Hwang, Soonwook
    • Journal of KIISE
    • /
    • v.43 no.6
    • /
    • pp.613-620
    • /
    • 2016
  • This paper presents a MOHA(Many-Task Computing on Hadoop) framework which aims to effectively apply the Many-Task Computing(MTC) technologies originally developed for high-performance processing of many tasks, to the existing Big Data processing platform Hadoop. We present basic concepts, motivation, preliminary results of PoC based on distributed message queue, and future research directions of MOHA. MTC applications may have relatively low I/O requirements per task. However, a very large number of tasks should be efficiently processed with potentially heavy inter-communications based on files. Therefore, MTC applications can show another pattern of data-intensive workloads compared to existing Hadoop applications, typically based on relatively large data block sizes. Through an effective convergence of MTC and Big Data technologies, we can introduce a new MOHA framework which can support the large-scale scientific applications along with the Hadoop ecosystem, which is evolving into a multi-application platform.

A Multimedia Data Management Technique Using Variable Size Buffer (가변 크기 버퍼를 이용한 멀티미디어 데이타 버퍼 관리 기법)

  • Jo, Yeong-Seop;Kim, Jae-Hong;Bae, Hae-Yeong
    • The Transactions of the Korea Information Processing Society
    • /
    • v.3 no.6
    • /
    • pp.1375-1385
    • /
    • 1996
  • As there has been much demands for processing multimedia data, a storage manager for multimedia data makes much effects on system performance. Because the size of multimedia data is usually very large, disk I/O for the data consumes much time and causes the system performance to be decreased. Therefore, it makes a better effect on system performance that a multimedia data storage manager decreases its disk I/O by the buffer management of multimedia data. This paper proposes a buffer management technique which allocates the buffer to be equal to its corresponding segment which consists of physically continuous disk page set and is disk management unit for multimedia data in many multimedia data storage manager. As the size of buffer varies, it also proposes a buffer replacement policy which consider not only reference behavior of buffer but also buffer size The proposed multimedia data buffer management technique is implemented in KORED/STORM which is a storage manager for multimedia data.

  • PDF

Comparisions of stream activation mechanisms in computer based teleconferencing systems for low delay (지연 축소를 위한 컴퓨터 영상회의 시스템의 시트림 동작 구조 비교)

  • Lee, Gyeong-Hui;Kim, Du-Hyeon;Gang, Min-Gyu;Jeong, Chan-Geun
    • The Transactions of the Korea Information Processing Society
    • /
    • v.4 no.2
    • /
    • pp.363-376
    • /
    • 1997
  • In this paper, we present a hardware architecture and a sofrware architecture for cimputer based teleconferencing systems.And also we analyse stream adtivation mechanisms for them form the viewpoint of delay. MuX that is a multimedia I/O server provides various processing elements for data I/O, synchronization, interleaving and mixing.We describe methods to build teleconferencing systems with the elements and compares the technique using master click with the techniquie using self clock.In the plase of dta input.the technique using self click is berrer than the technique using master clock.When we generate interleved stream from audio and video stream and activate channel objects by periodic audio stream as activation clock, dealy from imput audio stream to imterleved stream is reduced but delay for video stream is not reduced as much as in the case of audio stream.

  • PDF

Efficient Incorporation of Tertiary Storage in a Multimedia DBMS (멀티미디어 DBMS에서 3차 저장장치의 효율적 활용 기법)

  • Mun, Chan-Ho;Gang, Hyeon-Cheol
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.7
    • /
    • pp.1724-1737
    • /
    • 1999
  • Multimedia data service applications have to store and manipulate LOBs(unstructured large objects) composing multimedia data. As such, the tertiary storage devices such as an optical disk jukebox and a tape library that consist of a number of platters (the disks in case of an optical disk jukebox and the cartridge tapes in case of a tape library) have been considered essential for the storage system of a DBMS in order to efficiently support storage and management of vary large volume of data. Since the latency with tertiary storage is too long, the schemes for efficient retrieval of LOBs out of tertiary storage need to be investigated. In this paper, we investigated the tertiary I/O Considering the performance characteristics of the LOBs, we proposed various I/O scheduling heuristic algorithms that reduce latency in query processing with LOB retrieval from tertiary storage, and evaluated their performance through a detailed simulation.

  • PDF

A Study on a Vision Sensor System for Tracking the I-Butt Weld Joints

  • Kim Jae-Woong;Bae Hee-Soo
    • Journal of Mechanical Science and Technology
    • /
    • v.19 no.10
    • /
    • pp.1856-1863
    • /
    • 2005
  • In this study, a visual sensor system for weld seam tracking the I-butt weld joints in GMA welding was constructed. The sensor system consists of a CCD camera, a diode laser with a cylindrical lens and a band-pass-filter to overcome the degrading of image due to spatters and arc light. In order to obtain the enhanced image, quantitative relationship between laser intensity and iris opening was investigated. Throughout the repeated experiments, the shutter speed was set at 1/1000 second for minimizing the effect of spatters on the image, and therefore the image without the spatter traces could be obtained. Region of interest was defined from the entire image and gray level of the searched laser stripe was compared to that of weld line. The differences between these gray levels lead to spot the position of weld joint using central difference method. The results showed that, as long as weld line is within $\pm15^{o}$ from the longitudinal straight line, the system constructed in this study could track the weld line successfully. Since the processing time is no longer than 0.05 sec, it is expected that the developed method could be adopted to high speed welding such as laser welding.

Dynamic Load Balancing and Network Adaptive Virtual Storage Service for Mobile Appliances

  • Ong, Ivy;Lim, Hyo-Taek
    • Journal of Information Processing Systems
    • /
    • v.7 no.1
    • /
    • pp.53-62
    • /
    • 2011
  • With the steady growth of mobile technology and applications, demand for more storage in mobile devices has also increased. A lightweight block-level protocol, Internet Advanced Technology Attachment (iATA), has been developed to deliver a cost-effective storage network solution for mobile devices to obtain more storage. This paper seeks to contribute to designing and implementing Load Balancing (LB), Network Monitoring (NM) and Write Replication (WR) modules to improve the protocol's scalability and data availability. LB and NM modules are invoked to collect system resources states and current network status at each associate node (server machine). A dynamic weight factor is calculated based on the collected information and sent to a referral server. The referral server is responsible to analyze and allocate the most ideal node with the least weight to serve the client. With this approach, the client can avoid connecting to a heavily loaded node that may cause delays in subsequent in-band I/O operations. Write replication is applied to the remaining nodes through a WR module by utilizing the Unison file synchronization program. A client initially connected to node IP A for write operations will have no hindrances in executing the relevant read operations at node IP B in new connections. In the worst case scenario of a node crashing, data remain recoverable from other functioning nodes. We have conducted several benchmark tests and our results are evaluated and verified in a later section.

Improvement of Electrical Characteristics of MOSFETs Using High Pressure Deuterium Annealing (고압 중수소 열처리에 의한 MOSFETs의 특성 개선에 대한 연구)

  • Jung, Dae-Han;Ku, Ja-Yun;Wang, Dong-Hyun;Son, Young-Seo;Park, Jun-Young
    • Journal of the Korean Institute of Electrical and Electronic Material Engineers
    • /
    • v.35 no.3
    • /
    • pp.264-268
    • /
    • 2022
  • High pressure deuterium (HPD) annealing is an advancing technology for the fabrication of modern semiconductor devices. In this work, gate-enclosed FETs are fabricated on a silicon substrate as test vehicles. After a cycle for the HPD annealing, the device parameters such as threshold voltage (VTH), subthreshold swing (SS), on-state current (ION), off-state current (IOFF), and gate leakage (IG) were measured and compared depending on the HPD. The HPD annealing can passivate the dangling bonds at Si-SiO2 interfaces as well as eliminate the bulk trap in SiO2. It can be concluded that adding the HPD annealing as a fabrication process is very effective in improving device reliability, performance, and variability.

PROCESSING OF INTERSTELLAR MEDIUM AS DIVULGED BY AKARI

  • Onaka, Takashi;Mori, Tamami I.;Ohsawa, Ryou;Sakon, Itsuki;Bell, Aaron C.;Hammonds, Mark;Shimonishi, Takashi;Ishihara, Daisuke;Kaneda, Hidehiro;Okada, Yoko;Tanaka, Masahiro
    • Publications of The Korean Astronomical Society
    • /
    • v.32 no.1
    • /
    • pp.77-81
    • /
    • 2017
  • A wide spectral coverage from near-infrared (NIR) to far-infrared (FIR) of AKARI both for imaging and spectroscopy enables us to efficiently study the emission from gas and dust in the interstellar medium (ISM). In particular, the Infrared Camera (IRC) onboard AKARI offers a unique opportunity to carry out sensitive spectroscopy in the NIR ($2-5{\mu}m$) for the first time from a spaceborn telescope. This spectral range contains a number of important dust bands and gas lines, such as the aromatic and aliphatic emission bands at 3.3 and $3.4-3.5{\mu}m$, $H_2O$ and $CO_2$ ices at 3.0 and $4.3{\mu}m$, CO, $H_2$, and H I gas emission lines. In this paper we concentrate on the aromatic and aliphatic emission and ice absorption features. The balance between dust supply and destruction suggests significant dust processing taking place as well as dust formation in the ISM. Detailed analysis of the aromatic and aliphatic bands of AKARI observations for a number of H ii regions and H ii region-like objects suggests processing of carbonaceous dust in the ISM. The ice formation process can also be studied with IRC NIR spectroscopy efficiently. In this review, dust processing in the ISM divulged by recent analysis of AKARI data is discussed.

Memristors based on Al2O3/HfOx for Switching Layer Using Single-Walled Carbon Nanotubes (단일 벽 탄소 나노 튜브를 이용한 스위칭 레이어 Al2O3/HfOx 기반의 멤리스터)

  • DongJun, Jang;Min-Woo, Kwon
    • Journal of IKEEE
    • /
    • v.26 no.4
    • /
    • pp.633-638
    • /
    • 2022
  • Rencently, neuromorphic systems of spiking neural networks (SNNs) that imitate the human brain have attracted attention. Neuromorphic technology has the advantage of high speed and low power consumption in cognitive applications and processing. Resistive random-access memory (RRAM) for SNNs are the most efficient structure for parallel calculation and perform the gradual switching operation of spike-timing-dependent plasticity (STDP). RRAM as synaptic device operation has low-power processing and expresses various memory states. However, the integration of RRAM device causes high switching voltage and current, resulting in high power consumption. To reduce the operation voltage of the RRAM, it is important to develop new materials of the switching layer and metal electrode. This study suggested a optimized new structure that is the Metal/Al2O3/HfOx/SWCNTs/N+silicon (MOCS) with single-walled carbon nanotubes (SWCNTs), which have excellent electrical and mechanical properties in order to lower the switching voltage. Therefore, we show an improvement in the gradual switching behavior and low-power I/V curve of SWCNTs-based memristors.

Implementation of Video Image Processing Board for HMD (HMD용 비디오 영상처리 보드 구현)

  • Choi, Hyuk-Cho;Kim, Hyung-O
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2018.05a
    • /
    • pp.615-616
    • /
    • 2018
  • Recently, new interfaces such as virtual reality and augmented reality are being developed by the development of IT technology. In particular, virtual / augmented reality technology is being applied to training equipment for members in special environments such as defense and fire fighting. In this paper, we implemented a display image processing board for HMD which is applicable to firefighter's helmet. We developed a technology to visually provide various information to firefighters in case of fire fighting.

  • PDF