• 제목/요약/키워드: High scalability

Search Result 430, Processing Time 0.039 seconds

Data Mining for High Dimensional Data in Drug Discovery and Development

  • Lee, Kwan R.;Park, Daniel C.;Lin, Xiwu;Eslava, Sergio
    • Genomics & Informatics
    • /
    • v.1 no.2
    • /
    • pp.65-74
    • /
    • 2003
  • Data mining differs primarily from traditional data analysis on an important dimension, namely the scale of the data. That is the reason why not only statistical but also computer science principles are needed to extract information from large data sets. In this paper we briefly review data mining, its characteristics, typical data mining algorithms, and potential and ongoing applications of data mining at biopharmaceutical industries. The distinguishing characteristics of data mining lie in its understandability, scalability, its problem driven nature, and its analysis of retrospective or observational data in contrast to experimentally designed data. At a high level one can identify three types of problems for which data mining is useful: description, prediction and search. Brief review of data mining algorithms include decision trees and rules, nonlinear classification methods, memory-based methods, model-based clustering, and graphical dependency models. Application areas covered are discovery compound libraries, clinical trial and disease management data, genomics and proteomics, structural databases for candidate drug compounds, and other applications of pharmaceutical relevance.

Improving the Reliability of IEEE 802.11s Based Wireless Mesh Networks for Smart Grid Systems

  • Kim, Jaebeom;Kim, Dabin;Lim, Keun-Woo;Ko, Young-Bae;Lee, Sang-Youm
    • Journal of Communications and Networks
    • /
    • v.14 no.6
    • /
    • pp.629-639
    • /
    • 2012
  • A challenge faced by smart grid systems is providing highly reliable transmissions to better serve different types of electrical applications and improve the energy efficiency of the system. Although wireless networking technologies can provide high-speed and cost-effective solutions, their performance may be impaired by various factors that affect the reliability of smart grid networks. Here, we first suggest the use of IEEE 802.11s-based wireless LAN mesh networks as high-speed wireless backbone networks for smart grid infrastructure to provide high scalability and flexibility while ensuring low installation and management costs. Thereafter, we analyze some vital problems of the IEEE 802.11s default routing protocol (named hybrid wireless mesh protocol; HWMP) from the perspective of transfer reliability, and propose appropriate solutions with a new routing method called HWMP-reliability enhancement to improve the routing reliability of 802.11s-based smart grid mesh networking. A simulation study using ns-3 was conducted to demonstrate the superiority of the proposed schemes.

OFPT: OpenFlow based Parallel Transport in Datacenters

  • Liu, Bo;XU, Bo;Hu, Chao;Hu, Hui;Chen, Ming
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.10
    • /
    • pp.4787-4807
    • /
    • 2016
  • Although the dense interconnection datacenter networks (DCNs) (e.g. FatTree) provide multiple paths and high bisection bandwidth for each server pair, the single-path TCP (SPT) and ECMP which are widely used currently neither achieve high bandwidth utilization nor have good load balancing. Due to only one available transmission path, SPT cannot make full use of all available bandwidth, while ECMP's random hashing results in many collisions. In this paper, we present OFPT, an OpenFlow based Parallel Transport framework, which integrates precise routing and scheduling for better load balancing and higher network throughput. By adopting OpenFlow based centralized control mechanism, OFPT computes the optimal path and bandwidth provision for each flow according to the global network view. To guarantee high throughput, OFPT dynamically schedules flows with Seamless Flow Migration Mechanism (SFMM), which can avoid packet loss in flow rerouting. Finally, we test OFPT on Mininet and implement it in a real testbed. The experimental results show that the average network throughput in OFPT is up to 97.5% of bisection bandwidth, which is higher than ECMP by 36%. Besides, OFPT decreases the average flow completion time (AFCT) and achieves better scalability.

Transaction Processing Method for NoSQL Based Column

  • Kim, Jeong-Joon
    • Journal of Information Processing Systems
    • /
    • v.13 no.6
    • /
    • pp.1575-1584
    • /
    • 2017
  • As interest in big data has increased recently, NoSQL, a solution for storing and processing big data, is getting attention. NoSQL supports high speed, high availability, and high scalability, but is limited in areas where data integrity is important because it does not support multiple row transactions. To overcome these drawbacks, many studies are underway to support multiple row transactions in NoSQL. However, existing studies have a disadvantage that the number of transactions that can be processed per unit of time is low and performance is degraded. Therefore, in this paper, we design and implement a multi-row transaction system for data integrity in big data environment based on HBase, a column-based NoSQL which is widely used recently. The multi-row transaction system efficiently performs multi-row transactions by adding columns to manage transaction information for every user table. In addition, it controls the execution, collision, and recovery of multiple row transactions through the transaction manager, and it communicates with HBase through the communication manager so that it can exchange information necessary for multiple row transactions. Finally, we performed a comparative performance evaluation with HAcid and Haeinsa, and verified the superiority of the multirow transaction system developed in this paper.

Analysis of Overseas Data Management Systems for High Level Radioactive Waste Disposal (고준위방사성폐기물 처분 관련 자료 관리 해외사례 분석)

  • MinJeong Kim;SunJu Park;HyeRim Kim;WoonSang Yoon;JungHoon Park;JeongHwan Lee
    • The Journal of Engineering Geology
    • /
    • v.33 no.2
    • /
    • pp.323-334
    • /
    • 2023
  • The vast volumes of data that are generated during site characterization and associated research for the disposal of high-level radioactive waste require effective data management to properly chronicle and archive this information. The Swedish Nuclear Fuel and Waste Management Company, SKB, established the SICADA database for site selection, evaluation, analysis, and modeling. The German Federal Company for Radioactive Waste Disposal, BGE, established ArbeitsDB, a database and document management system, and the ELO data system to manage data collected according to the Repository Site Selection Act. The U.K. Nuclear Waste Services established the Data Management System to manage any research and survey data pertaining to nuclear waste storage and disposal. The U.S. Department of Energy and Office of Civilian Radioactive Waste Management established the Technical Data Management System for data management and subsequent licensing procedures during site characterization surveys. The presented cases undertaken by these national agencies highlight the importance of data quality management and the scalability of data utilization to ensure effective data management. Korea should also pursue the establishment of both a data management concept for radioactive waste disposal that considers data quality management and scalability from a long-term perspective and an associated data management system.

Sever Selection Schemes Considering Node Status For a Fault-Tolerant Streaming Service on a Peer-to-Peer Network

  • Kim, Hyun-Joo;Kang, Soo-Yong;Yeom, Heon-Y.
    • Journal of Information Processing Systems
    • /
    • v.2 no.1
    • /
    • pp.6-12
    • /
    • 2006
  • Peer-to-Peer (P2P) networks are attracting considerable research interest because of their scalability and high performance relative to cost. One of the important services on a P2P network is the streaming service. However, because each node in the P2P network is autonomous, it is difficult to provide a stable streaming service on the network. Therefore, for a stable streaming service on the P2P network, a fault-tolerant scheme must be provided. In this paper, we propose two new node selection schemes, Playback Node First (PNF) and Playback Node first with Prefetching (PNF-P) that can be used for a service migration-based fault-tolerant streaming service. The proposed schemes exploit the fact that the failure probability of a node currently being served is lower than that of a node not being served. Simulation results show that the proposed schemes outperform traditional node selection schemes.

A Experimental Study on the Repeatability of Network RTK-GPS with Spider Net Type (Spider Net 방식 Network RTK-GPS측량의 반복재현성에 대한 실험연구)

  • Kim, Sun-Chul;Kang, Sang-Gu;Lee, Jin-Duk
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2007.04a
    • /
    • pp.37-42
    • /
    • 2007
  • A network of MAC type was constructed in the Gyeonggi-do area to analyze the usefulness and validity of the Network RTK-GPS. Six sites were selected to conduct GPS observation for 24 hours, and by determining the ITRF of each site, coordinates were determined in connection with IGS network. Then check points which were established in Gimpo area were observed at least 7 times by Network RTK at 20 secs of retrieval intervals. The result showed high accuracy in the difference between the coordinates determined immediately by the in-field network survey and the current performance was 1-2cm. Its biggest benefit is the expanded range of survey and efficiency of practice. In summary, it is proved that a network survey has the accuracy, scalability and efficiency and it is expected that the network survey will contribute to the cadastral survey.

  • PDF

Scalable HEVC 표준 기술 동향

  • Kim, Gyeong-Hye;Jo, Hyeon-Ho;Sim, Dong-Gyu
    • Information and Communications Magazine
    • /
    • v.30 no.9
    • /
    • pp.49-57
    • /
    • 2013
  • 네트워크 기술과 멀티미디어 압축 기술이 발달함에 따라 사용자들은 고화질의 멀티미디어 콘텐츠를 무선 환경에서도 끊김 없이 제공 받기를 원하고 있다. 또한, 스마트폰과 스마트패드와 같은 다양한 멀티미디어 장치가 일상생활에서 보편적으로 사용되면서 디바이스 간에 끊김 없는 미디어의 연동을 가능케 하는 N-스크린 서비스가 점차 확산되고 있다. 이러한 시장의 흐름에 발맞춰 JCT-VC (Joint Collaborative Team on Video Coding)는 차세대 동영상 압축 표준 기술인 HEVC (High Efficiency Video Coding)를 바탕으로 공간적 (Spatial), 화질적 (Temporal) 스케일러빌리티 (Scalability)를 제공하는 확장 표준인 SHVC (Scalable HEVC)를 표준화 중에 있다. JCT-VC는 SHVC 부호화 기술들을 평가하기 위하여 SCE (Scalable Core Experiment)를 진행하고 있으며, SHVC 표준은 2014년 6월에 표준화가 완료 될 것으로 예상된다. 본 고에서는 비디오 스케일 러빌리티의 기본 개념 및 SHVC 표준화 과정에서 제안된 주요부호화 기술들과 이슈들을 소개한다.

Design and Implementation of a Wireless Sensor Network Protocol for a Smart Power Outlet System (스마트 아웃렛 시스템을 위한 무선 센서네트워크 프로토콜 설계 및 구현)

  • Chung, Han-Su;Moon, Jung-Ho;Park, Sung-Wook;Lee, Hyung-Bong;Park, Lae-Jeong;Chung, Tae-Yun
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.7 no.6
    • /
    • pp.291-300
    • /
    • 2012
  • This paper deals with the design and implementation of wireless sensor network protocol for smart power outlet system capable of fire detection, power monitoring, standby power cutoff, and home automation. The proposed protocol integrates both the CSMA and the TDMA protocols for low power consumption and good scalability. A prototype smart power outlet system employing the proposed protocol and a simple home automation network including the power outlet system have been implemented for evaluating the feasibility of the proposed protocol The result shows that the proposed protocol allows the power outlet system to be scalable with high power efficiency.

A Framework for Java-based Web Database Applications (JaVa를 기반으로 한 웹 데이타베이스 응용을 위한 프레임워크)

  • 구흥서
    • The Journal of Information Technology and Database
    • /
    • v.7 no.2
    • /
    • pp.1-15
    • /
    • 2000
  • The World-Wide-Web have many advantages as a front-end of database systems. Hence in Internet applications, such as E-Commerce systems, the requirements for Web-based database applications have been increasing. In this work we propose a framework for java-based Web database applications-JaWAF(Java-based Web Application Framework). JaWAF has the 3-tier architecture of Client/Server, and consists of database gateway, application server, and communication and message component. When this framework is applied to the database applications developments, it can provide advantages, such as ease understanding and fast implementations of the Web applications. Thus we can build 3-tier Web-based database application systems with high scalability and distributed processing capability. Database gateway in JaWAF works as a daemon process that connects to the database systems and waits for requests from clients, and supports state-oriented service between clients and database servers. Hence the performance of Web applications could be increasing.

  • PDF