• Title/Summary/Keyword: 패러미터 효율

Search Result 6, Processing Time 0.022 seconds

Parameter-Efficient Neural Networks Using Template Reuse (템플릿 재사용을 통한 패러미터 효율적 신경망 네트워크)

  • Kim, Daeyeon;Kang, Woochul
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.9 no.5
    • /
    • pp.169-176
    • /
    • 2020
  • Recently, deep neural networks (DNNs) have brought revolutions to many mobile and embedded devices by providing human-level machine intelligence for various applications. However, high inference accuracy of such DNNs comes at high computational costs, and, hence, there have been significant efforts to reduce computational overheads of DNNs either by compressing off-the-shelf models or by designing a new small footprint DNN architecture tailored to resource constrained devices. One notable recent paradigm in designing small footprint DNN models is sharing parameters in several layers. However, in previous approaches, the parameter-sharing techniques have been applied to large deep networks, such as ResNet, that are known to have high redundancy. In this paper, we propose a parameter-sharing method for already parameter-efficient small networks such as ShuffleNetV2. In our approach, small templates are combined with small layer-specific parameters to generate weights. Our experiment results on ImageNet and CIFAR100 datasets show that our approach can reduce the size of parameters by 15%-35% of ShuffleNetV2 while achieving smaller drops in accuracies compared to previous parameter-sharing and pruning approaches. We further show that the proposed approach is efficient in terms of latency and energy consumption on modern embedded devices.

Entropy-based Dynamic Histogram for Spatio-temporal Databases (시공간 데이타베이스의 엔트로피 기반 동적 히스토그램)

  • 박현규;손진현;김명호
    • Journal of KIISE:Databases
    • /
    • v.30 no.2
    • /
    • pp.176-183
    • /
    • 2003
  • Various techniques including histograms, sampling and parametric techniques have been proposed to estimate query result sizes for the query optimization. Histogram-based techniques are the most widely used form for the selectivity estimation in relational database systems. However, in the spatio-temporal databases for the moving objects, the continual changes of the data distribution suffer the direct utilization of the state of the art histogram techniques. Specifically for the future queries, we need another methodology that considers the updated information and keeps the accuracy of the result. In this paper we propose a novel approach based upon the duality and the marginal distribution to construct a histogram with very little time since the spatio-temporal histogram requires the data distribution defined by query predicates. We use data synopsis method in the dual space to construct spatio-temporal histograms. Our method is robust to changing data distributions during a certain period of time while the objects keep the linear movements. An additional feature of our approach supports the dynamic update incrementally and maintains the accuracy of the estimated result.

A Simulation-Based Investigation of an Advanced Traveler Information System with V2V in Urban Network (시뮬레이션기법을 통한 차량 간 통신을 이용한 첨단교통정보시스템의 효과 분석 (도시 도로망을 중심으로))

  • Kim, Hoe-Kyoung
    • Journal of Korean Society of Transportation
    • /
    • v.29 no.5
    • /
    • pp.121-138
    • /
    • 2011
  • More affordable and available cutting-edge technologies (e.g., wireless vehicle communication) are regarded as a possible alternative to the fixed infrastructure-based traffic information system requiring the expensive infrastructure investments and mostly implemented in the uninterrupted freeway network with limited spatial system expansion. This paper develops an advanced decentralized traveler information System (ATIS) using vehicle-to-vehicle (V2V) communication system whose performance (drivers' travel time savings) are enhanced by three complementary functions (autonomous automatic incident detection algorithm, reliable sample size function, and driver behavior model) and evaluates it in the typical $6{\times}6$ urban grid network with non-recurrent traffic state (traffic incident) with the varying key parameters (traffic flow, communication radio range, and penetration ratio), employing the off-the-shelf microscopic simulation model (VISSIM) under the ideal vehicle communication environment. Simulation outputs indicate that as the three key parameters are increased more participating vehicles are involved for traffic data propagation in the less communication groups at the faster data dissemination speed. Also, participating vehicles saved their travel time by dynamically updating the up-to-date traffic states and searching for the new route. Focusing on the travel time difference of (instant) re-routing vehicles, lower traffic flow cases saved more time than higher traffic flow ones. This is because a relatively small number of vehicles in 300vph case re-route during the most system-efficient time period (the early time of the traffic incident) but more vehicles in 514vph case re-route during less system-efficient time period, even after the incident is resolved. Also, normally re-routings on the network-entering links saved more travel time than any other places inside the network except the case where the direct effect of traffic incident triggers vehicle re-routings during the effective incident time period and the location and direction of the incident link determines the spatial distribution of re-routing vehicles.

A Performance Evaluation of Mobile Agent for Network Management (네트워크 관리를 위한 이동 에이전트의 성능평가)

  • 권혁찬;김흥환;유관종
    • The KIPS Transactions:PartC
    • /
    • v.8C no.1
    • /
    • pp.68-74
    • /
    • 2001
  • This paper mentions a centralized approach based on SNMP protocol and distributed approach based on mobile agent in network management s system. And it presents a few Quantitative models for systematically evaluating those two different approaches. To do this, we propose model m that is applicable under a uniform network environment, and compare network execution times of each paradigms based on parameters from s simulation. The model is then refined to take into account non-uniform networks. We show that it can reduce overall network execution times b by determining the best interaction patterns to perfo$\pi$n network management operations from this model. We believe that the model proposed h here should help us to decide appropriate paradigms and interaction patterns for developing network management applications.

  • PDF

Research on the Function and Economic Effect of Technology Opportunity Development System (기술기회발굴시스템의 기능 및 경제적 효과에 관한 연구)

  • Lee, Woo-Sung;Kim, Kang-Hoe;Coh, Byoung-Youl
    • Journal of Korea Technology Innovation Society
    • /
    • v.14 no.spc
    • /
    • pp.1096-1127
    • /
    • 2011
  • This research focus on estimating the economic effects of TOD system development from the perspective of new market creation, R&D planning cost reduction and increase of R&D projects' commercialization success rates. The research is conducted through simulation and scenario analysis with assumptions about economic effect parameters. Scenario analysis shows that scenario 1 (the application ratio of the new TOD system to total Korean R&D programs' planning is 1.4%) results in total economic effects, 921.3 billion won in 2011 price with B/C ratio 6.15, that scenario 2 (the application ratio is 1.9%) results in total economic effects, 1,250.3 billion won in 2011 price with B/C ratio 8.34, and that scenario 3 (the application ratio is 0.9%) results in total economic effects, 592.2 billion won in 2011 price with B/C ratio 3.95. The research contributed to the prior evaluation of economic validity of "R&D on Technology Opportunity Development (TOD) system" and to cultivating the new methodology of economic benefit estimation in the area of R&D on system development.

  • PDF

A Study on the Ecological Indices for the Assessment of the Function and Maturity of Artificial Reefs (인공어초의 기능도와 성숙도 평가를 위한 생태학적 지수에 대한 연구)

  • Yoo, Jae-Won;Hong, Hyun-Pyo;Hwang, Jae-Youn;Lee, Min-Soo;Lee, Yong-Woo;Lee, Chae-Sung;Hwang, Sun-Do
    • The Sea:JOURNAL OF THE KOREAN SOCIETY OF OCEANOGRAPHY
    • /
    • v.19 no.1
    • /
    • pp.8-34
    • /
    • 2014
  • We reviewed foreign evaluation systems based on the macrobenthic and macroalgal communities and developed a system, composed of a set of ecological indices able to evaluate the functionality (FI, Functional Index; estimation of stability and productivity) and maturity (MI, Maturity Index; comparisons with biological parameters of natural reefs) of artificial reefs by comparing the status in the adjacent natural reefs in Korean coastal waters. The evaluation system was applied to natural and artificial reefs/reef-planned areas (natural reefs), established in the 5 marine ranching areas (Bangnyeong-Daechung, Yeonpyung, Taean, Seocheon and Buan) in the west coast of Korea. The FI ranged between 31.6 (Bangnyeong-Daechung) and 72.5% (Buan) and MI did between 53.1 (Seocheon) and 76.9% (Taean) in average. The evaluation of artificial reefs by the two indices, showed the most appropriate status in Taean. The FI between the adjacent artificial and natural reefs were in significant linear relationship ($r^2=0.83$, p=0.01). This indicated the local status of biological community may be critical in determining the functionality of the artificial reefs. We have suggested an integrative but preliminary evaluation system of artificial reefs in this study. The output from the evaluation system may be utilized as a tool for environment/resource managers or policy makers, responsible for effective use of funds and decision making. Given the importance, we need to use the options to enhance and improve the accuracy as follows: (1) continuous validation of the evaluation system and rescaling the criteria of indicators, (2) vigorous utilization of observation and experience through the application and data accumulation and (3) development and testing of brand-new indicators.