• 제목/요약/키워드: Collaborative inference

검색결과 15건 처리시간 0.02초

Collaborative Inference for Deep Neural Networks in Edge Environments

  • Meizhao Liu;Yingcheng Gu;Sen Dong;Liu Wei;Kai Liu;Yuting Yan;Yu Song;Huanyu Cheng;Lei Tang;Sheng Zhang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제18권7호
    • /
    • pp.1749-1773
    • /
    • 2024
  • Recent advances in deep neural networks (DNNs) have greatly improved the accuracy and universality of various intelligent applications, at the expense of increasing model size and computational demand. Since the resources of end devices are often too limited to deploy a complete DNN model, offloading DNN inference tasks to cloud servers is a common approach to meet this gap. However, due to the limited bandwidth of WAN and the long distance between end devices and cloud servers, this approach may lead to significant data transmission latency. Therefore, device-edge collaborative inference has emerged as a promising paradigm to accelerate the execution of DNN inference tasks where DNN models are partitioned to be sequentially executed in both end devices and edge servers. Nevertheless, collaborative inference in heterogeneous edge environments with multiple edge servers, end devices and DNN tasks has been overlooked in previous research. To fill this gap, we investigate the optimization problem of collaborative inference in a heterogeneous system and propose a scheme CIS, i.e., collaborative inference scheme, which jointly combines DNN partition, task offloading and scheduling to reduce the average weighted inference latency. CIS decomposes the problem into three parts to achieve the optimal average weighted inference latency. In addition, we build a prototype that implements CIS and conducts extensive experiments to demonstrate the scheme's effectiveness and efficiency. Experiments show that CIS reduces 29% to 71% on the average weighted inference latency compared to the other four existing schemes.

협력적 여과 시스템에서 귀납 추리를 이용한 순위 결정 (Ranking by Inductive Inference in Collaborative Filtering Systems)

  • 고수정
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제37권9호
    • /
    • pp.659-668
    • /
    • 2010
  • 협력적 여과 시스템은 새로운 사용자의 행위를 파악하고 사용자가 흥미로워할 아이템을 추천해주기 위해서 사용자들에 대한 새로운 정보를 필요로 한다. 이러한 정보를 획득하기 위하여 협력적 여과 시스템은 기존 데이터를 기반으로 학습을 하고, 그 결과에 따라 사용자에 대한 새로운 정보를 찾아낼 수 있다. 본 논문에서는 사용자에 대한 새로운 정보를 획득하기 위한 방법으로 귀납적 추리 방법을 제안하고, 추리된 사용자의 정보를 이용하여 아이템의 순위를 결정한다. 제안된 방법에서는 귀납적 기계 학습 방법인 NMF를 이용하여 사용자를 학습시켜서 모든 사용자들을 그룹으로 군집시키고, 각 그룹으로부터 카이제곱을 이용하여 그룹의 특징을 추출한다. 다음으로, 귀납 추리 방법의 하나인 베이지언 확률모델을 이용하여 새로운 사용자가 입력한 평가값과 각 그룹의 특징을 기반으로 사용자를 적합한 그룹으로 분류한다. 마지막으로, 사용자가 결측한 아이템을 대상으로 로치오(Rocchio) 알고리즘을 적용하여 아이템의 순위를 결정한다.

An Inference Similarity-based Federated Learning Framework for Enhancing Collaborative Perception in Autonomous Driving

  • Zilong Jin;Chi Zhang;Lejun Zhang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제18권5호
    • /
    • pp.1223-1237
    • /
    • 2024
  • Autonomous vehicles use onboard sensors to sense the surrounding environment. In complex autonomous driving scenarios, the detection and recognition capabilities are constrained, which may result in serious accidents. An efficient way to enhance the detection and recognition capabilities is establishing collaborations with the neighbor vehicles. However, the collaborations introduce additional challenges in terms of the data heterogeneity, communication cost, and data privacy. In this paper, a novel personalized federated learning framework is proposed for addressing the challenges and enabling efficient collaborations in autonomous driving environment. For obtaining a global model, vehicles perform local training and transmit logits to a central unit instead of the entire model, and thus the communication cost is minimized, and the data privacy is protected. Then, the inference similarity is derived for capturing the characteristics of data heterogeneity. The vehicles are divided into clusters based on the inference similarity and a weighted aggregation is performed within a cluster. Finally, the vehicles download the corresponding aggregated global model and train a personalized model which is personalized for the cluster that has similar data distribution, so that accuracy is not affected by heterogeneous data. Experimental results demonstrate significant advantages of our proposed method in improving the efficiency of collaborative perception and reducing communication cost.

XML Topic Map을 이용한 Product Configuration 지식 교환에 관한 연구 (XTM based Knowledge Exchanges for Product Configuration Modeling)

  • 조지훈;곽현욱;김현;김형선;이주행;조준면;홍충성;도남철
    • 한국CDE학회논문집
    • /
    • 제11권1호
    • /
    • pp.57-66
    • /
    • 2006
  • Modeling product configurations needs large amounts of knowledge about technical and marketing restrictions on the product. Previous attempts to automate product configurations concentrate on representations and management of the knowledge for specific domains in fixed and isolated computing environments. Since the knowledge about product configurations is subject to continuous change and hard to express, these attempts often failed to efficiently manage and exchange the knowledge in collaborative product development. In this paper, XML Topic Map (XTM) is introduced to represent and exchange the knowledge about product configurations in collaborative product development. A product configuration model based on XTM along with its merger and inference facilities enables configuration engineers In collaborative product development to manage and exchange their knowledge efficiently. An implementation of the proposed product configuration model is presented to demonstrate that the proposed approach enables enterprises to exchange the knowledge about product configurations during their collaborative product development.

입자군집 최적화에 기초한 최적 퍼지추론 시스템의 구조설계 (Structural Design of Optimized Fuzzy Inference System Based on Particle Swarm Optimization)

  • 김욱동;이동진;오성권
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2009년도 정보 및 제어 심포지움 논문집
    • /
    • pp.384-386
    • /
    • 2009
  • This paper introduces an effectively optimized Fuzzy model identification by means of complex and nonlinear system applying PSO algorithm. In other words, we use PSO(Particle Swarm Optimization) for identification of Fuzzy model structure and parameter. PSO is an algorithm that follows a collaborative population-based search model. Each particle of swarm flies around in a multidimensional search space looking for the optimal solution. Then, Particles adjust their position according to their own and their neighboring-particles experience. This paper identifies the premise part parameters and the consequence structures that have many effects on Fuzzy system based on PSO. In the premise parts of the rules, we use triangular. Finally we evaluate the Fuzzy model that is widely used in the standard model of gas data and sew data.

  • PDF

DRM-FL: Cross-Silo Federated Learning 접근법의 프라이버시 보호를 위한 분산형 랜덤화 메커니즘 (DRM-FL: A Decentralized and Randomized Mechanism for Privacy Protection in Cross-Silo Federated Learning Approach)

  • 무함마드 필다우스;초느에진랏;마리즈아길랄;이경현
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2022년도 춘계학술발표대회
    • /
    • pp.264-267
    • /
    • 2022
  • Recently, federated learning (FL) has increased prominence as a viable approach for enhancing user privacy and data security by allowing collaborative multi-party model learning without exchanging sensitive data. Despite this, most present FL systems still depend on a centralized aggregator to generate a global model by gathering all submitted models from users, which could expose user privacy and the risk of various threats from malicious users. To solve these issues, we suggested a safe FL framework that employs differential privacy to counter membership inference attacks during the collaborative FL model training process and empowers blockchain to replace the centralized aggregator server.

Human Action Recognition Using Pyramid Histograms of Oriented Gradients and Collaborative Multi-task Learning

  • Gao, Zan;Zhang, Hua;Liu, An-An;Xue, Yan-Bing;Xu, Guang-Ping
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제8권2호
    • /
    • pp.483-503
    • /
    • 2014
  • In this paper, human action recognition using pyramid histograms of oriented gradients and collaborative multi-task learning is proposed. First, we accumulate global activities and construct motion history image (MHI) for both RGB and depth channels respectively to encode the dynamics of one action in different modalities, and then different action descriptors are extracted from depth and RGB MHI to represent global textual and structural characteristics of these actions. Specially, average value in hierarchical block, GIST and pyramid histograms of oriented gradients descriptors are employed to represent human motion. To demonstrate the superiority of the proposed method, we evaluate them by KNN, SVM with linear and RBF kernels, SRC and CRC models on DHA dataset, the well-known dataset for human action recognition. Large scale experimental results show our descriptors are robust, stable and efficient, and outperform the state-of-the-art methods. In addition, we investigate the performance of our descriptors further by combining these descriptors on DHA dataset, and observe that the performances of combined descriptors are much better than just using only sole descriptor. With multimodal features, we also propose a collaborative multi-task learning method for model learning and inference based on transfer learning theory. The main contributions lie in four aspects: 1) the proposed encoding the scheme can filter the stationary part of human body and reduce noise interference; 2) different kind of features and models are assessed, and the neighbor gradients information and pyramid layers are very helpful for representing these actions; 3) The proposed model can fuse the features from different modalities regardless of the sensor types, the ranges of the value, and the dimensions of different features; 4) The latent common knowledge among different modalities can be discovered by transfer learning to boost the performance.

지능형 추천시스템 개발을 위한 지식분류, 연결 및 통합 방법에 관한 연구 (Knowledge Classification and Demand Articulation & Integration Methods for Intelligent Recommendation System)

  • 하성도;황인식;권미수
    • 한국정밀공학회:학술대회논문집
    • /
    • 한국정밀공학회 2005년도 추계학술대회 논문집
    • /
    • pp.440-443
    • /
    • 2005
  • The wide spread of internet business recently necessitates recommendation systems which can recommend the most suitable product fur customer demands. Currently the recommendation systems use content-based filtering and/or collaborative filtering methods, which are unable both to explain the reason for the recommendation and to reflect constantly changing requirements of the users. These methods guarantee good efficiency only if there is a lot of information about users. This paper proposes an algorithm called 'demand articulate & integration' which can perceive user's continuously varying intents and recommend proper contents. A method of knowledge classification which can be applicable to this algorithm is also developed in order to disassemble knowledge into basic units and articulate indices. The algorithm provides recommendation outputs that are close to expert's opinion through the tracing of articulate index. As a case study, a knowledge base for heritage information is constructed with the expert guide's knowledge. An intelligent recommendation system that can guide heritage tour as good as the expert guider is developed.

  • PDF

퍼지연상기억장치에 기반한 협력 추천 방법 (A Collaborative Recommendation Method based on Fuzzy Associative Memory)

  • 이동섭;고일주;김계영
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제31권8호
    • /
    • pp.1054-1061
    • /
    • 2004
  • 최근 인터넷의 발전으로 정보의 접근이 용이할 뿐 아니라 그 양 또한 기하급수적으로 증가하고 있다. 정보의 홍수 속에서 원하는 정보만을 자동으로 추출할 수 있는 기술은 정보검색에 소요되는 시간과 노력을 절약할 수 있는 매우 중요한 연구이다. 본 논문에서는 관심 범위가 유사한 사용자에게 양질의 정보를 자동으로 추천하기 위하여 협력적 여과방법에 관하여 제안한다. 제안하는 방법의 기본적인 배경은 사용자는 선택항목의 선호도를 입력하고, 여과 장치는 이 선호도에 근거하여 추천집합을 자동으로 생성하는 것이다. 선호도로부터 추천집합을 추론하기 위하여 본 논문에서 퍼지 연상기억장치에 기반한 방법을 제안한다. 제안된 방법은 웹 서버상에서 기술문서 특히, 정보기술문서를 검색하는 분야에 대하여 구현하였으며 그 결과를 보인다.

자율 재구성형 협업 공급망 프레임워크 및 기업간 신뢰모델 기반 이익분배 전략 개발 (Framework for Self-reconfigurable and Collaborative Supply Chains and Revenue Sharing Strategy based on Trust Models of Enterprises)

  • 이기열;류광열;문일경;정무영
    • 대한산업공학회지
    • /
    • 제37권4호
    • /
    • pp.323-330
    • /
    • 2011
  • Globalization of market and diversification of customers' needs make enterprises to collaboration of participants in supply chain. To establish collaboration, supply chain must have the flexibility and reconfigurability, which are supported by fractal based supply chain management (FrSCM). In this paper, base on the FrSCM, formulation of trust model among the enterprises in the supply chain, and development of profit sharing strategies in the supply chain based on the trust model are investigated. To evaluate trust model, generation of enterprise's goal and its description, extraction and systematic composition of trust factors and trust evaluation are investigated. Based on the developed model, we developed the fuzzy inference engine to evaluate the trust value in terms of numerical value. And then revenue sharing strategies are developed based on the fractal concept and trust model for the collaborative SCM. The fractal concept is used to obtain the optimal production and transportation plans. In addition, the trust model will be integrated into the RS model. In such an RS model, the supply chain will obtain the maximum total profit and profit of each participant depends on its trust value.