• Title/Summary/Keyword: centralized training

Search Result 30, Processing Time 0.025 seconds

Collaborative Modeling of Medical Image Segmentation Based on Blockchain Network

  • Yang Luo;Jing Peng;Hong Su;Tao Wu;Xi Wu
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.3
    • /
    • pp.958-979
    • /
    • 2023
  • Due to laws, regulations, privacy, etc., between 70-90 percent of providers do not share medical data, forming a "data island". It is essential to collaborate across multiple institutions without sharing patient data. Most existing methods adopt distributed learning and centralized federal architecture to solve this problem, but there are problems of resource heterogeneity and data heterogeneity in the practical application process. This paper proposes a collaborative deep learning modelling method based on the blockchain network. The training process uses encryption parameters to replace the original remote source data transmission to protect privacy. Hyperledger Fabric blockchain is adopted to realize that the parties are not restricted by the third-party authoritative verification end. To a certain extent, the distrust and single point of failure caused by the centralized system are avoided. The aggregation algorithm uses the FedProx algorithm to solve the problem of device heterogeneity and data heterogeneity. The experiments show that the maximum improvement of segmentation accuracy in the collaborative training mode proposed in this paper is 11.179% compared to local training. In the sequential training mode, the average accuracy improvement is greater than 7%. In the parallel training mode, the average accuracy improvement is greater than 8%. The experimental results show that the model proposed in this paper can solve the current problem of centralized modelling of multicenter data. In particular, it provides ideas to solve privacy protection and break "data silos", and protects all data.

A TQM case of Centralized Sequential Decision-making Problem

  • Chang, Cheng-Chang;Chu, Yun-Feng
    • International Journal of Quality Innovation
    • /
    • v.4 no.1
    • /
    • pp.131-147
    • /
    • 2003
  • This paper considers that a public department under specialized TQM manpower constraints have to implement multiple total quality management (TQM) policies to promote its service performance (fundamental goal) by adopting a centralized sequential advancement strategy (CSAS). Under CSAS, the decision-makers (DMs) start off by focusing specialized TQM manpower on a single policy, then transfer the specialized TQM manpower to the next policy when the first policy reaches the predetermined implementation time limit (in terms of education and training). Suppose that each TQM policy has a different desirous education and training goal. When the desirous goals for all TQM policies are achieved, we say that the fundamental goal will be satisfied. Within the limitation of total implementation period of time for all policies, assume the desirous goals for all TQM policies cannot be achieved completely. Under this premise, the optimal implementation sequence for all TQM policies must be calculated to maximize the weighted achievement of the desirous goal. We call this optimization problem a TQM case of "centralized sequential decision-making problem (CSDMP)". The achievement of the desirous goal for each TQM policy is usually affected by the experience in prior implemented policies, which makes solving CSDMP quite difficult. As a result, this paper introduces the concepts of sequential effectiveness and path effectiveness. The structural properties are then studied to propose theoretical methods for solving CSDMP. Finally, a numerical example is proposed to demonstrate CSDMP′s usability.

Analysis of Questionary Survey Research on the Intensive Major Course in the KNAC (전공심화과정 개설을 위한 설문조사연구)

  • Kang, Y.K.;Hong, K.H.
    • Journal of Practical Agriculture & Fisheries Research
    • /
    • v.10 no.1
    • /
    • pp.137-151
    • /
    • 2008
  • This research was conducted to suggest a policy plan for intensive major course in recurrent education system of KNAC. A survey was answered by students, graduates, field professors and (full-time) professors. The results are summarized as follows; 1. In the item of educational operation system, there were some differences in preference among 4 examinee groups. Students preferred 'semester system', graduates and field professors did 'once per week system', and professors 'cyber+centralized training system'. 2. As entering time, students and graduates preferred 'immediately after graduation'. However, field and full-time professors preferred '1 to 3 years after graduation' that became reality. 3. As board and lodging, all examinee groups wanted 'dormitory in college'. Students and graduates were open to pay educational expenses as a level of national colleges. 4. As a curriculum, the most preferred subject by all groups was 'major field technique', which was followed by 'marketing/sale' and 'farm management' in the order of preference.

Plans to Integrate for the Polygraph Institution (거짓말탐지기 교육기관의 일원화 방안)

  • Kang, Dong Beom;Bae, Du Yeol
    • Convergence Security Journal
    • /
    • v.15 no.1
    • /
    • pp.49-57
    • /
    • 2015
  • As the capitalist society was launched, false has been increasing day by day for the personal profit. Study after study since a long time ago has concluded that today's polygraph developed in order to determine these false. In Korea the polygraph has been used actively in current investigation agency, and passively in a private enterprise by a former polygraph examinant from the investigation agency. Each investigation agency is recruiting polygraph examinants through the strict qualifications, training education. Decisions of Supreme Court precedents about the polygraph test results are denying admissibility of evidence in reliability on the efficiency of a test equipment, way to ask, qualities of polygraph examinant, etc. The most fundamental cause of the issues mentioned in the precedents is that examinants of each investigation agency are being trained by dual education not centralized. Because of each investigation agency has its own training and polygraph examinant, each agency can occur variations every agency or every examinant, therefore ensuring the centralized educational system is needed. In this way, ensuring the centralized educational system will contribute to improve the reliability of polygraph test results and make a retrenchment in the educational budget in accordance with examinant training of each agency.

Centralized Machine Learning Versus Federated Averaging: A Comparison using MNIST Dataset

  • Peng, Sony;Yang, Yixuan;Mao, Makara;Park, Doo-Soon
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.2
    • /
    • pp.742-756
    • /
    • 2022
  • A flood of information has occurred with the rise of the internet and digital devices in the fourth industrial revolution era. Every millisecond, massive amounts of structured and unstructured data are generated; smartphones, wearable devices, sensors, and self-driving cars are just a few examples of devices that currently generate massive amounts of data in our daily. Machine learning has been considered an approach to support and recognize patterns in data in many areas to provide a convenient way to other sectors, including the healthcare sector, government sector, banks, military sector, and more. However, the conventional machine learning model requires the data owner to upload their information to train the model in one central location to perform the model training. This classical model has caused data owners to worry about the risks of transferring private information because traditional machine learning is required to push their data to the cloud to process the model training. Furthermore, the training of machine learning and deep learning models requires massive computing resources. Thus, many researchers have jumped to a new model known as "Federated Learning". Federated learning is emerging to train Artificial Intelligence models over distributed clients, and it provides secure privacy information to the data owner. Hence, this paper implements Federated Averaging with a Deep Neural Network to classify the handwriting image and protect the sensitive data. Moreover, we compare the centralized machine learning model with federated averaging. The result shows the centralized machine learning model outperforms federated learning in terms of accuracy, but this classical model produces another risk, like privacy concern, due to the data being stored in the data center. The MNIST dataset was used in this experiment.

Survey on Recent Advances in Multiagent Reinforcement Learning Focusing on Decentralized Training with Decentralized Execution Framework (멀티에이전트 강화학습 기술 동향: 분산형 훈련-분산형 실행 프레임워크를 중심으로)

  • Y.H. Shin;S.W. Seo;B.H. Yoo;H.W. Kim;H.J. Song;S. Yi
    • Electronics and Telecommunications Trends
    • /
    • v.38 no.4
    • /
    • pp.95-103
    • /
    • 2023
  • The importance of the decentralized training with decentralized execution (DTDE) framework is well-known in the study of multiagent reinforcement learning. In many real-world environments, agents cannot share information. Hence, they must be trained in a decentralized manner. However, the DTDE framework has been less studied than the centralized training with decentralized execution framework. One of the main reasons is that many problems arise when training agents in a decentralized manner. For example, DTDE algorithms are often computationally demanding or can encounter problems with non-stationarity. Another reason is the lack of simulation environments that can properly handle the DTDE framework. We discuss current research trends in the DTDE framework.

Design of a ParamHub for Machine Learning in a Distributed Cloud Environment

  • Su-Yeon Kim;Seok-Jae Moon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.16 no.2
    • /
    • pp.161-168
    • /
    • 2024
  • As the size of big data models grows, distributed training is emerging as an essential element for large-scale machine learning tasks. In this paper, we propose ParamHub for distributed data training. During the training process, this agent utilizes the provided data to adjust various conditions of the model's parameters, such as the model structure, learning algorithm, hyperparameters, and bias, aiming to minimize the error between the model's predictions and the actual values. Furthermore, it operates autonomously, collecting and updating data in a distributed environment, thereby reducing the burden of load balancing that occurs in a centralized system. And Through communication between agents, resource management and learning processes can be coordinated, enabling efficient management of distributed data and resources. This approach enhances the scalability and stability of distributed machine learning systems while providing flexibility to be applied in various learning environments.

DRM-FL: A Decentralized and Randomized Mechanism for Privacy Protection in Cross-Silo Federated Learning Approach (DRM-FL: Cross-Silo Federated Learning 접근법의 프라이버시 보호를 위한 분산형 랜덤화 메커니즘)

  • Firdaus, Muhammad;Latt, Cho Nwe Zin;Aguilar, Mariz;Rhee, Kyung-Hyune
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.05a
    • /
    • pp.264-267
    • /
    • 2022
  • Recently, federated learning (FL) has increased prominence as a viable approach for enhancing user privacy and data security by allowing collaborative multi-party model learning without exchanging sensitive data. Despite this, most present FL systems still depend on a centralized aggregator to generate a global model by gathering all submitted models from users, which could expose user privacy and the risk of various threats from malicious users. To solve these issues, we suggested a safe FL framework that employs differential privacy to counter membership inference attacks during the collaborative FL model training process and empowers blockchain to replace the centralized aggregator server.

Distributed Federated Learning-based Intrusion Detection System for Industrial IoT Networks (산업 IoT 전용 분산 연합 학습 기반 침입 탐지 시스템)

  • Md Mamunur Rashid;Piljoo Choi;Suk-Hwan Lee;Ki-Ryong Kwon
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2023.11a
    • /
    • pp.151-153
    • /
    • 2023
  • Federated learning (FL)-based network intrusion detection techniques have enormous potential for securing the Industrial Internet of Things (IIoT) cybersecurity. The openness and connection of systems in smart industrial facilities can be targeted and manipulated by malicious actors, which emphasizes the significance of cybersecurity. The conventional centralized technique's drawbacks, including excessive latency, a congested network, and privacy leaks, are all addressed by the FL method. In addition, the rich data enables the training of models while combining private data from numerous participants. This research aims to create an FL-based architecture to improve cybersecurity and intrusion detection in IoT networks. In order to assess the effectiveness of the suggested approach, we have utilized well-known cybersecurity datasets along with centralized and federated machine learning models.

Development of Contents for Improve the Concentration based on Neurofeedback (뉴로피드백 기반의 집중력 향상 콘텐츠 개발)

  • Park, Tae-Woo;Park, Jun-Mo;Jeong, Do-Un
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2016.05a
    • /
    • pp.284-285
    • /
    • 2016
  • In this paper, reflecting the index of concentration and real-time EEG measurement, implementation of the game-type content that can be centralized power of training. Implemented content, for more effective training, based on the brain wave difference in each user, by reflecting an indication of concentration, it is possible by level training. In order to evaluate the usefulness of the implemented content, to target the five subjects, is underway to improve training of concentration, through a comparative analysis of the changes in the index of ability to concentrate, to confirm the improvement of the concentration of the user it could be.

  • PDF