• Title/Summary/Keyword: GEMM

Search Result 11, Processing Time 0.028 seconds

Optimizing 2-stage Tiling-based Matrix Multiplication in FPGA-based Neural Network Accelerator (FPGA기반 뉴럴네트워크 가속기에서 2차 타일링 기반 행렬 곱셈 최적화)

  • Jinse, Kwon;Jemin, Lee;Yongin, Kwon;Jeman, Park;Misun, Yu;Taeho, Kim;Hyungshin, Kim
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.17 no.6
    • /
    • pp.367-374
    • /
    • 2022
  • The acceleration of neural networks has become an important topic in the field of computer vision. An accelerator is absolutely necessary for accelerating the lightweight model. Most accelerator-supported operators focused on direct convolution operations. If the accelerator does not provide GEMM operation, it is mostly replaced by CPU operation. In this paper, we proposed an optimization technique for 2-stage tiling-based GEMM routines on VTA. We improved performance of the matrix multiplication routine by maximizing the reusability of the input matrix and optimizing the operation pipelining. In addition, we applied the proposed technique to the DarkNet framework to check the performance improvement of the matrix multiplication routine. The proposed GEMM method showed a performance improvement of more than 2.4 times compared to the non-optimized GEMM method. The inference performance of our DarkNet framework has also improved by at least 2.3 times.

Exploring GEMM Optimization Techniques for PIM Architecture: A Case Study on UPMEM (PIM 아키텍처를 위한 GEMM 최적화 기법 탐구: UPMEM 사례 연구)

  • Chan Lee;Heelim Choi;Hanjun Kim
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2024.05a
    • /
    • pp.65-68
    • /
    • 2024
  • 이 연구는 PIM(Processing-in-Memory) 아키텍처를 활용하여 General Matrix Multiplication(GEMM)의 최적화 기법을 UPMEM PIM 을 통해 탐구한다. 본 연구는 CPU 에서 경험하는 메모리 대역폭의 제한을 극복하고 병렬 처리 구조를 활용함으로써 GEMM 연산에서 PIM 의 잠재적 이점을 확인한다. 또한 연속된 세 개의 행렬 곱셈에 대한 효율성을 평가하고, 데이터 전송 시간이 성능 최적화의 주요병목 현상으로 작용하는 것을 확인한다. CPU 에서 UPMEM 커널로 전송되는 데이터의 양을 한 번에 늘리면서 전송 횟수를 줄이는 방법을 사용하여 CPU 에 비해 성능을 최대 6.57 배 향상시켰다.

  • PDF

The Effect of DanSamSaMul-Tang on Hematopoiesis (단삼사물탕이 조혈작용에 미치는 영향)

  • 유재연;김영철;이장훈;우흥정
    • The Journal of Korean Medicine
    • /
    • v.23 no.1
    • /
    • pp.145-155
    • /
    • 2002
  • Objectives : Korean traditional medicinal herbs and some formulas have been used to improve the function of the hematopoietic system. The present research is to examine the effect of DanSamSaMul- Tang(DSSMT) as a biological response modifier related to hemato-potentiating function using bone marrow cell as a testing system. Methods : Mice with leukopenia and thrombocytopenia induced by CTX were treated with DSSMT Extracts. Then we observed cytokines mRNA expression level, the number of CFU-GEMM and BFU-E, and the expression of TPO and SCF in bone marrow cells of mice. Results : In the DSSMT group, the gene expressions of hematopoietic cytokines were increased significantly and the number of CFU-GEMM and BFU-E of this group was significantly increased compared to the group treated only with EPO and IL-3. The expressions of TPO and SCF in the group treated with DSSMT were higher than those of the control group. Conclusions : We showed that DSSMT has a good effect on the hematopoietic system. This could also be used as important research data for Korean oriental medicine about hemato-potentiating.

  • PDF

Effects of Juakium-derivative on Experimental Aplastic Anemia (좌귀음가미방이 실험적 재생불량성빈혈에 미치는 영향)

  • 박신명;김영철;이장훈;우흥정
    • The Journal of Korean Medicine
    • /
    • v.23 no.1
    • /
    • pp.133-144
    • /
    • 2002
  • Objectives : Korean traditional medicinal herbs have been used to improve the function of the hematopoietic system. The purpose of this study is to examine the hematopoietic effects of Juakium-derivative on aplastic anemia. Methods : In vitro, after bone marrow cells of mice with aplastic anemia induced by benzene were cultured with Juakium-derivative, we measured the gene expressions of hematopoietic cytokines, the intracellular TPO and SCF expression and the colony number of CFU-GEMM and BFU-E. Results : The results are summarized as follows : 1. The gene expressions of hematopoietic cytokines (TPO, c-mpl, SCF, c-kit, IL-3, EPO, EpoR, GM-CSF) and the TPO and SCF expression of the group treated with Juakium-derivative increased significantly more than those of the control group. 2. The colony number of CFU-GEMM and BFU-E in the rEPO plus rIL-3 plus Juakium-derivative group increased significantly compared with the only rEPO plus rIL-3 group. Conclusion : It was acknowledged that Juakium-derivative has hemato-potentiating effects on aplastic anemia induced by benzene and it is expected that Juakium-derivative can be used clinically for the patient with hematopoietic system disorder. This study could also be used further as important research data for Korean oriental medicine about hemato-potentiating. The exact mechanism explaining our study would need to be studied further.

  • PDF

Enhancing effect of Canavalia gladiata DC semen on the hematopoietic expansion and function of stem cells (도두(刀豆)의 조혈증진 작용에 관한 연구)

  • Kim, Seung-Hyung;Kim, Kun-Hoae;Chi, Gyeong-Yup;Cho, In-Sik;Kim, Han-Young;Lee, Young-Cheol
    • The Korea Journal of Herbology
    • /
    • v.27 no.4
    • /
    • pp.9-16
    • /
    • 2012
  • Objective : Canavalia gladiata DC semen (CGS) have been used to improve hematopoietic activity. In the current study, we investigated whether CGS regulate hemato-potentiating function using hematopoietic stem cells (HSCs) as a testing system. Methods : HSCs isolated from femur in mice with leukopenia and thrombocytopenia induced induced by CTX. Then, Real-time PCR was performed to measure the mRNA expression and hematopoietic related gene (EPO, IL-3, SCF, c-kit, GM-CSF), the phoaphorylation of GATA-1 and STAT-5a/b were observed by ELISA method, and the number of granulocyte erythrocyte monocyte macrophage colony-forming units (CFU-GEMM) and erythroid burst forming units (BFU-E), semisolid clonogenic assay was performed. Result : When HSCs were treated with CGS, the expression of hematopoietic related genes (EPO, IL-3, SCF, c-kit, and GM-CSF) were significantly increased at the levels of mRNA as well as production in HSCs. Additionally, CGS enhanced phosphorylation of STAT-1 and signal transducer and activator of transcription-5a/b (STAT-5a/b) in HSCs. Furthermore, CGS significantly enhanced the growth rate of granulocyte erythrocyte monocyte macrophage colony-forming units (CFU-GEMM) and erythroid burst forming units (BFU-E) in vitro. Conclusion : These result suggest that CGS has hematopoietic enhancement via hematopoietic cytokine-mediated GATA-1/STAT-5a/b pathway.

Effects of Korean Traditional Medicine on Murine Hematopiesis (Regulation of Hematopoietic Cytokine & $CD34^{+}$ cell Expression) (수 종의 한약제제가 조혈작용에 미치는 영향)

  • 전재현;김영철;이장훈;우흥정
    • The Journal of Korean Medicine
    • /
    • v.22 no.3
    • /
    • pp.156-168
    • /
    • 2001
  • Objectives : To evaluate the diverse actions of stimulation on the hematopoietic system, 4 formulas (KH I, KH 2, KH 3, KH 4) were studied. Method and Result : RT-PCR was performed to measure the gene expression of hematopoietic cytokines (TPO, GM-CSF, SCF, IL-3). When bone marrow cells were treated with KH 1, 2, 3, 4, the gene expressions of TPO, SCF, IL-3, and GM-CSF were increased. Flow cytometric analysis was performed to measure the expression of CD34+ cell activity. After 72 hrs culture supplemented with KH 1, 2, 3, 4, the percent of CD34+ cell of KH 2, 3, 4 were increased. To measure the expression of colony forming units - granulocyte erythrocytes, macrophages, megakaryocytes (CFU-GEMM) and burst forming unit-erythroid (BFU-E), semisolid clonogenic assay was performed. After 14 days of culture the number of CFU-GEMM and BFU-E of KH I, 2, 3, 4 were significantly increased compared to those of EPO groups (KH 1 P<0.0l, KH 2 P<0.05, KH 3 P<0.001, KH 4 P<0.0l). To determine the intracelluar TPO expression by KH 3, KH 4 in bone marrow cells, intracelluar staining and flow cytometric analysis were performed. After 24 hrs cultures, the TPO expression of the KH 3 and KH 4 treated groups were increased over those of the controlled groups (control : 50%, KH 3 : 87%, KH 4 : 78%). Conclusion : These results suggest that KH I, KH 2, KH 3, KH 4 have hematopoietic effects through increasing the production of hematopoietic cytokines and stimulating the activity of $CD34^{+}$ cells. This study also shows that KH 3 has a more effective hematopoietic effect than KH 1, 2, 4. These results suggest that the formulas (KH I, 2, 3, 4) can be applied to the patients with inappropriate hematopoietic system, and that KH 3 can be the most effective formula among these 4 in treating bone marrow disease in clinics.

  • PDF

Ex vivo Expansion of CD34+ Hematopoietic Cells from Cord Blood in Various Culture Environments (다양한 배양 조건에서 제대혈 유래 CD34+ 조혈 세포의 체외 증식)

  • Choi, Yong Woon;Oh, Duk Jae
    • Korean Chemical Engineering Research
    • /
    • v.44 no.1
    • /
    • pp.73-80
    • /
    • 2006
  • This study compared cell expansion and colony forming ability in human cord blood stem cells cultured ex vivo with two kinds of cytokine combinations, two kinds of media, presence or absence of fetal bovine serum (FBS) and two or three dimensional (2D or 3D) culture environments. Purified $CD34^+$ cells were cultured in the IMDM (Iscove's Modified Dulbecco's Medium) and SFM (Serum Free Medium) containing a cytokine cocktail-I (coc-I) (EPO, GMCSF, SCF, and IL-3) or a cytokine cocktail-II (coc-II) (TPO, G-CSF, SCF, IL-6, and Flt3/Flk-2 ligand) with or without FBS. Generally, higher cellular and clonogenic expansion were observed in the coc-I cytokine condition, compared to coc-II cytokine condition. 3D (Methocult) and 2D (IMDM + coc-I + FBS) conditions gave the greatest cell ($2,258{\pm}456$ fold) and CFU (BFU-E: $652{\pm}19$, CFU-GM: $520{\pm}58$, CFU-GEMM: $339{\pm}100$ fold) expansions, respectively. In aspect of medium, IMDM was better than SFM, except for coc-II condition without FBS. In conclusion, 'IMDM + coc-I + FBS' and 'IMDM + coc-I' were the best CFU expansions on the occasion of all culture conditions. FBS and 2D conditions had affirmative effect on CFU expansion, generally. These data might provide a variety of notions about ex vivo expansion of hematopoietic stem cells.

Studies on the regulation of Hematopoietic enhancement of Brassica campestris var narinosa., Canavalia gladiata DC semen and their combinational prescription via Jak2/STAT5/GATA1 Pathway in Sca-1+ hematopoietic stem cells (Sca-1+골수조혈세포에서 JAK2/STAT5/GATA-1 신호전달 경로를 통한 다채, 도두 그리고 두 조합물에 의한 조혈증진 조절에 관한 연구)

  • Kim, Kunhoae;Kim, Seung-Hyung;Cho, In-Sik;Kim, Han-Young;Kim, Dong-Seon;Lee, Young-Cheol
    • The Korea Journal of Herbology
    • /
    • v.28 no.4
    • /
    • pp.7-16
    • /
    • 2013
  • Objectives : Brassica campestris var narinosa (BCN), Canavalia gladiata DC semen (CGD) and their combinational prescription (BCN+CGD) have been use to demonstrate to regulate hematopoiesis. In the current study, we investigated whether Brassica campestris var narinosa, Canavalia gladiata DC semen and their combinational prescription is related to hemato-potentiating function using Sca-$1^+$ hematopoietic stem cells (Sca-$1^+HSCs$) as a testing system. Methods : Sca-$1^+HSCs$ isolated from femur in C57bl/6 mice with leukopenia and thrombocytopenia induced by cyclophosphamide (CTX). Then, Real-time PCR was performed to measure the mRNA expression, ELISA and haematopoiesis-related gene (EPO, TPO, IL-3, SCF, c-kit, GM-CSF), the phosphorylation of JAK2, GATA-1 and STAT-5a/b were observed by western blot, and the numbers of $CD117^+/Sca-1^+$ cell and the number of granulocyte erythrocyte monocyte macrophage colony-forming units (CFU-GEMM) and erythroid burst forming units (BFU-E), semisolid clonogenic assay was performed. Result : When Sca-$1^+HSCs$ were treated with Brassica campestris var narinosa, Canavalia gladiata DC semen and their combinational prescription with rIL-3/rSCF, the expression of haematopoiesis-related (EPO, TPO, IL-3, SCF, c-kit, and GM-CSF) were significantly increased at the levels of mRNA as well as production in Sca-$1^+HSCs$. Additionally, CGS enhanced phosphorylation of JAK2, GATA-1, and signal transducer and activator of transcription-5a/b (STAT-5a/b) in Sca-$1^+HSCs$. Furthermore, their combinational prescription (BCN+CGD) significantly enhanced the growth rate of granulocyte erythrocyte monocyte macrophage colony-forming units (CFU-GEMM) and erythroid burst forming units (BFU-E) in vitro. Conclusion : These result suggest that Brassica campestris var narinosa (BCN) and Canavalia gladiata DC have hematopoietic enhancement via hematopoietic cytokine-mediated JAK2/GATA-1/STAT-5a/b pathway, and their combinational prescription (BCN+CGD) has superior hematopoietic enhancement to those of individual extracts.

Implementation of Neural Network Accelerator for Rendering Noise Reduction on OpenCL (OpenCL을 이용한 랜더링 노이즈 제거를 위한 뉴럴 네트워크 가속기 구현)

  • Nam, Kihun
    • The Journal of the Convergence on Culture Technology
    • /
    • v.4 no.4
    • /
    • pp.373-377
    • /
    • 2018
  • In this paper, we propose an implementation of a neural network accelerator for reducing the rendering noise using OpenCL. Among the rendering algorithms, we selects a ray tracing to assure a high quality graphics. Ray tracing rendering uses ray to render, less use of the ray will result in noise. Ray used more will produce a higher quality image but will take operation time longer. To reduce operation time whiles using fewer rays, Learning Base Filtering algorithm using neural network was applied. it's not always produce optimize result. In this paper, a new approach to Matrix Multiplication that is based on General Matrix Multiplication for improved performance. The development environment, we used specialized in high speed parallel processing of OpenCL. The proposed architecture was verified using Kintex UltraScale XKU6909T-2FDFG1157C FPGA board. The time it takes to calculate the parameters is about 1.12 times fast than that of Verilog-HDL structure.