• Title/Summary/Keyword: SoftMax

Search Result 102, Processing Time 0.029 seconds

Successive Approximated Log Operation Circuit for SoftMax in CNN (CNN의 SoftMax 연산을 위한 연속 근사 방식의 로그 연산 회로)

  • Kang, Hyeong-Ju
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.2
    • /
    • pp.330-333
    • /
    • 2021
  • In a CNN for image classification, a SoftMax layer is usually placed at the end. The exponentinal and logarithmic operations in the SoftMax layer are not adequate to be implemented in an accelerator circuit. The operations are usually implemented with look-up tables, and the exponential operation can be implemented in an iterative method. This paper proposes a successive approximation method to calculate a logarithm to remove a very large look-up table. By substituing the large table with two very small tables, the circuit can be reduced much. The experimental results show that the 85% area reduction can be reached with a small error degradation.

SoftMax Computation in CNN Using Input Maximum Value (CNN에서 입력 최댓값을 이용한 SoftMax 연산 기법)

  • Kang, Hyeong-Ju
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.2
    • /
    • pp.325-328
    • /
    • 2022
  • A convolutional neural network(CNN) is widely used in the computer vision tasks, but its computing power requirement needs a design of a special circuit. Most of the computations in a CNN can be implemented efficiently in a digital circuit, but the SoftMax layer has operations unsuitable for circuit implementation, which are exponential and logarithmic functions. This paper proposes a new method to integrate the exponential and logarithmic tables of the conventional circuits into a single table. The proposed structure accesses a look-up table (LUT) only with a few maximum values, and the LUT has the result value directly. Our proposed method significantly reduces the space complexity of the SoftMax layer circuit implementation. But our resulting circuit is comparable to the original baseline with small degradation in precision.

Maximum shear modulus of rigid-soft mixtures subjected to overconsolidation stress history

  • Boyoung Yoon;Hyunwook Choo
    • Geomechanics and Engineering
    • /
    • v.37 no.5
    • /
    • pp.443-452
    • /
    • 2024
  • The use of sand-tire chip mixtures in construction industry is a sustainable and environmentally friendly approach that addresses both waste tire disposal and soil improvement needs. However, the addition of tire chip particles to natural soils decreases maximum shear modulus (Gmax), but increases compressibility, which can be potential drawbacks. This study examines the effect of overconsolidation stress history on the maximum shear modulus (Gmax) of rigid-soft mixtures with varying size ratios (SR) and tire chip contents (TC) by measuring the wave velocity through a 1-D compression test during loading and unloading. The results demonstrate that the Gmax of tested mixtures in the normally consolidated state increased with increasing SR and decreasing TC. However, the tested mixtures with a smaller SR exhibited a greater increase in Gmax during unloading because of the active pore-filling behavior of the smaller rubber particles and the consequent increased connectivity between sand particles. The SR-dependent impact of the overconsolidation stress history on Gmax was verified using the ratio between the swelling and compression indices. Most importantly, this study reveals that the excessive settlement and lower Gmax of rigid-soft mixtures can be overcome by introducing an overconsolidated state in sand-tire chip mixtures with low TC.

Soft decision for Gray Coded PAM Signals Using Max-Log-MAP (Max-Log-MAP을 이용한 Gray 부호화된 PAM 신호의 연판정 계산식)

  • Hyun, Kwang-Min;Yoon, Dong-Weon
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.2C
    • /
    • pp.117-122
    • /
    • 2006
  • In this paper, we present a simple and general soft bit decision expression for a Gray coded PAM signal over additive white Gaussian noise(AWGN) channel with the log likelihood ratio(LLR). In order to reduce the complexity of the LLR calculation, we make the bitwise LLR expression simple by replacing the mathematical max functions of the conventional Max-Log-MAP expression with simple arithmetic functions associated with some deterministic parameters, such as a received value and distance between symbols on a signal space. Taking the implementation issues, like the area of silicon, the power consumption, the timing latency, and so on, into consideration, we submit that the proposed method is a promising alternative way to conventional methods for reconfigurable systems.

The Differentiation of Malignant and Benign Musculoskeletal Tumors by F-18 FDG PET/CT Studies - Determination of maxSUV by Analysis of ROC Curve (F-18 FDG PET/CT에서 양성과 악성 근골격 종양의 감별진단 - 수신자 판단특성곡선을 이용한 maxSUV의 절단값 결정)

  • Kong, Eun-Jung;Cho, Ihn-Ho;Chun, Kyung-Ah;Won, Kyu-Chang;Lee, Hyung-Woo;Choi, Jun-Heok;Shin, Duk-Seop
    • Nuclear Medicine and Molecular Imaging
    • /
    • v.41 no.6
    • /
    • pp.553-560
    • /
    • 2007
  • Purpose: We evaluated the standard uptake value (SUV) of F-18 FDG at PET/CT for differentiation of benign from malignant tumor in primary musculoskeletal tumors. Materials and Methods: Forty-six tumors (11 benign and 12 malignant soft tissue tumors, 9 benign and 14 malignant bone tumors) were examined with F-18 FDG PET/CT (Discovery ST, GE) prior to tissue diagnosis. The maxSUV(maximum value of SUV) were calculated and compared between benign and malignant lesions. The lesion analysis was based on the transverse whole body image. The maxSUV with cutoff of 4.1 was used in distinguishing benign from malignant soft tissue tumor and 3.05 was used in bone tumor by ROC curve. Results: There was a statistically significant difference in maxSUV between benign (n=11; maxSUV $3.4{\pm}3.2$) and malignant (n=12; maxSUV $14.8{\pm}12.2$) lesions in soft tissue tumor (p=0.001). Between benign bone tumor (n=9; maxSUV $5.4{\pm}4.0$) and malignant bone tumor (n=14; maxSUV $7.3{\pm}3.2$), there was not a significant difference in maxSUV. The sensitivity and specificity for differentiating malignant from benign soft tissue tumor was 83% and 91%, respectively. There were four false positive malignant bone tumor cases to include fibrous dysplasia, Langerhans-cell histiocytosis (n=2) and osteoid osteoma. Also, one false positive case of malignant soft tissue tumor was nodular fasciitis. Conclusion: The maxSUV was useful for differentiation of benign from malignant lesion in primary soft tissue tumors. In bone tumor, the low maxSUV correlated well with benign lesions but high maxSUV did not always mean malignancy.

Bioequivalence of Cholicerin Soft Capsule to Gliatilin Soft Capsule (Choline Alphoscerate 400 mg)

  • Kang, Hyun-Ah;Kim, Se-Mi;Kang, Seung-Rae;Kang, Min-Sun;Lee, Sang-No;Kwon, In-Ho;Yoo, Hee-Doo;Kim, Yoon-Gyoon;Lee, Yong-Bok
    • Journal of Pharmaceutical Investigation
    • /
    • v.40 no.2
    • /
    • pp.109-115
    • /
    • 2010
  • The purpose of the present study was to evaluate the bioequivalence of two choline alphoscerate soft capsules, Gliatilin soft capsule (Daewoong Pharmaceuticals Co., Ltd.) and Cholicerin soft capsule (Sam Chun Dang Pharm. Co., Ltd.), according to the guidelines of Korea Food and Drug Administration (KFDA). Serum concentrations of choline after oral administration of choline alphoscerate were determined using a validated LC/MS/MS method. This method showed linear response over the concentration range of 0.5-20 ${\mu}g$/mL with correlation coefficient of 0.9999. The lower limit of quantitation using 100 ${\mu}L$ of serum was 0.5 ${\mu}g$/mL which was sensitive enough for pharmacokinetic studies. Thirty six healthy male Korean volunteers received each medicine at the choline alphoscerate dose of 1200 mg in a $2{\times}2$ crossover study. There was a one-week washout period between the doses. Blood samples were taken at predetermined time intervals up to 8 hr. $AUC_t$ (the area under the serum concentration-time curve from time 0 to 8 hr) was calculated by the linear trapezoidal rule method. $C_{max}$ (the maximum serum drug concentration) and $T_{max}$ (the time to reach $C_{max}$) were compiled from the serum concentration-time data. Analysis of variance was carried out using logarithmically transformed $AUC_t$ and $C_{max}$. No significant sequence effect was found for all of the bioavailability parameters, indicating that the crossover design was properly performed. The 90% confidence intervals of the $AUC_t$ ratio and the $C_{max}$ ratio for Cholicerin/Gliatilin were log0.9998-log1.1172 and log0.9938-1.0944, respectively. These values were within the acceptable bioequivalence intervals of log0.80-log1.25. Thus, the criteria of the KFDA guidelines for the bioequivalence was satisfied, indicating Cholicerin soft capsule and Gliatilin soft capsule are bioequivalent.

Approximated MAP Algorithm for Gray Coded QAM Signals (Gray 부호화된 QAM 신호를 위한 근사화된 MAP 알고리듬)

  • Hyun, Kwang-Min
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.10 no.12
    • /
    • pp.3702-3707
    • /
    • 2009
  • In this paper, a new approximated MAP algorithm for soft bit decision from QAM symbols is proposed for Gray Coded QAM signals, based on the Max-Log-MAP and a Gray coded QAM signal can be separated into independent two Gray coded PAM signal, M-PAM on I axis with M symbols and N-PAM on Q axis with N symbols. The Max-Log-MAP used distance comparisons between symbols to get the soft bit decision instead of mathematical exponential or logarithm functions. But in accordance with the increase of the number of symbols, the number of comparisons also increase with high complexity. The proposed algorithm is used with the Euclidean distance and constituted with plain arithmetic functions, thus we can know intuitively that the algorithm has low implementing complexity comparing to conventional ones.

A Receiver-Aided Seamless And Smooth Inter-RAT Handover At Layer-2

  • Liu, Bin;Song, Rongfang;Hu, Haifeng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.10
    • /
    • pp.4015-4033
    • /
    • 2015
  • The future mobile networks consist of hyper-dense heterogeneous and small cell networks of same or different radio access technologies (RAT). Integrating mobile networks of different RATs to provide seamless and smooth mobility service will be the target of future mobile converged network. Generally, handover from high-speed networks to low-speed networks faces many challenges from application perspective, such as abrupt bandwidth variation, packet loss, round trip time variation, connection disruption, and transmission blackout. Existing inter-RAT handover solutions cannot solve all the problems at the same time. Based on the high-layer convergence sublayer design, a new receiver-aided soft inter-RAT handover is proposed. This soft handover scheme takes advantage of multihoming ability of multi-mode mobile station (MS) to smooth handover procedure. In addition, handover procedure is seamless and applicable to frequent handover scenarios. The simulation results conducted in UMTS-WiMAX converged network scenario show that: in case of TCP traffics for handover from WiMAX to UMTS, not only handover latency and packet loss are eliminated completely, but also abrupt bandwidth/wireless RTT variation is smoothed. These delightful features make this soft handover scheme be a reasonable candidate of mobility management for future mobile converged networks.

Efficient Method to Implement Max-Log-MAP Algorithm: Parallel SOVA

  • Lee, Chang-Woo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.33 no.6C
    • /
    • pp.438-443
    • /
    • 2008
  • The efficient method to implement the Max-Log-MAP algorithm is proposed by modifying the conventional algorithm. It is called a parallel soft output Viterbi algorithm (SOVA) and the rigorous proof is given for the equivalence between the Max-Log-MAP algorithm and the parallel SOVA. The parallel SOVA is compared with the conventional algorithms and we show that it is an efficient algorithm implementing the modified SOVA in parallel.