• Title/Summary/Keyword: 10-MDP

Search Result 112, Processing Time 0.037 seconds

Deep Reinforcement Learning-based Distributed Routing Algorithm for Minimizing End-to-end Delay in MANET (MANET에서 종단간 통신지연 최소화를 위한 심층 강화학습 기반 분산 라우팅 알고리즘)

  • Choi, Yeong-Jun;Seo, Ju-Sung;Hong, Jun-Pyo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.9
    • /
    • pp.1267-1270
    • /
    • 2021
  • In this paper, we propose a distributed routing algorithm for mobile ad hoc networks (MANET) where mobile devices can be utilized as relays for communication between remote source-destination nodes. The objective of the proposed algorithm is to minimize the end-to-end communication delay caused by transmission failure with deep channel fading. In each hop, the node needs to select the next relaying node by considering a tradeoff relationship between the link stability and forward link distance. Based on such feature, we formulate the problem with partially observable Markov decision process (MDP) and apply deep reinforcement learning to derive effective routing strategy for the formulated MDP. Simulation results show that the proposed algorithm outperforms other baseline schemes in terms of the average end-to-end delay.

Change in the Measured Value at 99mTc-MDP Administration before and after Bone Density Measurement using the Dual Energy X-ray Absorptiometry (이중에너지 X선 흡수법을 이용한 골밀도 측정시 99mTc-MDP 투여 전·후 측정값의 변화)

  • Kang, Yong-Gil;Won, Do-Yeon;Jung, Hong-Moon
    • Journal of the Korean Society of Radiology
    • /
    • v.11 no.1
    • /
    • pp.43-48
    • /
    • 2017
  • Measurement of bone marrow measurements may occur if bone marrow examination performed with bone marrow examination (bone marrow examination) and bone density (bone scan) are performed together recently. Thus, it was examined in clinical aspects that $^{99m}Tc-MDP$ compounds were affected by bone mineral density measurements. The average age of the participants in the experiment was $35.17{\pm}9.45$ and the patient fractures of the lumbar vertebrae that could affect the metabolic disease and bone density measurements affecting the metabolic disease of the 17 subjects. 6 patients with normal bone mineral density T-scores>-1.0 in 12 patients were analyzed before and after the administration of $^{99m}Tc-MDP$. In the lumbar spine, the average of $0.975{\pm}0.084g/cm^2$ and $0.966{\pm}0.078g/cm^2$ were increased by $0.009g/cm^2$. respectively In the right proximal femur, mean values were $0.909{\pm}0.078g/cm^2$ and $0.913{\pm}0.086g/cm^2$. In the right proximal thigh, mean values were $0.909{\pm}0.078g/cm^2$ and $0.913{\pm}0.08 g/cm^2$, respectively, which decreased by $0.004g/cm^2$. In the left side proximal femur, mean $0.887{\pm}0.099g/cm^2$ and $0.881{\pm}0.103g/cm^2$, respectively, increased by $0.007g/cm^2$. Therefore, the BMD changes in the lumbar region were larger than that in the proximal thigh. In addition, $^{99m}Tc-MDP$ did not affect the BMD. And a bone scan test using a technetium-labeled compound emitting a gamma-ray energy of 140 keV did not significantly affect bone density measurements. However, if the nuclear medical examination and the osteoporosis test are to be performed together, the examination should be carried out at intervals considering the exposures of the patient.

Antioxidant and Tyrosinase Inhibitory Effects of Paeonia suffruticosa Water Extract (목단피 물 추출물의 항산화 및 Tyrosinase 억제효과)

  • You, Jin-Kyoun;Chung, Mi-Ja;Kim, Dae-Jung;Seo, Dong-Joo;Park, Jeong-Hae;Kim, Tae-Woo;Choe, Myeon
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.38 no.3
    • /
    • pp.292-296
    • /
    • 2009
  • Tyrosinase catalyzes melanin synthesis in skin melanocytes. The effects of Paeonia sufficinalis water extract (MDP) on antioxidant and tyrosinase activities have been studied in a cell-free system and mouse melanoma B16 cell. Radical scavenging activity of MDP was tested by DPPH assay and it showed high DPPH radical scavenging activity. The cellular tyrosinase activity was measured in mouse melanoma B16 cell by RT-PCR and enzyme activity. Treatment with MDP for 24 hr resulted in decreased tyrosinase mRNA level. Tyrosinase activity was decreased, compared with control, in cells exposed to MDP. Thus, Paeonia sufficinalis water extracts may be a candidate for cosmetic use.

Inhibitory action of adenosine on sinus rate in isolated rabbit SA node (토끼 동방결절 박동수에 대한 아데노신의 작용)

  • Chae, Hurn;Suh, Kyung-Phlill;Kim, Ki-Whan
    • Journal of Chest Surgery
    • /
    • v.16 no.2
    • /
    • pp.199-212
    • /
    • 1983
  • The inhibition/influences of adenine compounds on the heart have been described repeatedly by many investigators, since the first report by Druny and Szent-Gyorgyi [1929]. These studies have shown that adenosine and adenine nucleotides have an over-all effect similar to that of acetylcholine [ACh] by slowing and weakening the heartbeat. The basic cellular and membrane events underlying the inhibitory action of adenosine on sinus rate, however, are not well understood. Furthermore, the physiological role of adenosine in regulation of the heartbeat remains still to be elucidated. Therefore, this study was undertaken in order to examine the response of rabbit SA node to adenosine and to compare the response to that of ACh. Isolated SA node preparation, whole atrial pair, or left atrlal strip was used in each experiment. Action potentials of SA node were recorded through the intracellular glass microelectrodes, which were filled with 3M KCI and had resistance of 30-50 M. All experiments were performed in a bicarbonate-buffered Tyrode solution which was aerated with 3% $CO_2-97%$ $O_2$ gas mixture and kept at $35^{\circ}C$. Spontaneous firing rate of SA node at 35C [Mean + SEM, n=16] was 154 + 3.3 beats/min. The parameters of action potentials were: maximum astolic potential [MDP], -731.7mV: overshoot [OS], 9 + 1.4mV; slope of pacemaker potential [SPP], 94 3.0mV/sec.Adenosine suppressed the firing rate of SA node in a dose dependent manner. This inhibitory effect appeared at the concentration of $10^{-6}M$ and was potentiated in parallel with the increase in adenosine concentration. Changes in action potential by adenosine were dose-dependent increase of MDP and decrease of SPP until $10^{-4}$. Above this concentration, however, the amplitude of action potential decreased markedly due to the simultaneous decrease of both MDP and OS. All these effects of adenosine were not affected by pretreatment of atropine [2mg/l] and propranolol [$5{\times}10^{-6}M$]. ACh [$10^{-6}M$] responses on action potential were similar to those of adenosine by increasing MDP and decreasing SPP. These effects of ACh disappeared by pretreatment of atropine [2mg/1]. Inhibition/effects of adenosine and ACh on sinus rate were enhanced synergistically with the simultaneous administration of adenosine and ACh. Marked decrease of overshoot potential was the most prominent feature on action potential. Dipyridamole [DPM], which is known to block the adenosine transport across cell membrane, definitely potentiated the action of adenosine . Adenosine suppressed the sinus rate and atrial contractility in the same dosage range, even in the reserpinized preparation. Above` results suggest that adenosine suppresses pacemaker activity, like ACh, by acting directly on the membrane of SA node, increasing MDP and decreasing SPP.

  • PDF

A Simulation Sample Accumulation Method for Efficient Simulation-based Policy Improvement in Markov Decision Process (마르코프 결정 과정에서 시뮬레이션 기반 정책 개선의 효율성 향상을 위한 시뮬레이션 샘플 누적 방법 연구)

  • Huang, Xi-Lang;Choi, Seon Han
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.7
    • /
    • pp.830-839
    • /
    • 2020
  • As a popular mathematical framework for modeling decision making, Markov decision process (MDP) has been widely used to solve problem in many engineering fields. MDP consists of a set of discrete states, a finite set of actions, and rewards received after reaching a new state by taking action from the previous state. The objective of MDP is to find an optimal policy, that is, to find the best action to be taken in each state to maximize the expected discounted reward of policy (EDR). In practice, MDP is typically unknown, so simulation-based policy improvement (SBPI), which improves a given base policy sequentially by selecting the best action in each state depending on rewards observed via simulation, can be a practical way to find the optimal policy. However, the efficiency of SBPI is still a concern since many simulation samples are required to precisely estimate EDR for each action in each state. In this paper, we propose a method to select the best action accurately in each state using a small number of simulation samples, thereby improving the efficiency of SBPI. The proposed method accumulates the simulation samples observed in the previous states, so it is possible to precisely estimate EDR even with a small number of samples in the current state. The results of comparative experiments on the existing method demonstrate that the proposed method can improve the efficiency of SBPI.

Evaluation of Bone Uptake on Tc-99m-MDP in Immediate and Delayed Dental Implants (즉시형과 지연형 치아 임플란트에서 Tc-99m-MDP의 Bone Uptake 평가)

  • 김중현;김명환;이원국;이재영;강성수;최석화
    • Journal of Veterinary Clinics
    • /
    • v.20 no.2
    • /
    • pp.207-211
    • /
    • 2003
  • This investigation aimed to determine the relative merit of osseointegration in immediate and delayed implantation in the dog mandible using radiography and bone scintigraphy. five adult mongrel dogs with a mean weight of 8.5 kg were used in this investigation. During the entire study period. all dogs were fed with a soft commercial diet and water ad libitum to minimize functional loading of the implant. Twenty titanium alloy systems 4 mm in diameter and 10 mm in length blasted with calcium phosphate were prepared for insertion. The second and third left mandibular premolars in each dog were extracted for the delayed implant insertion. Twelve weeks later, the second and third right mandibular premolars were extracted for the immediate implant insertion. Before the delayed and immediate implantation procedures and 0, 4, 8, and 12 weeks after the insertions, radiography and bone scintigraphy were conducted. Bone scans were obtained using a large field of view gamma camera equipped with a collimator about 3 hours after intravenous injection of Tc-99m-MDP to the dogs. All the dogs were evaluated weekly for inflammation, necrosis, and other of the bone or sort tissue. Significant macroscopic lesions were not detected. Radioisotope scintigraphy with Tc-99m-MDP hat proved to be a reliable method for measuring increased bone activity at specific skeleton tissue sites. In conclusion, osseointegration in peri-implant bone did not differ significantly between the immediate and delayed implant procedures during the experimental period. The immediate implant may be an alternative treatment of implant insertion in animals.

The Minimum-cost Network Selection Scheme to Guarantee the Periodic Transmission Opportunity in the Multi-band Maritime Communication System (멀티밴드 해양통신망에서 전송주기를 보장하는 최소 비용의 망 선택 기법)

  • Cho, Ku-Min;Yun, Chang-Ho;Kang, Chung-G
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.36 no.2A
    • /
    • pp.139-148
    • /
    • 2011
  • This paper presents the minimum-cost network selection scheme which determines the transmission instance in the multi-band maritime communication system, so that the shipment-related real-time information can be transmitted within the maximum allowed period. The transmission instances and the corresponding network selection process are modeled by a Markov Decision Process (MDP), for the channel model in the 2-state Markov chain, which can be solved by stochastic dynamic programming. It derives the minimum-cost network selection rule, which can reduce the network cost significantly as compared with the straight-forward scheme with a periodic transmission.

A Study on Deep Reinforcement Learning Framework for DME Pulse Design

  • Lee, Jungyeon;Kim, Euiho
    • Journal of Positioning, Navigation, and Timing
    • /
    • v.10 no.2
    • /
    • pp.113-120
    • /
    • 2021
  • The Distance Measuring Equipment (DME) is a ground-based aircraft navigation system and is considered as an infrastructure that ensures resilient aircraft navigation capability during the event of a Global Navigation Satellite System (GNSS) outage. The main problem of DME as a GNSS back up is a poor positioning accuracy that often reaches over 100 m. In this paper, a novel approach of applying deep reinforcement learning to a DME pulse design is introduced to improve the DME distance measuring accuracy. This method is designed to develop multipath-resistant DME pulses that comply with current DME specifications. In the research, a Markov Decision Process (MDP) for DME pulse design is set using pulse shape requirements and a timing error. Based on the designed MDP, we created an Environment called PulseEnv, which allows the agent representing a DME pulse shape to explore continuous space using the Soft Actor Critical (SAC) reinforcement learning algorithm.

Impact of multiple firings and resin cement type on shear bond strength between zirconia and resin cements

  • Oguz, Ece Irem;Ozgur, Merve Erdog;Sungur, Sercan;Uctasli, Sadullah
    • The Journal of Advanced Prosthodontics
    • /
    • v.12 no.4
    • /
    • pp.197-203
    • /
    • 2020
  • PURPOSE. The aim of this study was to evaluate the effect of multiple firings on the bond strength between yttriatetragonal zirconia polycrystals (Y-TZP) and 2 types of resin cements. MATERIALS AND METHODS. Sixty 3Y-TZP specimens (LAVA Frame Multi) were divided into 3 groups depending on the following firing procedures: (1) 2-firing cycles, (2) 5-firing cycles, (3) 10-firing cycles. Two samples from each group were investigated by using SEM to determine the morphological changes. All specimens were treated with 125 ㎛ airborne-particle abrasion and the surface roughness of each specimen was measured. The specimens from each firing group were then further divided into 2 subgroups (n = 9) to apply 2 types of resin cement (MDP-free resin cement: RelyX Unicem-RU, and MDP containing resin cement: Panavia F 2.0-PA). The shear bond strength (SBS) test was performed and failure types of all the debonded specimens were classified by using a stereomicroscope as adhesive, cohesive, and mixed. The statistical analysis of surface roughness and SBS data were performed by using 1-way ANOVA and 2-way ANOVA followed by Tukey-HSD tests (α=.05). Failure modes were calculated as a percentage for each group. RESULTS. The bond strength of RU and PA to the specimens obtained with 2 firings were not statistically different from each other (P=.1). However, the SBS values of PA were found to be significantly higher than RU for the specimens obtained with 5 and 10 firing cycles (P=.001 and P=.02, respectively). Surface roughness analysis revealed no statistical difference between groups (P=.2). The SEM analysis of samples fired 5- and 10- times showed irregularities and boundary loss in zirconia grains, and empty spaces between zirconia grains. CONCLUSION. The bond strength of PA cement was higher than that of RU to the zirconia subjected to repeated firings (5 and 10 firing cycles). When zirconia is subjected to multiple firings, using MDP-containing resin cement can be recommended.

A Semi-Markov Decision Process (SMDP) for Active State Control of A Heterogeneous Network

  • Yang, Janghoon
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.7
    • /
    • pp.3171-3191
    • /
    • 2016
  • Due to growing demand on wireless data traffic, a large number of different types of base stations (BSs) have been installed. However, space-time dependent wireless data traffic densities can result in a significant number of idle BSs, which implies the waste of power resources. To deal with this problem, we propose an active state control algorithm based on semi-Markov decision process (SMDP) for a heterogeneous network. A MDP in discrete time domain is formulated from continuous domain with some approximation. Suboptimal on-line learning algorithm with a random policy is proposed to solve the problem. We explicitly include coverage constraint so that active cells can provide the same signal to noise ratio (SNR) coverage with a targeted outage rate. Simulation results verify that the proposed algorithm properly controls the active state depending on traffic densities without increasing the number of handovers excessively while providing average user perceived rate (UPR) in a more power efficient way than a conventional algorithm.