• Title/Summary/Keyword: RL-function

Search Result 36, Processing Time 0.024 seconds

Restless Legs Syndrome in Children and Adolescents with Type 1 Diabetes (제 1형 당뇨병 소아 청소년의 하지불안증후군)

  • Yang, Woo Seok;Yoo, Jae Ho;Cheon, Sang-Myung;Kim, Seong Hwan;Choe, Byeong Moo;Kim, Woo Jin;Bang, Young Rong;Park, Jae Hong
    • Sleep Medicine and Psychophysiology
    • /
    • v.22 no.1
    • /
    • pp.20-24
    • /
    • 2015
  • Objectives: Restless legs syndrome (RLS) is a common sleep disorder in adults with diabetes. This study investigated the frequency of RLS and clinical correlations in children and adolescents with type 1 diabetes. Methods: This study included 55 consecutive patients (21 males, age $12.6{\pm}3.4years$) with type I diabetes that were regularly treated at the Department of Pediatric Endocrinology. RLS was diagnosed by intensive interviews which also included the Epworth Sleepiness Scale (ESS) and International RLS Rating Scale (IRLSRS). Patients also received neurological examinations and laboratory tests for diabetes, iron metabolism and renal function. Results: Thirteen patients (23.6%, 6 males) were compatible for the diagnostic criteria of RLS. None of the RLS patients showed abnormal findings in neurological evaluations and 7 patients had familial history of RLS. Demographic and laboratory findings were not different between the patients with or without RLS. The RLS group showed significantly increased ESS and IRLSRS scores. Conclusion: RLS was prevalent in children and adolescents with type 1 diabetes. The association between RLS and diabetes-related laboratory findings requires further investigation.

Leveraging Reinforcement Learning for Generating Construction Workers' Moving Path: Opportunities and Challenges

  • Kim, Minguk;Kim, Tae Wan
    • International conference on construction engineering and project management
    • /
    • 2022.06a
    • /
    • pp.1085-1092
    • /
    • 2022
  • Travel distance is a parameter mainly used in the objective function of Construction Site Layout Planning (CSLP) automation models. To obtain travel distance, common approaches, such as linear distance, shortest-distance algorithm, visibility graph, and access road path, concentrate only on identifying the shortest path. However, humans do not necessarily follow one shortest path but can choose a safer and more comfortable path according to their situation within a reasonable range. Thus, paths generated by these approaches may be different from the actual paths of the workers, which may cause a decrease in the reliability of the optimized construction site layout. To solve this problem, this paper adopts reinforcement learning (RL) inspired by various concepts of cognitive science and behavioral psychology to generate a realistic path that mimics the decision-making and behavioral processes of wayfinding of workers on the construction site. To do so, in this paper, the collection of human wayfinding tendencies and the characteristics of the walking environment of construction sites are investigated and the importance of taking these into account in simulating the actual path of workers is emphasized. Furthermore, a simulation developed by mapping the identified tendencies to the reward design shows that the RL agent behaves like a real construction worker. Based on the research findings, some opportunities and challenges were proposed. This study contributes to simulating the potential path of workers based on deep RL, which can be utilized to calculate the travel distance of CSLP automation models, contributing to providing more reliable solutions.

  • PDF

Simultaneous neural machine translation with a reinforced attention mechanism

  • Lee, YoHan;Shin, JongHun;Kim, YoungKil
    • ETRI Journal
    • /
    • v.43 no.5
    • /
    • pp.775-786
    • /
    • 2021
  • To translate in real time, a simultaneous translation system should determine when to stop reading source tokens and generate target tokens corresponding to a partial source sentence read up to that point. However, conventional attention-based neural machine translation (NMT) models cannot produce translations with adequate latency in online scenarios because they wait until a source sentence is completed to compute alignment between the source and target tokens. To address this issue, we propose a reinforced learning (RL)-based attention mechanism, the reinforced attention mechanism, which allows a neural translation model to jointly train the stopping criterion and a partial translation model. The proposed attention mechanism comprises two modules, one to ensure translation quality and the other to address latency. Different from previous RL-based simultaneous translation systems, which learn the stopping criterion from a fixed NMT model, the modules can be trained jointly with a novel reward function. In our experiments, the proposed model has better translation quality and comparable latency compared to previous models.

CODES BASED ON RESIDUATED LATTICES

  • Atamewoue, Tsafack Surdive;Jun, Young Bae;Lele, Celestin;Ndjeya, Selestin;Song, Seok-Zun
    • Communications of the Korean Mathematical Society
    • /
    • v.31 no.1
    • /
    • pp.27-40
    • /
    • 2016
  • We define the notion of a residuated lattice valued function on a set as Jun and Song have done in BCK-algebras. We also investigate related properties of residuated lattice valued function. We establish the codes generated by residuated lattice valued function and conversely we give residuated lattice valued function and residuated lattice obtained by the giving binary block-code.

Electromagnetic wave absorption characteristics in Ni-Mn-Zn Ferrite with varying Mn content and applied magnetic field (Ni-Mn-Zn ferrite의 합성과 Mn의 치환량 및 인가자장에 따른 전자기파 흡수 특성 연구)

  • Ji-Hye Lee;Sang-Min Lee;Young-Min Kang
    • Journal of the Korean Crystal Growth and Crystal Technology
    • /
    • v.33 no.6
    • /
    • pp.294-302
    • /
    • 2023
  • Ni-Mn-Zn ferrite, Ni0.5-xMnxZn0.5Fe2O4 (0 ≤ x ≤ 0.5), was synthesized using the sol-gel method to investigate the crystal structure, microstructure, magnetic properties, high-frequency characteristics, and electromagnetic (EM) wave absorption characteristics as a function of Mn substitution. As the Mn content increased, a continuous decrease in saturation magnetization (MS) was observed with little change in coercivity (HC). Samples for each composition (x) exhibited strong EM wave absorption performance with first and second strong EM wave absorption regions satisfying minimum reflection loss, RLmin < -40 dB in the 1.5~2.5, 6~11 GHz range, respectively. The EM wave absorption in Ni-Mn-Zn ferrite depends on magnetic loss, and adjusting µ' and µ'' spectra by Mn substitution or H field allows control of the EM wave absorption frequency.

Coupling Matrix Synthesis Methods for RF/Microwave Filter Design (초고주파용 필터설계를 위한 결합행렬 합성법)

  • Choi, Dong-Muk;Kim, Che-Young
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.32 no.12A
    • /
    • pp.1346-1353
    • /
    • 2007
  • In this paper, the methods are presented for the calculation of general coupling coefficient matrixes used in the band pass filter design. They are calculated from transmission coefficient($S_{21}$) and reflection coefficient($S_{11}$) with desired characteristics derived from the poles of filter function and return loss(RL). The calculated matrixes from this method are transformed to the folded canonical filter structure using similarity transformation which lends us the practical filter design. Based on the resulting matrix, the folded canonical filter has been designed.

Effect of Leptin on the Expression of Chemokine Genes in THP-1 Cells (THP-1 세포주에서 Leptin에 의한 케모카인 유전자 발현)

  • Choi, Jin-Hee;Park, Ho-Sun;Lee, Tae-Yoon;Kim, Sung-Kwang;Kim, Hee-Sun
    • Journal of Yeungnam Medical Science
    • /
    • v.20 no.2
    • /
    • pp.129-141
    • /
    • 2003
  • Background: Leptin is a 16-KDa non-glycosylated peptide hormone synthesized almost exclusively by adipocytes. The well-known function of leptin is regulation of food intake and energy expenditure. Leptin also plays a regulatory role in immune and inflammatory process including cytokine production. The purpose of this study was to investigate the effect of leptin on the expression of several chemokine genes(RANTES, IL-8, MCP-1, IP-10, Mig, MIP-$1{\alpha}$, MIP-$1{\beta}$, and GRO-${\alpha}$) in THP-1 cells. Materials and Methods: Total RNA of THP-1 cells were prepared by Trizol method, and then stimulated with the leptin(250 ng/$m{\ell}$) or LPS(100 ng/$m{\ell}$). We examined the expression patterns of various chemokine mRNAs in THP-1 cell lines by RT-PCR and Northern blot. Results: Leptin did not induce the expression of chemokine mRNAs in THP-1 cells. The expression patterns of RANTES, IL-8, MCP-1, IP-10, and Mig mRNAs in THP-1 cells stimulated with leptin and LPS simultaneously was almost same to the patterns of LPS alone-induced chemokine mRNAs. RANTES mRNA expression was independent on the concentrations of leptin. Although leptin did not have strong effect on the expression of RANTES, IL-8, MCP-1, IP-10, Mig, MIP-$1{\alpha}$, MIP-$1{\beta}$, and GRO-${\alpha}$ mRNAs in THP-1 cells, leptin could induce the expression of long isoform of leptin receptor(OB-RL) mRNA, and its expression was elevated in simultaneous stimulation of leptin and LPS. Conclusion: These data suggest that leptin is able to induce OB-RL in THP-1 cells, however, leptin has little effect on the expression of pro-inflammatory chemokine genes.

  • PDF

Evaluating SR-Based Reinforcement Learning Algorithm Under the Highly Uncertain Decision Task (불확실성이 높은 의사결정 환경에서 SR 기반 강화학습 알고리즘의 성능 분석)

  • Kim, So Hyeon;Lee, Jee Hang
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.11 no.8
    • /
    • pp.331-338
    • /
    • 2022
  • Successor representation (SR) is a model of human reinforcement learning (RL) mimicking the underlying mechanism of hippocampal cells constructing cognitive maps. SR utilizes these learned features to adaptively respond to the frequent reward changes. In this paper, we evaluated the performance of SR under the context where changes in latent variables of environments trigger the reward structure changes. For a benchmark test, we adopted SR-Dyna, an integration of SR into goal-driven Dyna RL algorithm in the 2-stage Markov Decision Task (MDT) in which we can intentionally manipulate the latent variables - state transition uncertainty and goal-condition. To precisely investigate the characteristics of SR, we conducted the experiments while controlling each latent variable that affects the changes in reward structure. Evaluation results showed that SR-Dyna could learn to respond to the reward changes in relation to the changes in latent variables, but could not learn rapidly in that situation. This brings about the necessity to build more robust RL models that can rapidly learn to respond to the frequent changes in the environment in which latent variables and reward structure change at the same time.

Evaluation of Salt Tolerance in Sorghum (Sorghum bicolor L.) Mutant Population

  • Ye-Jin Lee;Baul Yang;Woon Ji Kim;Juyoung Kim;Soon-Jae Kwon;Jae Hoon Kim;Joon-Woo Ahn;Sang Hoon Kim;Haeng-Hoon Kim;Chang-Hyu Bae;Jaihyunk Ryu
    • Proceedings of the Plant Resources Society of Korea Conference
    • /
    • 2023.04a
    • /
    • pp.38-38
    • /
    • 2023
  • Sorghum (Sorghum bicolor L.) is a promising biomass crop with a high lignocellulose content. This study aimed to select high salt-tolerance sorghum lines for cultivation on reclaimed land. Using 7-day seedlings of the sorghum population consisted of 71 radiation-derived mutants (M2 to M6) and 33 genetic resources, survival rate (SR), plant height (PH), root length (RL), fresh weight (FW), and chlorophyll content (CC) were measured for two weeks after 102 mM (0.6%) NaCl treatment. Furthermore, the characteristics of the sorghum population were confirmed using correlation analysis, PCA (principal component analysis), and the FCE (fuzzy comprehensive evaluation) method. Under 102 mM NaCl conditions, SR ranged from 4.9 (IS645-200-6) to 82.4% (KLSo79125-200-1), with an average of 49.9%. PH varied from 7.5 (Mesusu-100-2) to 33.2 cm (DINE-A-MITE-100-2-10), with an average of 20.4 cm. RL ranged from 1.0 (IS645-200-1) to 17.0 cm (30-100-2), with an average of 7.7 cm. FW varied from 0.1 (IS645-200-6) to 4.5 g/plant (DINE-A-MITE-100-2-10), with an average of 2.1 g/plant. CC ranged from 0.9 (DINE-A-MITE-100-2-2) to 3.1 mg/g (IS12937), with an average of 1.7 mg/g. An overall positive correlation, with SR and FW (r = 0.86, P < 0.01), and FW and CC (r = 0.79, P < 0.01), was shown by correlation analysis. Among the five traits, two principal components were extracted by PCA analysis. PC1 was significantly associated with FW, while PC2 was highly involved with RL. To evaluate the salt tolerance level of the sorghum population when an FCE based on trait data was performed, MFV (membership function value) was 0.68. As a result of compiling the MFV of each line, eight lines with MFV > 0.68 were selected. Ultimately, the radiation-derived mutant lines, DINE-A-MITE-100-2-10 and DINE-A-MITE-100-2-12 were selected as salt-tolerant sorghum lines. The results are expected to inform salt-tolerant sorghum breeding programs, and the high salt-tolerance sorghum lines might be advantageous for cultivation on reclaimed land.

  • PDF

A Preliminary Study on Piezo-aeroelastic Energy Harvesting Using a Nonlinear Trailing-Edge Flap

  • Bae, Jae-Sung;Inman, Daniel J.
    • International Journal of Aeronautical and Space Sciences
    • /
    • v.16 no.3
    • /
    • pp.407-417
    • /
    • 2015
  • Recently, piezo-aeroelastic energy harvesting has received greater attention. In the present study, a piezo-aeroelastic energy harvester using a nonlinear trailing-edge flap is proposed, and its nonlinear aeroelastic behaviors are investigated. The energy harvester is modeled using a piezo-aeroelastic model of a two-dimensional typical section airfoil with a trailing-edge flap (TEF). A piezo-aeroelastic analysis is carried out using RL and time-integration methods, and the results are verified with the experimental data. The linearizing method using a describing function is used for the frequency domain analysis of the nonlinear piezo-aeroelastic system. From the linear and nonlinear piezo-aeroelastic analysis, the limit cycle oscillation (LCO) characteristics of the proposed energy harvester with the nonlinear TEF are investigated in both the frequency and time domains. Finally, the authors discuss the air speed range for effective piezo-aeroelastic energy harvesting.