• Title/Summary/Keyword: ML-Agent

Search Result 806, Processing Time 0.023 seconds

Implementation of Intelligent Agent Based on Reinforcement Learning Using Unity ML-Agents (유니티 ML-Agents를 이용한 강화 학습 기반의 지능형 에이전트 구현)

  • Young-Ho Lee
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.24 no.2
    • /
    • pp.205-211
    • /
    • 2024
  • The purpose of this study is to implement an agent that intelligently performs tracking and movement through reinforcement learning using the Unity and ML-Agents. In this study, we conducted an experiment to compare the learning performance between training one agent in a single learning simulation environment and parallel training of several agents simultaneously in a multi-learning simulation environment. From the experimental results, we could be confirmed that the parallel training method is about 4.9 times faster than the single training method in terms of learning speed, and more stable and effective learning occurs in terms of learning stability.

Obstacle Avoidance of Mobile Robot Using Reinforcement Learning in Virtual Environment (가상 환경에서의 강화학습을 활용한 모바일 로봇의 장애물 회피)

  • Lee, Jong-lark
    • Journal of Internet of Things and Convergence
    • /
    • v.7 no.4
    • /
    • pp.29-34
    • /
    • 2021
  • In order to apply reinforcement learning to a robot in a real environment, it is necessary to use simulation in a virtual environment because numerous iterative learning is required. In addition, it is difficult to apply a learning algorithm that requires a lot of computation for a robot with low-spec. hardware. In this study, ML-Agent, a reinforcement learning frame provided by Unity, was used as a virtual simulation environment to apply reinforcement learning to the obstacle collision avoidance problem of mobile robots with low-spec hardware. A DQN supported by ML-Agent is adopted as a reinforcement learning algorithm and the results for a real robot show that the number of collisions occurred less then 2 times per minute.

Design and Implementation of the SyncML Server Agent (SyncML 프로토콜을 이용한 데이터 동기화 서버 Agent 설계 및 구현)

  • Ryoo, Soo-Hee;Choi, Hoon;Ryu, Shi-Won
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2001.10b
    • /
    • pp.1347-1350
    • /
    • 2001
  • 무선 이동 통신의 발달로 인해, 각 이동 단말 장치에 따른 데이터 동기화 방법이 다양해짐에 따라 공통된 동기화 프로토콜 규격의 필요성이 대두되었다. SyncML 은 이기종 시스템 간의 상호 운용성을 보장하는 데이터 동기화 표준으로서 사용자와 벤더들에게 많은 장점을 제공하는 프로토콜로 인식되고 있다. 본 논문에서는 SyncML 프로토콜에 대한 간략한 설명과 함께 SyncML 을 이용하여 개발된 서버의 프레임웍을 제시하고, 데이터 동기화를 처리해 주는 Sync Agent에 대하여 기술하였다.

  • PDF

USN metadata management agent using IoT-based EMRA

  • Lee, Jong-Sub
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.14 no.4
    • /
    • pp.96-103
    • /
    • 2022
  • In this paper, we define EMRA-based USN metadata to describe sensor device, sensor node, and sensor network information at the application level. And the proposed method for effectively storing and retrieving USN metadata based on EMRA uses agent technology. As the sensor metadata proposed in this paper is based on SensorML, interoperability can be maintained in the USN environment, and the metadata management system can be directly utilized for metadata management in USN middleware or applications.

Development of Anti-Wrinkle Agent from Nelumbo nucifera Root Extract (연근 추출물에서 주름개선 소재의 개발)

  • Kim, Hee Jin;Kim, Tagon;Kang, Whan Yul;Baek, Hyun;Cheon, Hae Young;Kim, Bo Young;Kim, Donguk
    • Korean Chemical Engineering Research
    • /
    • v.48 no.4
    • /
    • pp.413-416
    • /
    • 2010
  • In this research, root extracts of Nelumbo nucifera was tested to see the possibility for functional cosmetic agent. 70-100% ethanol was used as solvent and nuciferin was confirmed as active component. To test cosmetic effect of root extracts of Nelumbo nucifera, safety effect(MTT assay), anti-wrinkle effect(elastase inhibition assay) and antioxidation effect(DPPH free radical scavenging assay) were measured. When 100% ethanol was used as extracting solvent, cell viability was over 80% at $100{\mu}g/ml$, which indicated that root extract of Nelumbo nucifera was suitable for cosmetic agent. Root extract of Nelumbo nucifera showed 40~50% elastase inhibition at $100{\mu}g/ml$ so that it had good anti-wrinkle characteristics. 50% antioxidation capacity($FSC_{50}$) was $5.0{\sim}38{\mu}g/ml$ and root extract of Nelumbo nucifera showed excellent antioxidation effect. From the research, root extracts of Nelumbo nucifera showed strong possibility for anti-wrinkle functional cosmetic agent.

Germination Enhancer and Wetting Agent for Quick Establishment of Kentucky bluegrass Cultivars

  • Lee, Sang-Kook
    • Weed & Turfgrass Science
    • /
    • v.6 no.4
    • /
    • pp.313-321
    • /
    • 2017
  • Wetting agent is designed to reduce the surface tension of the liquid and spread more easily across or penetrate into the soil against water repellency. The effect of wetting agent to seed germination is not clear. Using germination enhancer is one of the methods to increase the germination speed of turfgrass seeds and to shorten establishment period. The objective of the study was to evaluate germination enhancer and wetting agent for quick establishment of various Kentucky bluegrass cultivars. The germination enhancer was used at two levels of 0.3 and $0.6ml\;kg^{-1}$ as low and high, respectively. Two levels of wetting agent were of 0.46, and $0.92ml\;m^{-2}$ as low and high, respectively. Germination enhancer has no synergistic effect with wetting agent. When quick establishment is required, selection of cultivar would be more effective instead of using germination enhancer and wetting agent. Among Kentucky bluegrass cultivars, 'Award' had the greatest turfgrass coverage for establishment and the greatest turfgrass color and quality based on the result of the study. When quick establishment is required, selection of cultivar would be more effective instead of using germination enhancer and wetting agent.

Effects of Various Formulations on Bioavailability of Acetaminophen Soft Gelatin Capsules in Rabbits (토끼에서 아세트아미노펜 연집캅셀제의 생체이용율에 미치는 제제처방들의 영향)

  • Park, Gee-Bae;Lee, Yong-Suk;Choi, Myung-Ho;Lee, Do-Ik;Lee, Kwang-Pyo
    • YAKHAK HOEJI
    • /
    • v.36 no.6
    • /
    • pp.598-603
    • /
    • 1992
  • The purpose of this study was to assess the effect of three formulations; product A (polyethylene glycol was used as a main dispersing agent), product B (wax mixture was used as a main dispersing agent) and product C(silicon dioxide was used as a main dispersing agent) on bioavailability of acetaminophen soft gelatin capsules(softgels) and to develop an effective acetaminophen softgel which exhibits an excellent bioavailability. Acetaminophen softgels of various formulations were prepared as 4 minim round type by rotary die method. Four softgels of the three formulation (A, B, C), each of which contained 50 mg acetaminophen, were administered orally to 12 normal healthy rabbits using a three-way cross over design. Plasma acetaminophen concentrations were measured by HPLC. The results obtained in this study were as follows: 1. The Tmax rank order of acetaminophen softgel was C$(63.75{\pm}10.62\;min)$>A$(36.25{\pm}5.37\;min)$>B$(35{\pm}6.74\;min)$. 2. The decreasing Cmax order of softgel product was A$(93.51{\pm}0.55\;{\mu}g/ml)$>B$(3.16{\pm}0.37\;{\mu}g/ml)$>C$(2.6{\pm}0.55\;{\mu}g/ml)$. 3. The $[AUC]^{\infty}_0$ rank order for three acetaminophen softgel formulations was A $(14.89{\pm}1.56\;{\mu}g/ml{\cdot}min)$ >B$(14.39{\pm}1.43\;{\mu}g/ml{\cdot}min)$>C$(11.45{\pm}1.49\;{\mu}g/ml{\cdot}min)$. 4. Pharmacokinetic parameters such as Tmax, Cmax and $[AUC]^{\infty}_0$ of product A and B did not differ significantly(p>0.05). On the other hand, those of product C were significantly different(p>0.05).

  • PDF

Cytotoxic Effects on HL-60 Cells of Myosin Light Chain Kinase Inhibitor ML-7 Alone and in Combination with Flavonoids

  • Lee, Joong-Won;Kim, Yang-Jee;Choi, Young-Joo;Woo, Hae-Dong;Kim, Gye-Eun;Ha, Tae-Kyung;Lee, Young-Hyun;Chung, Hai-Won
    • Toxicological Research
    • /
    • v.25 no.4
    • /
    • pp.181-188
    • /
    • 2009
  • Uncontrolled cell growth and increased cell proliferation are major features of cancer that are dependent on the stable structure and dynamics of the cytoskeleton. Since stable cytoskeleton structure and dynamics are partly regulated by myosin light chain kinase (MLCK), many current studies focused on MLCK inhibition as a chemotherapeutic target. As a potent and selective MLCK inhibitor, ML-7 [1-(5-iodonaphthalene-1-sulfonyl)-1 H-hexahydro-1,4-diazapine hydrochloride] is a promising candidate for an anticancer agent, which would induce apoptosis as well as prevents invasion and metastasis in certain types of cancer cells. This study assessed cytotoxic effects of ML-7 against HL-60 cells and therapeutic efficacy of ML-7 as a potential antileukemia agent. Trypan-blue exclusion assays showed dose- and time- dependent decreases in ML-7 treated HL-60 cells (p<0.05). Comet assays revealed a significant increase in DNA damage in HL-60 cells after treatment with $40{\mu}M$ ML-7 for 2h. Sub-G1 fractions, analyzed by flow cytometry increased in a dose-dependent manner, suggesting that ML-7 can induce apoptotic cell death in HL-60 cells. ML-7 was selectively cytotoxic towards HL-60 cells; not affecting normal human lymphocytes. That selective effect makes it a promising potential anti-leukemia agent. In addition, anticancer efficacy of ML-7 in combination with flavonoids (genistein or quercetin) or anticancer drugs (cisplatin or Ara-C) against HL-60 cells was assessed. Combination of ML-7 with flavonoids increased the anti-cancer effect of ML-7 to a greater extent than combination with the anticancer drugs. This implies that ML-7 in combination with flavonoids could increase the efficacy of anticancer treatment, while avoiding side effects cansed by conventional anticancer drug-containing combination chemotherapy.

Clinical Usefulness of Contrast Echocardiography: The Dose Effect for Left Ventricle Visualization in Dogs (심초음파의 조영제의 임상적 유용성: 개에서 좌심영상화에 대한 조영제 용량의 영향)

  • Shin, Chang-ho;Hwang, Tae-sung;Yoon, Young-min;Jung, Dong-in;Yeon, Seong-chan;Lee, Hee-chun
    • Journal of Veterinary Clinics
    • /
    • v.32 no.6
    • /
    • pp.486-490
    • /
    • 2015
  • Two-demensional echocardiography is routinely used for evaluation of cardiac function. Visualization of the endocardial border is essential for the assessment of global and regional left ventricular with cardiac disease. SonoVue$^{TM}$ is a microbubble contrast agent that consists of sulfur hexafluoride-filled microbubbles in a phospholipid shell. There were many studies about contrast echocardiographic examination using SonoVue$^{TM}$ contrast agent, and various doses of SonoVue$^{TM}$ were used. To our knowledge, in published veterinary medicine, there was not reported for diagnostic efficient dose of SonoVue$^{TM}$ to evaluate contrast enhanced left ventricular endocardial border delineation (LVEBD). The purpose of this study is to compare the visualization time of LVEBD and find efficient dose of SonoVue$^{TM}$ for using various doses in dogs. Ten healthy Beagles were recruited to the study. Three different doses (0.03 ml/kg, 0.05 ml/kg and 0.1 ml/kg) of SonoVue$^{TM}$ were injected. Endocardial segments were assigned based on previously established methodology, where by the four-chamber views of the LV were divided into 6 segments. In this study, Contrast enhancement of the LVEBD after each injection was evaluated visually at the time point of overall contrast enhancement (Segmental scoring 5+) in the LV by three investigators in a blind manner. Statistical analysis was performed with SPSS version 14.0. All data were analyzed using one-way ANOVA, the multiple comparison Scheffe test. When data for the three offsite readers were combined, mean durations of useful contrast were $3.54({\pm}2.14)$, $6.15({\pm}2.61)$, and $24.39({\pm}11.10)$ seconds for the 0.03 ml/kg, 0.05 ml/kg, and 0.1 ml/kg SonoVue$^{TM}$ doses, respectively. After injection of contrast agent, there were no significant change in side effects such as urticaria, angioedema, hypersensitivity reactions, and digestive system disorders. This study suggests that efficient dose of SonoVue$^{TM}$ contrast agent for improvement of the left ventricle visualization is 0.1 ml/kg. The duration of useful enhancement of LVEBD and the reproducibility were also the highest at the 0.1 ml/kg dosage.

A Study about the Usefulness of Reinforcement Learning in Business Simulation Games using PPO Algorithm (경영 시뮬레이션 게임에서 PPO 알고리즘을 적용한 강화학습의 유용성에 관한 연구)

  • Liang, Yi-Hong;Kang, Sin-Jin;Cho, Sung Hyun
    • Journal of Korea Game Society
    • /
    • v.19 no.6
    • /
    • pp.61-70
    • /
    • 2019
  • In this paper, we apply reinforcement learning in the field of management simulation game to check whether game agents achieve autonomously given goal. In this system, we apply PPO (Proximal Policy Optimization) algorithm in the Unity Machine Learning (ML) Agent environment and the game agent is designed to automatically find a way to play. Five game scenario simulation experiments were conducted to verify their usefulness. As a result, it was confirmed that the game agent achieves the goal through learning despite the change of environment variables in the game.