• Title/Summary/Keyword: Unity ML

Search Result 19, Processing Time 0.019 seconds

Quantitative Analysis of Quality Control of Natural Medicine by $^1H-NMR$ Spectrometry-Quantitative Analysis of Hesperidin from Citrus unshiu ($^1H-NMR$을 이용한 한약재의 품질 평가 방법 확립;진피의 Hesperidin 정량분석)

  • Ahn, Eun-Mi;Baek, Mi-Young
    • The Korea Journal of Herbology
    • /
    • v.23 no.3
    • /
    • pp.27-32
    • /
    • 2008
  • Objectives : In this paper, we describe that $^1H-NMR$ spectroscopy may be superior to the conventional HPLC for the quantitative analysis of hesperidin from Citrus unshiu. Methods : $^1H-NMR$ spectra (400 MHz) were recorded in $DMSO-d_6$ using a Varian UNITY Inova AS 400 FT NMR spectrometer. One hundred milligram of powdered Citrus unshiu was weighed out and mixed with 1 ml of $DMSO-d_6$ with sonication for 30 min (room temperature). The extracts were filtrated through a 0.45 ${\mu}m$ PVDF filter and 0.5 ml of filtrated extract used for quantitative $^1H-NMR$ measurement (added 1 mg of dimethyl terephthalate as internal standard). The quantity of hesperidin was calculated by the ratio of the intensity of the compound to the known amount of internal standard. For HPLC analysis, the half gram of plant material was extracted with 60 ml of MeOH for 2 hours. The extracts were made 100 ml volume and analyzed by a Waters HPLC system using a YMC ODS column. The total flow rate was 1.0 ml/min with a sample volume 10 ${\mu}l$ and UV detection at 280nm. Results : The contents of hesperidin in Citrus unshiu was determined $5.33{\pm}0.06$% in the quantitative $^1H-NMR$ method and $5.15{\pm}0.12%$ in HPLC method. Using the quantitative $^1H-NMR$ the contents of hesperidin can be determined in much shorter time than the conventional HPLC measurements. Conclusions : From those results, the advantages of quantitative $^1H-NMR$ analysis are that can be analyzed to identify and quantify, and no reference compounds required for calibration curve. Besides, it allows rapid and simple quantification for hesperidin with an analysis time for only 10 min without any pre-purification steps.

  • PDF

Build reinforcement learning AI process for cooperative play with users (사용자와의 협력 플레이를 위한 강화학습 인공지능 프로세스 구축)

  • Jung, Won-Joe
    • Journal of Korea Game Society
    • /
    • v.20 no.1
    • /
    • pp.57-66
    • /
    • 2020
  • The goal is to implement AI using reinforcement learning, which replaces the less favored Supporter in MOBA games. ML_Agent implements game rules, environment, observation information, rewards, and punishment. The experiment was divided into P and C group. Experiments were conducted to compare the cumulative compensation values and the number of deaths to draw conclusions. In group C, the mean cumulative compensation value was 3.3 higher than that in group P, and the total mean number of deaths was 3.15 lower. performed cooperative play to minimize death and maximize rewards was confirmed.

Production of Cyclodextrin Homologues Using Aqueous Two-Phase System

  • Chang, Woo-Jin;Koo, Yoon-Mo;Park, Sung-Sik
    • Biotechnology and Bioprocess Engineering:BBE
    • /
    • v.2 no.2
    • /
    • pp.97-100
    • /
    • 1997
  • Cyclodxtrin homologues(CDs), produced by cyclodextrin glycosyltransferase(CGTase), were simultaneously partitioned in aqueous two-phase system(ATPS). Partition coefficients of CDs were measured in PEG/dextran systems. Phosphate, citrate, sulfate were tested as salt. ATPS of PEG/salt and PEG/dextran had the partition coefficients of the CDs, larger than unity. However, PEG/dextran system was observed better than PEG/salt as CGTase activity decreased sharply with salt concentration. Enzymatic rection occurred mainly in PEG-rich bottom phase because of the low partition coefficient of CGTase. The resulting CDs transferred to the PEG-rich top phase, obeying the diffusional partition. In the ATPS of 7% PEG(M.W.40, 000), 7mg/ml of CDs were obtained in top phase at 4.5 hours.

  • PDF

Implementation Fighting Game AI using Reinforcement Learning (강화학습을 이용한 대전 격투 게임 AI 구현)

  • Shin, Hee-Sang;Park, Seung-Bo
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2022.01a
    • /
    • pp.333-334
    • /
    • 2022
  • 본 논문에서는 대전 격투 게임에서의 AI 개발을 위한 강화학습 사용 방법을 제안한다. 이 방법은 학습 모델에 상대방의 다양한 패턴을 학습시켜 적은 코드로 효율적인 AI 개발을 할 수 있어 개발 시간을 최소화 할 수 있다. 또한, 이 방법은 복잡한 코드를 추가 또는 제거할 필요 없이 보상과 액션을 조정하여 다양한 종류의 AI를 원하는 만큼 생성할 수 있다는 장점이 있다. 본 논문에서는 Unity 사에서 제공하는 머신러닝 툴인 ML-Agents를 활용하여 강화학습을 통한 대전 격투 게임 AI의 가능성을 보인다.

  • PDF

Proximal Policy Optimization Reinforcement Learning based Optimal Path Planning Study of Surion Agent against Enemy Air Defense Threats (근접 정책 최적화 기반의 적 대공 방어 위협하 수리온 에이전트의 최적 기동경로 도출 연구)

  • Jae-Hwan Kim;Jong-Hwan Kim
    • Journal of the Korea Society for Simulation
    • /
    • v.33 no.2
    • /
    • pp.37-44
    • /
    • 2024
  • The Korean Helicopter Development Program has successfully introduced the Surion helicopter, a versatile multi-domain operational aircraft that replaces the aging UH-1 and 500MD helicopters. Specifically designed for maneuverability, the Surion plays a crucial role in low-altitude tactical maneuvers for personnel transportation and specific missions, emphasizing the helicopter's survivability. Despite the significance of its low-altitude tactical maneuver capability, there is a notable gap in research focusing on multi-mission tactical maneuvers that consider the risk factors associated with deploying the Surion in the presence of enemy air defenses. This study addresses this gap by exploring a method to enhance the Surion's low-altitude maneuvering paths, incorporating information about enemy air defenses. Leveraging the Proximal Policy Optimization (PPO) algorithm, a reinforcement learning-based approach, the research aims to optimize the helicopter's path planning. Visualized experiments were conducted using a Surion model implemented in the Unity environment and ML-Agents library. The proposed method resulted in a rapid and stable policy convergence for generating optimal maneuvering paths for the Surion. The experiments, based on two key criteria, "operation time" and "minimum damage," revealed distinct optimal paths. This divergence suggests the potential for effective tactical maneuvers in low-altitude situations, considering the risk factors associated with enemy air defenses. Importantly, the Surion's capability for remote control in all directions enhances its adaptability in complex operational environments.

Optimal deployment of sonobuoy for unmanned aerial vehicles using reinforcement learning considering the target movement (표적의 이동을 고려한 강화학습 기반 무인항공기의 소노부이 최적 배치)

  • Geunyoung Bae;Juhwan Kang;Jungpyo Hong
    • The Journal of the Acoustical Society of Korea
    • /
    • v.43 no.2
    • /
    • pp.214-224
    • /
    • 2024
  • Sonobuoys are disposable devices that utilize sound waves for information gathering, detecting engine noises, and capturing various acoustic characteristics. They play a crucial role in accurately detecting underwater targets, making them effective detection systems in anti-submarine warfare. Existing sonobuoy deployment methods in multistatic systems often rely on fixed patterns or heuristic-based rules, lacking efficiency in terms of the number of sonobuoys deployed and operational time due to the unpredictable mobility of the underwater targets. Thus, this paper proposes an optimal sonobuoy placement strategy for Unmanned Aerial Vehicles (UAVs) to overcome the limitations of conventional sonobuoy deployment methods. The proposed approach utilizes reinforcement learning in a simulation-based experimental environment that considers the movements of the underwater targets. The Unity ML-Agents framework is employed, and the Proximal Policy Optimization (PPO) algorithm is utilized for UAV learning in a virtual operational environment with real-time interactions. The reward function is designed to consider the number of sonobuoys deployed and the cost associated with sound sources and receivers, enabling effective learning. The proposed reinforcement learning-based deployment strategy compared to the conventional sonobuoy deployment methods in the same experimental environment demonstrates superior performance in terms of detection success rate, deployed sonobuoy count, and operational time.

Pharmacokinetics of Recombinant Human Epidermal Growth Factor (DWP401) in Rats (재조합 인간 상피세포성장인자(DWP401)의 흰쥐에서의 약물동태)

  • Chung, Joo-Young;Koh, Yeo-Wook;Nam, Kwon-Ho;Cho, Jae-Youl;Park, Seung-Kook;Yu, Young-Ho;Kim, Jae-Hwan;Han, Kun;Park, Myung-Hwan;Shim, Chang-Koo
    • YAKHAK HOEJI
    • /
    • v.41 no.3
    • /
    • pp.328-334
    • /
    • 1997
  • Pharmacokinetics of DWP401, a recombinant human epidermal growth factor (rhEGF), was studied using radioimmunoassay (RIA) and $^{125}I$-DWP401 in rats. When DWP401 was adm inistered i.v. at doses of 50 and 500 mcg/kg, the plasma DWP401 disappeared biiexponentially with terminal half life of 4.7 and 92.8 min. The $C_{max}$ and $T_{max}$ after s.c. administration of ti at doses of 50 and 500 ${\mu}g$/kg were determined to be 23.6 and 17.5 ng/ml at 50 ${\mu}g$/kg, and 261.4 ng/ml and 36.8 min, respectively. Both the total urinary and biliary recoveries of intact DWP401 2343 very low (<0.4%), probably due to its extensive degradation in the body. the concentration ratio of DWP401 between the organ and plasma decreased especially in the liver and kidney as the dose and time after the dose increased. For example, the liver/plasma and kidney/plasma concentration ratio of DWP401 at 2.5 min after i.v. doses of 50 ${\mu}g$/kg were comparable and much larger than unity. But, the ratio at 2.5 min after i.v. doses of 500${\mu}g$/kg was much larger in the kidney that in than in the liver. These results suggest that the systemic administration of DWP401 might be subject to rapid and extensive clearance from circulation within several hour after main distrbution to liver and kidney.

  • PDF

Appearance Rates of Several Substances into Cerebrospinal Fluid of Histamine-treated Rabbits (히스타민 투여시 토끼 뇌척수액으로의 물질 출현율)

  • Kim, Won-Shik;Shin, Dong-Hoon
    • The Korean Journal of Physiology
    • /
    • v.2 no.2
    • /
    • pp.21-31
    • /
    • 1968
  • The appearance rates of antipyrine and urea into cerebrospinal fluid from blood were studied in the rabbits which were in the state of hypotension and of high permeability in the capillary beds following injection of histamine. The alteration in the distribution of electrolytes among various compartments of the brain and the permeability characteristics in the blood-cerebrospinal fluid barrier were also observed. Adult male rabbits, weighing around 2 kg, were used. Twenty four rabbits were divided into 3 groups. Besides the control group, histamine treated rabbits were categorized into 2 groups. $H_1$ consisted of the rabbits showing moderate responses to histamine and ranging from 62 to 80 mmHg in their mean anterial blood pressure. The animals which belong to $H_2-group$ showed severe responses to histamine and the mean anterial blood pressures dropped to 30-50 mmHg. Animals were anesthetized with nembutal, 30mg/kg i.v. The mean arterial blood pressure was read by means of the mercury manometer connected to the femoral artery. The animals, treated with histamine, were kept in hypotensive state at least for 40 minutes before the administration of the test-substances. The test-substances, 300 mg of urea and 200 mg of antipyrine, were dissolved in 3 ml of distilled water and were injected into the ear vein of the rabbit. After 10 minutes elapsed arterial blood sample was taken from the femoral artery and cerebrospinal fluid from the cisterna magna. Brain tissues were also analysed with respect to electrolytes in order to observe the disturbances in the electrolytes balance as well as in the function of the central nervous system. The results obtained were as follow: 1. The ratio of antipyrine concentration in cerebrospinal fluid to that of arterial blood plasma, that was the distribution ratio, was close to unity, revealing a well established equilibrium between the compartments of blood and cerebrospinal fluid in 10 minutes. In other words, there was no diffusion barrier with regard to antipyrine. The ratios over unity which were frequently seen in the histamine treated animals were attributable to the early penetration of the substance into the cerebrospinal fluid. 2. The appearance rates of urea into the cerebrospinal fluid in the histamine treated rabbits were higher in comparison with those of in the control animals. The increasing tendency in the rates was particularly remarkable in the $H_2-group$, showing the enhanced penetration of urea across the boondary. 3. In the htisamine treated $H_2-group$ the concentration of potassium in the blood plasma and cerebrospinal fluid well exceeded the control values and showed 8.5 and 9.0 mEq/l in average, respectively. Simultaneous drops in the brain tissue water were noticed, suggesting the leakage of intracellular potassium. 4. There was a coincidence in the rising pattern of potassium in the blood plasma and in the cerebrospinal fluid of $H_2-group$ and at least partial removal of the blood-cerebrospinal fluid barrier with respect to potassium was suggested in these animals. 5. The concentration of sodium in the blood plasma or in the cerebrospinal fluid showed no significant changes following histamine injection. However, sodium in the brain tissue revealed slight elevation in the histamine treated groups. 6. The ratios of the concentrations of potassium to those of sodium, [K]/[Na] in the brain tissues, were 1.92 in the control 1.82 in the $H_1$ and 1.52 in the $H_2-group$, respectively. The marked drop in the $H_2-group$ might represent neural dysfunction in the extremely hypotensive rabbits.

  • PDF

Influences of Histamine on Permeability across Blood-brain Barrier (혈액-뇌장벽 투과성에 대한 히스타민의 영향)

  • Kim, Kee-Jin;Shin, Dong-Hoon
    • The Korean Journal of Physiology
    • /
    • v.2 no.2
    • /
    • pp.33-43
    • /
    • 1968
  • Histamine, 0.5 mg as histamine base in 4 ml of normal saline solution, was injected into rabbits anesthetized with nembutal and the mean blood pressure was kept in the range of $52{\sim}80\;mmHg$ for over one hour by supplemental additions. Following the injection of the test substances, 300 mg of urea and 200 mg of antipyrine intravenously, serial blood samples were obtained from the femoral artery and the internal jugular vein at $0.5{\sim}3$ minutes interval. The decreasing patterns in the concentrations of arterial and venous blood plasma samples were compared with each other. The ratio of the concentration of brain tissue to that of the final arterial plasma was also studied. By these measures the degrees of penetration of the test substances in the brain in the control and in the histamine treated rabbits were observed. The concentrations of antipyrine and urea in the arterial blood plasma were decreasing exponentially with respect to the time elapsed. The venous concentrations were anticipated to increase initially and to cross the arterial concentration curve in the point of equlibrium between the plasma and the tissue. On the contrary to the expectation venous concentration also revealed the decreasing tendency similar to that of arterial plasma. The similarity between these two curves, arterial and venous, would be atributable to the fact that the cerebral blood flow rate was large enough and the rising phase in the venous concentration curve was instantly over before serial blood samples were taken. Inspite of some similarity in the decreasing tedency in both concentration curves there were appreciable discrepancies between the arterial and venous plasma which would reflect the situation far from the equlibria among several compartments in the brain. Changes in plasma potassium levels caused by the injection of histamine or bleeding were observed, too. Using 8 rabbits as the control and 12 rabbits for the histamine treated group following results were obtained: 1. Both of the concentration curves, arterial and venous, declined rapidly at_first and slowly later on and approached same equilibrium concentration with the passage of time after a single injection. The time at which attained the same concentration was $2.0{\pm}0.54\;min.$ in the control and $4.3{\pm}1.92\;min.$ in the histamine treated group with respect to antipyrine. On the other hand in the case of urea they were $2.4{\pm}0.59\;min.$ in the control and $4.4{\pm}1.31\;min.$ in the histamine group, respectively. In the histamine treated group enlarged spaces for distribution of test substances were postulated. 2. The concentration of antipyrine in the brain tissue water revealed no significant differences between the control and experimental groups, showing $212{\pm}40.2\;mg/l$ in the control and $206{\pm}64.1\;mg/l$ in the histamine treated group. On the other hand urea revealed higher value in the histamine treated group than in the control, showing an enhanced penetration of urea into the tissue after injection of histamine. Urea concentration in the brain water was $32.3{\pm}3.36\;mg%$ in the control and $39.2{\pm}4.25\;mg%$ in the histamine treated group. 3. The distribution ratio of antipyrine in the brain tissue was very close to unity in the histamine treated animals as well as in the control. 4. The average of the distribution ratio of urea in the control animals was 0.77 and it showed the presence of blood-brain barrier with regard to urea. However in the histamine treated animals the distribution ratios climbed up to 0.86 and they were closer to unity than in the control animals. Out of 12 cases 5 were greater than 0.9 and 8 exceeded 0.85. It appeared that histamine enhanced the penetration of urea through the barrier. 5. Histamine injection and or hemorrhage caused an elevation of the concentration of potassium in plasma. In the event that histamine and hemorrhage were applied together the elevation of potassium exceed the elevation seen at the histamine alone. There was no evidence that the leakage of potassium from the brain tissue was dominant in comparison with the general leakage from the whole body.

  • PDF