• Journal of the Korea Society of Computer and Information
• /
• v.29 no.1
• /
• pp.11-19
• /
• 2024

Multi-agent systems can be utilized in various real-world cooperative environments such as battlefield engagements and unmanned transport vehicles. In the context of battlefield engagements, where dense reward design faces challenges due to limited domain knowledge, it is crucial to consider situations that are learned through explicit sparse rewards. This paper explores the collaborative potential among allied agents in a battlefield scenario. Utilizing the Multi-Robot Warehouse Environment(RWARE) as a sparse reward environment, we define analogous problems and establish evaluation criteria. Constructing a learning environment with the QMIX algorithm from the reinforcement learning library Ray RLlib, we enhance the Agent Network of QMIX and integrate Random Network Distillation(RND). This enables the extraction of patterns and temporal features from partial observations of agents, confirming the potential for improving the acquisition of sparse reward experiences through intrinsic rewards.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.17 no.1
• /
• pp.114-122
• /
• 2018

In this paper, we propose new water pressure measurement system to measure the water pressure of water pipe laid underground beneath the manhole efficiently. For this purpose, we installed water pressure sensor(IoT) which has built-in bluetooth module at valve of water pipe. The proposed system can be managed through collected data which measured at sensor and then transmitted to smart phone through bluetooth connectivity and re-transmitted to server on this system. By checking out water pressure data stored in server from remote location, the persons in charge can confirm the leakage of water pipe or propriety of water pressure in management area. By this procedure, they can detect the existence of condition of water pipe and manage water pressure of water pipe efficiently.

• International Journal of Precision Engineering and Manufacturing
• /
• v.8 no.2
• /
• pp.44-48
• /
• 2007

In recent years, the size of plane substrates and semiconductor wafers has increased. As conventional contact transportation systems composed of, for example, carrier rollers, belt conveyers, and robot hands carry these longer and wider substrates, the increased weight results in increased potential for fracture. A noncontact transportation system is required to solve this problem. We propose a new noncontact transportation system combining acoustic viscous and aerostatic forces to provide damage-free transport. In this system, substrates are supported by aerostatic force and transported by acoustic viscous streaming induced by traveling wave deformation of a disk-type stator. A ring-type piezoelectric transducer bonded on the stator excites vibration. A stator with a high Q piezoelectric transducer can generate traveling vibrations with amplitude of $3.2{\mu}m$. Prior to constructing a carrying road for substrates, we clarified the basic properties of this technique and stator vibration characteristics experimentally. We constructed the experimental equipment using a rotational disk with a 95-mm diameter. Electric power was 70 W at an input voltage of 200 Vpp. A rotational torque of $8.5\times10^{-5}Nm$ was obtained when clearance between the stator and disk was $120{\mu}m$. Finally, we constructed a noncontact transport apparatus for polycrystalline silicon wafers $(150(W)\times150(L)\times0.3(t))$, producing a carrying speed of 59.2 mm/s at a clearance of 0.3 mm between the stator and wafer. The carrying force when four stators acted on the wafer was $2\times10^{-3}N$. Thus, the new noncontact transportation system was demonstrated to be effective.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.5
• /
• pp.2267-2271
• /
• 2011

This study was focused on getting p-type copper-oxide thin-film semiconductors suitable for p-channel thin-film transistors. Vacuum thermal evaporation and thermal annealing were used to get copper-oxide thin-film semiconductor having properties adoptable as an active layer of thin-film transistors. n-type thin films having electron carrier density of about $10^{22}\;cm^{-3}$ before thermal annealing was converted to p-type thin films having hole carrier density of about $10^{16}\;cm^{-3}$ as the thermal annealing conditions were optimized.

• Journal of Korean Institute of Industrial Engineers
• /
• v.21 no.1
• /
• pp.119-135
• /
• 1995

We consider problems of tool loading and scheduling in a flexible manufacturing system (FMS) in which tool transportation constitutes the major portion of material flows. In this type of FMSs, parts are initially assigned to machines and released to the machines according to input sequencing rules. Operations for the parts released to the machines are performed by tools initially loaded onto the machines or provided by an automatic tool transport robot when needed. For an efficient operation of such systems, therefore, we may have to consider loading and scheduling problems for tools in addition to those for parts. In this paper, we consider three problems, part loading, tool loading, and tool scheduling problems with the overall objective of minimizing the makespan. The part loading problem is solved by a method similar to that for the bin packing problem and then a heuristic based on the frequency of tool usage is applied for tool loading. Also suggested are part input sequencing and tool scheduling rules. To show the effectiveness of the overall algorithm suggested here, we compare it with an existing algorithm through a series of computational tests on randomly generated test problems.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.1
• /
• pp.445-450
• /
• 2011

In this paper, we describe the implementation of an wireless sensor network testbed. We developed a web-based sensor network gateway and enhanced the Surge program which is used for sending and routing of packets in the sensor field. The developed program can transmit the source data of sensor nodes to the sink node via multi-hop routing, and deliver user commands to actuate sensor related equipments. Moreover, in this testbed, the data transport path from a node to the sink can be monitored. Thus we can approximate the network topology and the relative positions of sensor nodes. We also describe an application of the testbed that is used for controlling a remote robot.

• Journal of Biosystems Engineering
• /
• v.27 no.5
• /
• pp.409-416
• /
• 2002

This study was conducted to develop a vehicle, leading or following a worker at a certain distance to assist laborious transporting works in greenhouses. A prototype vehicle, which consisted of the rear driving, the front steering and the console units, was designed and tested in the ideal indoor conditions. Results of this study were summarized as following: 1. The driving unit was designed to travel at the speed ranges of 0.3∼0.8 m/sec depending on the operating modes with a maximum payload of 100 kg. 2. The console unit consisted of a main-board including a 80C196KC microprocessor and peripheral devices, a power-board and safety interlock. Worker-leading, and following modes were available in automatic and manual modes. 3. Steering was achieved by turning the steering motor against the sensed direction. Proper steering angles for correcting travel direction were determined as 5 and 9 degrees when sensing cultivation beds and plants, respectively.

• Korean Journal of Construction Engineering and Management
• /
• v.5 no.4 s.20
• /
• pp.139-146
• /
• 2004

Resent removal work for road signs has been labor intensive and required times since it has been done manually using shaving type equipment. While traditional process is conducting, there are traffic jams caused by the passing control, and happened unexpected accidents to workers working at dangerous road circumstance. Besides, in current shaving method, there are high potentialities on the air pollution as well as the explosive accident occurred by using a propane gas. So, as an alternative, we have studied to develop the automatic erasing equipment made up with a high pressure water-jet system and automatic control system, mobile system; Wate-rjet system consists of an intensifier and nozzles to give a high pressure and spray on the sign, and automatic control system is composed of one axis robot using a hydraulic servo actuator controlled by a lever, And as a mobile system, a truck plays an important role for the transport of equipment and the forward movement in a removal process. In this paper, we have analyzed the characteristics of road signs and have investigated current erasing methods in the field. And we have organized and designed automatic erasing equipment, and we have made a basic experiment to find out the optimal spray condition as like the spray distance, spray angle and injection pressure.

• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 2002.05a
• /
• pp.285-292
• /
• 2002

A cluster tool for semiconductor manufacturing is an integrated device that consists of several single wafer processing modules and a wafer transport module based on a robot. The distributed module controllers are integrated by an inter-module communication network and coordinated by a centralized controller, called a cluster tool controller (CTC). Since the CTC monitors and coordinates the distributed complex module controllers for advanced process control, complex commuication messaging and services between the CTC and the module controllers are required. A SEMI standard, CTMC(Cluster Tool Module Communication), specifies application-level communication service requirements for inter-module communication. We propose the use of high-level fieldbuses, for instance. PROFIBUS-FMS, for implementing CTMC since the high-level fieldbuses are well suited for complex real-time distributed manufacturing control applications. We present a way of implementing CTMC using PROFIBUS-FMS as the communication enabler. We first propose improvements of a key object of CTMC for material transfer and the part transfer protocol to meet the functional requirements of modem advanced cluster tools. We also discuss mapping objects and services of CTMC to PROFIBUS-FMS communication objects and services. Finally, we explain how to implement the mappings.

• Journal of Institute of Control, Robotics and Systems
• /
• v.16 no.5
• /
• pp.440-445
• /
• 2010

This paper proposes a single accelerometer sensor control algorithm to mobile inverted pendulum, generally called 'Segway', and evaluates the performance of this system comparing to the conventional ones. The commercialized 'Prototype Segway-PT' is initially considered as a next-generation transport vehicle. However, this robot is operated by three gyroscopes and two accelerometers to control the posture and speed, and it requires the complex signal processing for fusing the two sets of data. As the result of this, the growth rate of market size of 'Segway' is slow because of its high price mainly. In this paper, the mobile inverted pendulum is operated by a single accelerometer to simplify the control system to lower the price. Low pass filter is one of the good sensors to reducing the variation of an accelerometer, but it has time delay. This time delay disturbs real-time mobile inverted pendulum control. Like this, other various algorithms are used for this system, but each one has its own weak point. So this paper proposes a new filtering method, median filter and EKF. Median filter is used to image processing to reject impulse elements like salt and pepper noise. As the major performance evaluation parameter for the accelerometer, the high-frequency to low frequency ratio from FFT (Fast Fourier Transform) is used. Effectiveness of the proposed algorithms has been verified through the real experiments and the results are demonstrated.