• Title/Summary/Keyword: small time-delay process

Search Result 47, Processing Time 0.028 seconds

Application of reinforcement learning to hyper-redundant system Acquisition of locomotion pattern of snake like robot

  • Ito, K.;Matsuno, F.
    • Proceedings of the Korea Inteligent Information System Society Conference
    • /
    • 2001.01a
    • /
    • pp.65-70
    • /
    • 2001
  • We consider a hyper-redundant system that consists of many uniform units. The hyper-redundant system has many degrees of freedom and it can accomplish various tasks. Applysing the reinforcement learning to the hyper-redundant system is very attractive because it is possible to acquire various behaviors for various tasks automatically. In this paper we present a new reinforcement learning algorithm "Q-learning with propagation of motion". The algorithm is designed for the multi-agent systems that have strong connections. The proposed algorithm needs only one small Q-table even for a large scale system. So using the proposed algorithm, it is possible for the hyper-redundant system to learn the effective behavior. In this algorithm, only one leader agent learns the own behavior using its local information and the motion of the leader is propagated to another agents with time delay. The reward of the leader agent is given by using the whole system information. And the effective behavior of the leader is learned and the effective behavior of the system is acquired. We apply the proposed algorithm to a snake-like hyper-redundant robot. The necessary condition of the system to be Markov decision process is discussed. And the computer simulation of learning the locomotion is demonstrated. From the simulation results we find that the task of the locomotion of the robot to the desired point is learned and the winding motion is acquired. We can conclude that our proposed system and our analysis of the condition, that the system is Markov decision process, is valid.

  • PDF

Optimal Inventory Management for Rebar Fabrication Process in Construction Process (건설현장 철근작업 프로세스상의 적정 자재재고 관리 방안에 관한 연구)

  • Jung, Do-Young;Park, Sang-Hyuk;Kwak, Soo-Nam;Kim, Hyoung-Kwan;Han, Seung-Heon
    • Proceedings of the Korean Institute Of Construction Engineering and Management
    • /
    • 2006.11a
    • /
    • pp.702-707
    • /
    • 2006
  • There have been certain extent of material inventory in construction site because of difficulties in ordering by small quantity, strategy of securing future requirements and prevention of delay. However, carrying these inventory entails a financial cost called inventory holding cost and decrease construction productivity, so proper inventory management in construction industry is important for construction efficiency and cost reduction. This study tries to find analytical method of inventory management. It includes ordering decision which decide how much to order and when to order. Setting these strategies including deciding safety inventory, input and ouput variability are able to controled.

  • PDF

A DEVELOPMENT OF RFID/USN-BASED INTELLIGENT EQUIPMENT FOR CONSTRUCTION SUPPLY CHAIN MANAGEMENT

  • Tae-Hong Shin;Su-Won Yoon;Sangyoon Chin;Soon-Wook Kwon;Yea-Sang Kim;Cheolho Choi
    • International conference on construction engineering and project management
    • /
    • 2009.05a
    • /
    • pp.472-478
    • /
    • 2009
  • The scopes of the supply chain management in construction projects has expanded from the field management focusing on field storage, transportation, and lifting to the whole supply chain from the materials to field. The expansion of the supply chain management can raise the possibilities of leaner production, which enables shortened lead time of the difficult-to-operate materials, and prevents the work interference or delay. However, the expanded management range requires more information and management than an existing management style currently used for factory production of iron frame, curtain wall, PC, etc. In addition, there are limitations that expand the existing management style into the new supply chain management in construction projects and therefore it is required to automate the existing management style in order to extend the management range. The objective of this study is to propose the process and equipment that can manage the supply chain of the materials which range from the factory production to the field storage based on RFID/USN techniques, introducing small-sized transportation equipment(intelligent pallet), the vehicle tool kit(intelligent trailer), and in-and-out management equipment(Gate Sensor) as a prototype to effectively develop the appliances for operating the proposed process, and present the application possibility of the appliances. The full paper will present then the test results that the proposed appliances for the supply chain management automatically transmit and receive the generated information between the appliances or the appliance and sever under various wireless network circumstances such as zigbee, wibro, Wi-Fi, and CDMA.

  • PDF

A Genetic Algorithm for Production Scheduling of Biopharmaceutical Contract Manufacturing Products (바이오의약품 위탁생산 일정계획 수립을 위한 유전자 알고리즘)

  • Ji-Hoon Kim;Jeong-Hyun Kim;Jae-Gon Kim
    • The Journal of Bigdata
    • /
    • v.9 no.1
    • /
    • pp.141-152
    • /
    • 2024
  • In the biopharmaceutical contract manufacturing organization (CMO) business, establishing a production schedule that satisfies the due date for various customer orders is crucial for competitiveness. In a CMO process, each order consists of multiple batches that can be allocated to multiple production lines in small batch units for parallel production. This study proposes a meta-heuristic algorithm to establish a scheduling plan that minimizes the total delivery delay of orders in a CMO process with identical parallel machine. Inspired by biological evolution, the proposed algorithm generates random data structures similar to chromosomes to solve specific problems and effectively explores various solutions through operations such as crossover and mutation. Based on real-world data provided by a domestic CMO company, computer experiments were conducted to verify that the proposed algorithm produces superior scheduling plans compared to expert algorithms used by the company and commercial optimization packages, within a reasonable computation time.

Variable Sampling Window Flip-Flops for High-Speed Low-Power VLSI (고속 저전력 VLSI를 위한 가변 샘플링 윈도우 플립-플롭의 설계)

  • Shin Sang-Dae;Kong Bai-Sun
    • Journal of the Institute of Electronics Engineers of Korea SD
    • /
    • v.42 no.8 s.338
    • /
    • pp.35-42
    • /
    • 2005
  • This paper describes novel flip-flops with improved robustness and reduced power consumption. Variable sampling window flip-flop (VSWFF) adjusts the width of the sampling window according to input data, providing robust data latching as well as shorter hold time. The flip-flop also reduces power consumption for higher input switching activities as compared to the conventional low-power flip-flop. Clock swing-reduced variable sampling window flip-flop (CSR-VSWFF) reduces clock power consumption by allowing the use of a small swing clock. Unlike conventional reduced clock swing flip-flops, it requires no additional voltage higher than the supply voltage, eliminating design overhead related to the generation and distribution of this voltage. Simulation results indicate that the proposed flip-flops provide uniform latency for narrower sampling window and improved power-delay product as compared to conventional flip-flops. To evaluate the performance of the proposed flip-flops, test structures were designed and implemented in a $0.3\mu m$ CMOS process technology. Experimental result indicates that VSWFF yields power reduction for the maximum input switching activity, and a synchronous counter designed with CSR-VSWFF improves performance in terms of power consumption with no use of extra voltage higher than the supply voltage.

A Development of Maritime Search and Rescue Supporting System using Smartphone Application (스마트폰 어플리케이션을 활용한 해상 구조 지원 시스템 개발)

  • Hwang, Hun-Gyu;Kim, Bae-Sung;Woo, Yun-Tae;Shin, Il-Sik;Lee, Jang-Se
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.4
    • /
    • pp.804-810
    • /
    • 2017
  • Distress accidents occur annually by and failure of sea rescue and time delay lead to fatal accident. In the event of maritime distress, most of the equipments used for search and rescue are in responsible for the position of ships. An MOB equipment is a representative equipment for lifesaving and uses AIS communication method. However, the MOB equipment has problems of interference with existing vessel traffic process and it is difficult to apply because there is no proper certification standard. Therefore, this paper proposes a maritime search and rescue supporting system using smartphone. Utilizing the widely constructed IT infrastructure, it collects position information of the fishing boat and leisure ship using GPS embedded in the smartphone. Also the developed system supports to participate in the rescue by sending the information about the occurrence of the survivor in a certain area to the ship operator.

Performance Analysis of a Statistical Packet Voice/Data Multiplexer (통계적 패킷 음성 / 데이터 다중화기의 성능 해석)

  • 신병철;은종관
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.11 no.3
    • /
    • pp.179-196
    • /
    • 1986
  • In this paper, the peformance of a statistical packet voice/data multiplexer is studied. In ths study we assume that in the packet voice/data multiplexer two separate finite queues are used for voice and data traffics, and that voice traffic gets priority over data. For the performance analysis we divide the output link of the multiplexer into a sequence of time slots. The voice signal is modeled as an (M+1) - state Markov process, M being the packet generation period in slots. As for the data traffic, it is modeled by a simple Poisson process. In our discrete time domain analysis, the queueing behavior of voice traffic is little affected by the data traffic since voice signal has priority over data. Therefore, we first analyze the queueing behavior of voice traffic, and then using the result, we study the queueing behavior of data traffic. For the packet voice multiplexer, both inpur state and voice buffer occupancy are formulated by a two-dimensional Markov chain. For the integrated voice/data multiplexer we use a three-dimensional Markov chain that represents the input voice state and the buffer occupancies of voice and data. With these models, the numerical results for the performance have been obtained by the Gauss-Seidel iteration method. The analytical results have been verified by computer simylation. From the results we have found that there exist tradeoffs among the number of voice users, output link capacity, voic queue size and overflow probability for the voice traffic, and also exist tradeoffs among traffic load, data queue size and oveflow probability for the data traffic. Also, there exists a tradeoff between the performance of voice and data traffics for given inpur traffics and link capacity. In addition, it has been found that the average queueing delay of data traffic is longer than the maximum buffer size, when the gain of time assignment speech interpolation(TASI) is more than two and the number of voice users is small.

  • PDF

Intertidal DEM Generation Using Satellite Radar Interferometry (인공위성 레이더 간섭기술을 이용한 조간대 지형도 작성에 관한 연구)

  • Park, Jeong-Won;Choi, Jung-Hyun;Lee, Yoon-Kyung;Won, Joong-Sun
    • Korean Journal of Remote Sensing
    • /
    • v.28 no.1
    • /
    • pp.121-128
    • /
    • 2012
  • High resolution intertidal DEM is a basic material for science research like sedimentation/erosion by ocean current, and is invaluable in a monitoring of environmental changes and practical management of coastal wetland. Since the intertidal zone changes rapidly by the inflow of fluvial debris and tide condition, remote sensing is an effective tool for observing large areas in short time. Although radar interferometry is one of the well-known techniques for generating high resolution DEM, conventional repeat-pass interferometry has difficulty on acquiring enough coherence over tidal flat due to the limited exposure time and the rapid changes in surface condition. In order to overcome these constraints, we tested the feasibility of radar interferometry using Cosmo-SkyMed tandem-like one-day data and ERS-ENVISAT cross tandem data with very short revisit period compared to the conventional repeat pass data. Small temporal baseline combined with long perpendicular baseline allowed high coherence over most of the exposed tidal flat surface in both observations. However the interferometric phases acquired from Cosmo-SkyMed data suffer from atmospheric delay and changes in soil moisture contents. The ERS-ENVISAT pair, on the other hand, provides nice phase which agree well with the real topography, because the atmospheric effect in 30-minute gap is almost same to both images so that they are cancelled out in the interferometric process. Thus, the cross interferometry with very small temporal baseline and large perpendicular baseline is one of the most reliable solutions for the intertidal DEM construction which requires very accurate mapping of the elevation.

A Measuring Model of Risk Impact on The App Development Project in The Social App Manufacturing Environment (Social App Manufacturing 환경의 앱 개발 프로젝트에서 위험영향도 측정 모델)

  • Baek, Jung Hee;Lim, Young Hwan
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.3 no.9
    • /
    • pp.335-340
    • /
    • 2014
  • Crowd Sourcing-based Social App Manufacturing environment, a small app development project by a team of anonymous virtual performed without the constraints of time and space, and manage it for the app development process need to be automated method. Virtual teams with anonymity is a feature of the Social App Manufacturing, is an important factor that increases the uncertainty of whether the completion of the project or reduction in visibility of the progress of the project. In this study, as one of how to manage the project of Social App Manufacturing environment, the impact of risk that can be used to quantitatively measure the impact of the risk of delay in development has on the project also proposes a measurement model. Effects of risk and type of the impact of risks associated with delays in the work schedule also define the characteristic function, measurement model that has been proposed, suggest the degree of influence measurement equation of risk of the project in accordance with the progressive. The advantage of this model, the project manager is able to ensure the visibility of the progress of the project. In addition, identify the project risk of work delays, and to take precautions.

Query Technique for Quick Network Routing changing of Mobility Sensor Node in Healthcare System (헬스케어 시스템에서 이동형 센서노드의 신속한 네트워크 라우팅 변화를 위한 질의기법)

  • Lee, Seung-chul;Kwon, Tae-Ha;Chung, Wan-Young
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2009.10a
    • /
    • pp.517-520
    • /
    • 2009
  • Healthcare application system has been actively researched to apply WSN technology to healthcare area with a mobile sensor node of low cost, low power, and small size. Sensor node has the problem for transmission range of RF power and time delay of the wireless routing connectivity between sensor nodes. In this paper, we proposes a new method utilizing mobile sensor nodes with relay sensor nodes for quick network routing changing using query technique in healthcare system. A query processor to control and manage the routing changing of sensor nodes in a wireless sensor network was designed and implemented. The user's PC transmits the beacon message which will change the quick link routing according to activity status of patient in wireless sensor network. We describe the implementation for query protocol that is very effective of power saving between sensor nodes.

  • PDF