This paper reviews dynamic programming (DP), surveys approximate solution methods for it, and considers their applicability to process control problems. Reinforcement Learning (RL) and Neuro-Dynamic Programming (NDP), which can be viewed as approximate DP techniques, are already established techniques for solving difficult multi-stage decision problems in the fields of operations research, computer science, and robotics. Owing to the significant disparity of problem formulations and objective, however, the algorithms and techniques available from these fields are not directly applicable to process control problems, and reformulations based on accurate understanding of these techniques are needed. We categorize the currently available approximate solution techniques fur dynamic programming and identify those most suitable for process control problems. Several open issues are also identified and discussed.

This paper presents a novel design for a tubular linear brushless permanent-magnet motor. In this design, the magnets in the moving part are oriented in an NS-NS―SN-SN fashion which leads to higher magnetic force near the like-pole region. An analytical methodology to calculate the motor force and to size the actuator was developed. The linear motor is operated in conjunction with a position sensor, three power amplifiers, and a controller to form a complete solution for controlled precision actuation. Real-time digital controllers enhanced the dynamic performance of the motor, and gain scheduling reduced the effects of a nonlinear dead band. In its current state, the motor has a rise time of 30 ms, a settling time of 60 ms, and 25% overshoot to a 5-mm step command. The motor has a maximum speed of 1.5 m/s and acceleration up to 10 g. It has a 10-cm travel range and 26-N maximum pull-out force. The compact size of the motor suggests it could be used in robotic applications requiring moderate force and precision, such as robotic-gripper positioning or actuation. The moving part of the motor can extend significantly beyond its fixed support base. This reaching ability makes it useful in applications requiring a small, direct-drive actuator, which is required to extend into a spatially constrained environment.

This paper deals with the design and control of passive multiple trailer systems for practical applications. Due to the cost and complexity of the trailer mechanism, passive systems are preferred to active systems in this research. The design and control objective is to minimize the trajectory tracking errors occurring in passive multiple trailers. Three sorts of passive trailer systems, off-hooked, direct-hooked, and three-point, are discussed in this paper. Trajectory tracking performance and stability issues under constant curvature reference trajectories are investigated for these three types. As well, various simulations and experiments have been performed for each type. It is shown that the proposed off-hooked trailer system produces a tracking performance that is superior to the others.

In this paper, a new evolutionary scheme to design a TSK fuzzy model from relevant data is proposed. The identification of the antecedent rule parameters is performed via the evolutionary algorithm with the unique fitness function and the various evolutionary operators, while the identification of the consequent parameters is done using the least square method. The occurrence of the multiple overlapping membership functions, which is a typical feature of unconstrained optimization, is resolved with the help of the proposed fitness function. The proposed algorithm can generate a fuzzy model with transparent membership functions. Through simulations on various problems, the proposed algorithm found a TSK fuzzy model with better accuracy than those found in previous works with transparent partition of input space.

In this paper, an unscented Kalman filter (UKF) for curvilinear motions in an interacting multiple model (IMM) algorithm to track a maneuvering vehicle on a road is investigated. Driving patterns of vehicles on a road are modeled as stochastic hybrid systems. In order to track the maneuvering vehicles, two kinematic models are derived: A constant velocity model for linear motions and a constant-speed turn model for curvilinear motions. For the constant-speed turn model, an UKF is used because of the drawbacks of the extended Kalman filter in nonlinear systems. The suggested algorithm reduces the root mean squares error for linear motions and rapidly detects possible turning motions.

This paper proposes some further improvements on N.K. Bose's 2D stability test for polynomials with real coefficients by revealing symmetric properties of the polynomials, resultants occurring in the test and by generalizing Sturm's method. The improved test can be fulfilled by a totally algebraic algorithm with a finite number of steps and the computational complexity is largely reduced as it involves only certain real variable polynomials with degrees not exceeding half of their previous complex variable counterparts. Nontrivial examples for 2D polynomials having both numerical and literal coefficients are also shown to illustrate the computational advantage of the proposed method.

This paper presents a framework for the self-organization of swarm systems based on coupled nonlinear oscillators (CNOs). In this scheme, multiple agents in a swarm self-organize to flock and arrange themselves as a group using CNOs, which are able to keep a certain distance by the attractive and repulsive forces among different agents. A theoretical approach of flocking behavior by CNOs and a design guideline of CNO parameters are proposed. Finally, the formation scenario for cooperative multi-agent groups is investigated to demonstrate group behaviors such as aggregation, migration, homing and so on. The task for each group in this scenario is to perform a series of processes such as gathering into a whole group or splitting into two groups, and then to return to the base while avoiding collision with agents in different groups and maintaining the formation of each group.

This paper presents the survivability, mobility, and functionality of a rover as part of a radar system for polar regions. Rovers can provide autonomy and precision for radars used to measure ice thickness and other characteristics of ice sheets in Greenland and Antarctica. These rovers can be used to move radar antennas in precise patterns for synthetic aperture radars while providing environmental protection and power to the onboard radar equipment. This paper describes the mobility, actuation, sensing, winterization, control, and virtual prototyping of a polar rover. The rover has been successfully tested in Greenland.

To improve fault isolation performance of the Bayes isolator, this paper proposes the Fuzzy-Bayes isolator, which uses the Fuzzy-Bayes classifier as a fault isolator. The Fuzzy-Bayes classifier is composed of the Bayes classifier and weighting factor, which is determined by fuzzy inference logic. The Mahalanobis distance derivative is mapped to the weighting factor by fuzzy inference logic. The Fuzzy-Bayes fault isolator is designed for the BLDC motor fault diagnosis system. Fault isolation performance is evaluated by the experiments. The research results indicate that the Fuzzy-Bayes fault isolator improves fault isolation performance and that it can reduce the transition region chattering that is occurred when the fault is injected. In the experiment, chattering is reduced by about half that of the Bayes classifier's.

In this study, we introduce a noble neurogenetic approach to the design of the fuzzy controller. The design procedure dwells on the use of Computational Intelligence (CI), namely genetic algorithms and neurofuzzy networks (NFN). The crux of the design methodology is based on the selection and determination of optimal values of the scaling factors of the fuzzy controllers, which are essential to the entire optimization process. First, tuning of the scaling factors of the fuzzy controller is carried out, and then the development of a nonlinear mapping for the scaling factors is realized by using GA based NFN. The developed approach is applied to an inverted pendulum nonlinear system where we show the results of comprehensive numerical studies and carry out a detailed comparative analysis.

This paper presents a neural network adaptive controller for autonomous diving control of an autonomous underwater vehicle (AUV) using adaptive backstepping method. In general, the dynamics of underwater robotics vehicles (URVs) are highly nonlinear and the hydrodynamic coefficients of vehicles are difficult to be accurately determined a priori because of variations of these coefficients with different operating conditions. In this paper, the smooth unknown dynamics of a vehicle is approximated by a neural network, and the remaining unstructured uncertainties, such as disturbances and unmodeled dynamics, are assumed to be unbounded, although they still satisfy certain growth conditions characterized by 'bounding functions' composed of known functions multiplied by unknown constants. Under certain relaxed assumptions pertaining to the control gain functions, the proposed control scheme can guarantee that all the signals in the closed-loop system satisfy to be uniformly ultimately bounded (UUB). Simulation studies are included to illustrate the effectiveness of the proposed control scheme, and some practical features of the control laws are also discussed.

Recently a method of model reduction for discrete systems has been proposed in the literature based on a new impulse response Gramian. In this method, the system matrix$A_r$ of a reduced model is computed by approximating the reduced-order impulse response Gramian. The remaining matrices $b_r$ and $c_r$ are obtained so that various initial Markov parameters and time-moments of the original system are preserved in the reduced model. In this paper a different approach is presented based on the recursive relationship among the impulse response Gramians.

This paper presents the design and testing of a multi-channel vibrotactile display. It is composed of a cylindrical handle with four embedded vibrating elements driven by piezoelectric beams. Vibrations are transmitted to the hands through arrays of pins. The device was tested in sensory substitution for conveying force information during a teleoperated peg insertion. Results show that the device is effective in reducing peak forces during the insertion task.

A human-friendly interactive system that is based on the harmonious symbiotic coexistence of humans and robots is explored. Based on the interactive technology paradigm, a robotic cane is proposed for blind or visually impaired pedestrians to navigate safely and quickly through obstacles and other hazards. Robotic aids, such as robotic canes, require cooperation between humans and robots. Various methods for implementing the appropriate cooperative recognition, planning, and acting, have been investigated. The issues discussed include the interaction between humans and robots, design issues of an interactive robotic cane, and behavior arbitration methodologies for navigation planning.