• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.43 no.4 s.310
• /
• pp.74-86
• /
• 2006

This paper proposes a robust and computationally efficient algorithm for automatic video object segmentation. For implementing the spatio-temporal segmentation, which aims for efficient combination of the motion segmentation and the color segmentation, an SOM-based hierarchical clustering method in which the segmentation process is regarded as clustering of feature vectors is employed. As results, problems of high computational complexity which required for obtaining exact segmentation results in conventional video object segmentation methods, and the performance degradation due to noise are significantly reduced. A measure of motion vector reliability which employs MRF-based MAP estimation scheme has been introduced to minimize the influence from the motion estimation error. In addition, a noise elimination scheme based on the motion reliability histogram and a clustering validity index for automatically identifying the number of objects in the scene have been applied. A cross projection method for effective object tracking and a dynamic memory to maintain temporal coherency have been introduced as well. A set of experiments has been conducted over several video sequences to evaluate the proposed algorithm, and the efficiency in terms of computational complexity, robustness from noise, and higher segmentation accuracy of the proposed algorithm have been proved.

• Journal of Intelligence and Information Systems
• /
• v.18 no.1
• /
• pp.1-21
• /
• 2012

In recent years, mobile phone has experienced an extremely fast evolution. It is equipped with high-quality color displays, high resolution cameras, and real-time accelerated 3D graphics. In addition, some other features are includes GPS sensor and Digital Compass, etc. This evolution advent significantly helps the application developers to use the power of smart-phones, to create a rich environment that offers a wide range of services and exciting possibilities. To date mobile AR in outdoor research there are many popular location-based AR services, such Layar and Wikitude. These systems have big limitation the AR contents hardly overlaid on the real target. Another research is context-based AR services using image recognition and tracking. The AR contents are precisely overlaid on the real target. But the real-time performance is restricted by the retrieval time and hardly implement in large scale area. In our work, we exploit to combine advantages of location-based AR with context-based AR. The system can easily find out surrounding landmarks first and then do the recognition and tracking with them. The proposed system mainly consists of two major parts-landmark browsing module and annotation module. In landmark browsing module, user can view an augmented virtual information (information media), such as text, picture and video on their smart-phone viewfinder, when they pointing out their smart-phone to a certain building or landmark. For this, landmark recognition technique is applied in this work. SURF point-based features are used in the matching process due to their robustness. To ensure the image retrieval and matching processes is fast enough for real time tracking, we exploit the contextual device (GPS and digital compass) information. This is necessary to select the nearest and pointed orientation landmarks from the database. The queried image is only matched with this selected data. Therefore, the speed for matching will be significantly increased. Secondly is the annotation module. Instead of viewing only the augmented information media, user can create virtual annotation based on linked data. Having to know a full knowledge about the landmark, are not necessary required. They can simply look for the appropriate topic by searching it with a keyword in linked data. With this, it helps the system to find out target URI in order to generate correct AR contents. On the other hand, in order to recognize target landmarks, images of selected building or landmark are captured from different angle and distance. This procedure looks like a similar processing of building a connection between the real building and the virtual information existed in the Linked Open Data. In our experiments, search range in the database is reduced by clustering images into groups according to their coordinates. A Grid-base clustering method and user location information are used to restrict the retrieval range. Comparing the existed research using cluster and GPS information the retrieval time is around 70~80ms. Experiment results show our approach the retrieval time reduces to around 18~20ms in average. Therefore the totally processing time is reduced from 490~540ms to 438~480ms. The performance improvement will be more obvious when the database growing. It demonstrates the proposed system is efficient and robust in many cases.

• Journal of Internet Computing and Services
• /
• v.12 no.3
• /
• pp.119-129
• /
• 2011

Vision-based Human computer interaction is an emerging field of science and industry to provide natural way to communicate with human and computer. Especially, recent increasing demands for mobile augmented reality require the development of efficient interactive technologies between the augmented virtual object and users. This paper presents a novel approach to construct marker-less mobile augmented reality object and control the object. Replacing a traditional market, the human hand interface is used for marker-less mobile augmented reality system. In order to implement the marker-less mobile augmented system in the limited resources of mobile device compared with the desktop environments, we proposed a method to extract an optimal hand region which plays a role of the marker and augment object in a realtime fashion by using the camera attached on mobile device. The optimal hand region detection can be composed of detecting hand region with YCbCr skin color model and extracting the optimal rectangle region with Rotating Calipers Algorithm. The extracted optimal rectangle region takes a role of traditional marker. The proposed method resolved the problem of missing the track of fingertips when the hand is rotated or occluded in the hand marker system. From the experiment, we can prove that the proposed framework can effectively construct and control the augmented virtual object in the mobile environments.

• Journal of the Korean Society of Marine Environment & Safety
• /
• v.23 no.4
• /
• pp.415-420
• /
• 2017

In this paper, an algorithm for object counting via a conveyor system using machine vision is suggested. Object counting systems using image processing have been applied in a variety of industries for such purposes as measuring floating populations and traffic volume, etc. The methods of object counting mainly used involve template matching and machine learning for detecting and tracking. However, operational time for these methods should be short for detecting objects on quickly moving conveyor belts. To provide this characteristic, this algorithm for image processing is a region-based method. In this experiment, we counted young abalone shells that are similar in shape, size and color. We applied a characteristic conveyor system that operated in one direction. It obtained information on objects in the region of interest by comparing a second frame that continuously changed according to the information obtained with reference to objects in the first region. Objects were counted if the information between the first and second images matched. This count was exact when young shells were evenly spaced without overlap and missed objects were calculated using size information when objects moved without extra space. The proposed algorithm can be applied for various object counting controls on conveyor systems.

• Journal of the Korean Institute of Traditional Landscape Architecture
• /
• v.29 no.2
• /
• pp.81-89
• /
• 2011

The results of tracking the symbolism of plants in the introduction factors of Sokhwa(folk painting) are as the following. 1. The term Sokhwa(俗畵) is not only a type of painting with a strong local customs, but also carries a symbolic meaning and was discovered in "Donggukisanggukjip" of Lee, Gyu-Bo(1268~1241) in the Goryo era as well as the various usage in the "Sok Dongmunseon" in the early Chosun era, "Sasukjaejip" of Gang, Hee-mang(1424~1483), "Ilseongrok(1786)" in the late Chosun era, "Jajeo(自著)" of Yoo, Han-joon(1732~1811), and "Ojuyeonmunjangjeonsango(五洲衍文長箋散稿)" of Lee, Gyu-gyung(1788~?). Especially, according to the Jebyungjoksokhwa allegation〈題屛簇俗畵辯證說〉in the Seohwa of the Insa Edition of Ojuyeonmunjangjeonsango, there is a record that the "people called them Sokhwa." 2. Contemporarily, the Korean Sokhwa underwent the prehistoric age that primitively reflected the natural perspective on agricultural culture, the period of Three States that expressed the philosophy of the eternal spirits and reflected the view on the universe in colored pictures, the Goryo Era that religiously expressed the abstract shapes and supernatural patterns in spacein symbolism, and the Chosun Era that established the traditional Korean identity of natural perspective, aesthetic values and symbolism in a complex integration in the popular culture over time. 3. The materials that were analyzed in 1,009 pieces of Korean Sokhwa showed 35 species of plants, 37 species of animals, 6 types of natural objects and other 5 types with a total of 83 types. 4. The shape aesthetics according to the aesthetic analysis of the plants in Sokhwa reflect the primitive world view of Yin/yang and the Five Elements in the peony paintings and dynamic refinement and biological harmonies in the maehwado; the composition aesthetics show complex multi-perspective composition with a strong noteworthiness in the bookshelf paintings, a strong contrast of colors with reverse perspective drawing in the battlefield paintings, and the symmetric beauty of simple orderly patterns in nature and artificial objects with straight and oblique lines are shown in the leisurely reading paintings. In terms of color aesthetics, the five colors of directions - east, west, south, north and the center - or the five basic colors - red, blue, yellow, white and black - are often utilized in ritual or religious manners or symbolically substitute the relative relationships with natural laws. 5. The introduction methods in the Korean Sokhwa exceed the simple imitation of the natural shapes and have been sublimated to the symbolism that is related to nature based on the colloquial artistic characteristics with the suspicion of the essence in the universe. Therefore, the symbolism of the plants and animals in the Korean Sokhwas is a symbolic recognition system, not a scientific recognition system with a free and unique expression with a complex interaction among religious, philosophical, ecological and ideological aspects, as a identity of the group culture of Koreans where the past and the future coexist in the present. This is why the Koran Sokhwa or the folk paintings can be called a cultural identity and can also be interpreted as a natural and folk meaningful scenic factor that has naturally integrated into our cultural lifestyle. However, the Sokhwa(folk paintings) that had been closely related to our lifestyle drastically lost its meaning and emotions through the transitions over time. As the living lifestyle predominantly became the apartment culture and in the historical situations where the confusion of the identity has deepened, the aesthetic and the symbolic values of the Sokhwa folk paintings have the appropriateness to be transmitted as the symbolic assets that protect our spiritual affluence and establish our identity.