• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.6 no.12
• /
• pp.3315-3337
• /
• 2012

Crowded scenes analysis is a challenging topic in computer vision field. How to detect diverse motion patterns in crowded scenarios from videos is the critical yet hard part of this problem. In this paper, we propose a novel approach to mining motion patterns by utilizing motion information during both long-term period and short interval simultaneously. To capture long-term motions effectively, we introduce Motion History Image (MHI) representation to access to the global perspective about the crowd motion. The combination of MHI and optical flow, which is used to get instant motion information, gives rise to discriminative spatial-temporal motion features. Benefitting from the robustness and efficiency of the novel motion representation, the following motion pattern mining is implemented in a completely unsupervised way. The motion vectors are clustered hierarchically through automatic hierarchical clustering algorithm building on the basis of graphic model. This method overcomes the instability of optical flow in dealing with time continuity in crowded scenes. The results of clustering reveal the situations of motion pattern distribution in current crowded videos. To validate the performance of the proposed approach, we conduct experimental evaluations on some challenging videos including vehicles and pedestrians. The reliable detection results demonstrate the effectiveness of our approach.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.2
• /
• pp.912-928
• /
• 2019

Crowd behavior analysis research has revealed a central role in helping people to find safety hazards or crime optimistic forecast. Thus, it is significant in the future video surveillance systems. Recently, the growing demand for safety monitoring has changed the awareness of video surveillance studies from analysis of individuals behavior to group behavior. Group detection is the process before crowd behavior analysis, which separates scene of individuals in a crowd into respective groups by understanding their complex relations. Most existing studies on group detection are scene-specific. Crowds with various densities, structures, and occlusion of each other are the challenges for group detection in diverse crowded scenes. Therefore, we propose a group detection approach called Collective Interaction Filtering to discover people motion interaction from trajectories. This approach is able to deduce people interaction with the Expectation-Maximization algorithm. The Collective Interaction Filtering approach accurately identifies groups by clustering trajectories in crowds with various densities, structures and occlusion of each other. It also tackles grouping consistency between frames. Experiments on the CUHK Crowd Dataset demonstrate that approach used in this study achieves better than previous methods which leads to latest results.

• Journal of Korea Multimedia Society
• /
• v.11 no.5
• /
• pp.597-609
• /
• 2008

Due to the recursive updating nature of background model, previous background modeling methods are often perturbed by crowd scenes where foreground pixels occurs more frequently than background pixels. To resolve this problem, an adaptive background modeling method, which is based on the well-known Gaussian mixture background model, is proposed. In the proposed method, the learning rate of background model is adaptively adjusted with respect to the crowdedness of the scene. Consequently, the learning process is suppressed in crowded scene to maintain proper background model. Experiments on real dataset revealed that the proposed method could perform background subtraction effectively even in crowd situation while the performance is almost the same to the previous method in normal scenes. Also, the F-measure was increased by 5-10% compared to the previous background modeling methods in the video of crowded situations.

• Journal of Korea Multimedia Society
• /
• v.13 no.8
• /
• pp.1128-1141
• /
• 2010

This paper proposes a method of moving object detection in crowded scene using clustered trajectory. Unlike previous appearance based approaches, the proposed method employes motion information only to isolate moving objects. In the proposed method, feature points are extracted from input frames first and then feature tracking is followed to create feature trajectories. Based on an assumption that feature points originated from the same objects shows similar motion as the object moves, the proposed method detects moving objects by clustering trajectories of similar motions. For this purpose an energy function based on spatial proximity, motion coherence, and temporal continuity is defined to measure the similarity between two trajectories and the clustering is achieved by minimizing the energy function in CRFs (conditional random fields). Compared to previous methods, which are unable to separate falsely merged trajectories during the clustering process, the proposed method is able to rearrange the falsely merged trajectories during iteration because the clustering is solved my energy minimization in CRFs. Experiment results with three different crowded scenes show about 94% detection rate with 7% false alarm rate.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.67 no.7
• /
• pp.903-909
• /
• 2018

We propose laser scanner sensor system based walking pattern and tracking method of multiple human. This system uses laser scanners sensors and is applicable to wide and crowded area such as hospital and medical care center. The primary objective of this research is to promote the development of robust, repeatable and transferable software for security system that can automatically detect, track and follow people in public area. We developed the method of human identification for this system. Our method is following: 1. Best-walking pattern data are obtained by the help of human position and direction data obtained by laser scanners. 2. Human identification is conducted by calculating the correlation between the step length of walking human. It becomes possible to conduct human identification even in crowded scenes by estimating the movements of waling human' feet are periodic. In the experiment in the station, some effectiveness of this method became clear.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.3
• /
• pp.1450-1463
• /
• 2019

The problem towards crowd behavior recognition in a serious clustered scene is extremely challenged on account of variable scales with non-uniformity. This paper aims to propose a crowed behavior classification framework based on a transferring hybrid network blending 3D res-net with inception-v3. First, the 3D res-inception network is presented so as to learn the augmented visual feature of UCF 101. Then the target dataset is applied to fine-tune the network parameters in an attempt to classify the behavior of densely crowded scenes. Finally, a transferred entropy function is used to calculate the probability of multiple labels in accordance with these features. Experimental results show that the proposed method could greatly improve the accuracy of crowd behavior recognition and enhance the accuracy of multiple label classification.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.6
• /
• pp.597-602
• /
• 2014

We propose hybrid-sensing system for human tracking. This system uses laser scanners and image sensors and is applicable to wide and crowded area such as hallway of university. Concretely, human tracking using laser scanners is at base and image sensors are used for human identification when laser scanners lose persons by occlusion, entering room or going up stairs. We developed the method of human identification for this system. Our method is following: 1. Best-shot images (human images which show human feature clearly) are obtained by the help of human position and direction data obtained by laser scanners. 2. Human identification is conducted by calculating the correlation between the color histograms of best-shot images. It becomes possible to conduct human identification even in crowded scenes by estimating best-shot images. In the experiment in the station, some effectiveness of this method became clear.

• International journal of advanced smart convergence
• /
• v.12 no.4
• /
• pp.147-153
• /
• 2023

In recent times, an absence of effective crowd management has led to numerous stampede incidents in crowded places. A crucial component for enhancing on-site crowd management effectiveness is the utilization of crowd counting technology. Current approaches to analyzing congested scenes have evolved beyond simple crowd counting, which outputs the number of people in the targeted image to a density map. This development aligns with the demands of real-life applications, as the same number of people can exhibit vastly different crowd distributions. Therefore, solely counting the number of crowds is no longer sufficient. CSRNet stands out as one representative method within this advanced category of approaches. In this paper, we propose a crowd counting network which is adaptive to the change in the density of people in the scene, addressing the performance degradation issue observed in the existing CSRNet(Congested Scene Recognition Network) when there are changes in density. To overcome the weakness of the CSRNet, we introduce a system that takes input from the image's information and adjusts the output of CSRNet based on the features extracted from the image. This aims to improve the algorithm's adaptability to changes in density, supplementing the shortcomings identified in the original CSRNet.

• MISULJARYO - National Museum of Korea Art Journal
• /
• v.96
• /
• pp.54-88
• /
• 2019

The Album of Complete Views of Seas and Mountains comprises sixty real scenery landscape paintings depicting Geumgangsan Mountain, the Haegeumgang River, and the eight scenic views of Gwandong regions, as well as fifty-one pieces of writing. It is a rare example in terms of its size and painting style. The paintings in this album, which are densely packed with natural features, follow the painting style of the Southern School yet employ crude and unconventional elements. In them, stones on the mountains are depicted both geometrically and three-dimensionally. Since 1973, parts of this album have been published in some exhibition catalogues. The entire album was opened to the public at the special exhibition "Through the Eyes of Joseon Painters: Real Scenery Landscapes of Korea" held at the National Museum of Korea in 2019. The Album of Complete Views of Seas and Mountains was attributed to Kim Eung-hwan (1742-1789) due to the signature on the final leaf of the album and the seal reading "Bokheon(painter's penname)" on the currently missing album leaf of Chilbodae Peaks. However, there is a strong possibility that this signature and seal may have been added later. This paper intends to reexamine the creator of this album based on a variety of related factors. In order to understand the production background of Album of Complete Views of Seas and Mountains, I investigated the eighteenth-century tradition of drawing scenic spots while travelling in which scenery of was depicted during private travels or official excursions. Jeong Seon(1676-1759), Sim Sa-jeong(1707-1769), Kim Yun-gyeom(1711-1775), Choe Buk(1712-after 1786), and Kang Se-hwang(1713-1791) all went on a journey to Geumgangsan Mountain, the most famous travel destination in the late Joseon period, and created paintings of the mountain, including Album of Pungak Mountain in the Sinmyo Year(1711) by Jeong Seon. These painters presented their versions of the traditional scenic spots of Inner Geumgangsan and newly depicted vistas they discovered for themselves. To commemorate their private visits, they produced paintings for their fellow travelers or sponsors in an album format that could include several scenes. While the production of paintings of private travels to Geumgangsan Mountain increased, King Jeongjo(r. 1776-1800) ordered Kim Eung-hwan and Kim Hong-do, court painters at the Dohwaseo(Royal Bureau of Painting), to paint scenic spots in the nine counties of the Yeongdong region and around Geumgangsan Mountain. King Jeongjo selected these two as the painters for the official excursion taking into account their relationship, their administrative experience as regional officials, and their distinct painting styles. Starting in the reign of King Yeongjo(r. 1724-1776), Kim Eung-hwan and Kim Hong-do served as court painters at the Dohwaseo, maintained a close relationship as a senior and a junior and as colleagues, and served as chalbang(chief in large of post stations) in the Yeongnam region. While Kim Hong-do was proficient at applying soft and delicate brushstrokes, Kim Eung-hwan was skilled at depicting the beauty of robust and luxuriant landscapes. Both painters produced about 100 scenes of original drawings over fifty days of the official excursion. Based on these original drawings, they created around seventy album leaves or handscrolls. Their paintings enriched the tradition of depicting scenic spots, particularly Outer Inner Geumgang and the eight scenic views of Gwandong around Geumgangsan Mountain during private journeys in the eighteenth century. Moreover, they newly discovered places of scenic beauty in the Outer Geungang and Yeongdong regions, establishing them as new painting themes. The Album of Complete Views of Seas and Mountains consists of four volumes. The volumes I, II include twenty-nine paintings of Inner Geumgangsan; the volume III, seventeen scenes of Outer Geumgangsan; and the volume IV, fourteen images of Maritime Geumgangsan and the eight scenic views of Gwandong. These paintings produced on silk show crowded compositions, geometrical depictions of the stones and the mountains, and distinct presentation of the rocky peaks of Geumgangsan Mountain using white and grayish-blue pigments. This album reflects the Joseon painting style of the mid- and late eighteenth century, integrating influences from Jeong Seon, Kang Se-hwang, Sim Sa-jeong, Jeong Chung-yeop(1725-after 1800), and Kim Hong-do. In particular, some paintings in the album show similarities to Kim Hong-do's Album of Famous Mountains in Korea in terms of its compositions and painterly motifs. However, "Yeongrangho Lake," "Haesanjeong Pavilion," and "Wolsongjeong Pavilion" in Kim Eung-hwan's album differ from in the version by Kim Hong-do. Thus, Kim Eung-hwan was influenced by Kim Hong-do, but produced his own distinctive album. The Album of Complete Views of Seas and Mountains includes scenery of "Jaundam Pool," "Baegundae Peak," "Viewing Birobong Peak at Anmunjeom groove," and "Baekjeongbong Peak," all of which are not depicted in other albums. In his version, Kim Eung-hwan portrayed the characteristics of the natural features in each scenic spot in a detailed and refreshing manner. Moreover, he illustrated stones on the mountains using geometric shapes and added a sense of three-dimensionality using lines and planes. Based on the painting traditions of the Southern School, he established his own characteristics. He also turned natural features into triangular or rectangular chunks. All sixty paintings in this album appear rough and unconventional, but maintain their internal consistency. Each of the fifty-one writings included in the Album of Complete Views of Seas and Mountains is followed by a painting of a scenic spot. It explains the depicted landscape, thus helping viewers to understand and appreciate the painting. Intimately linked to each painting, the related text notes information on traveling from one scenic spot to the next, the origins of the place names, geographic features, and other related information. Such encyclopedic documentation began in the early nineteenth century and was common in painting albums of Geumgangsan Mountain in the mid- nineteenth century. The text following the painting of Baekhwaam Hermitage in the Album of Complete Views of Seas and Mountains documents the reconstruction of the Baekhwaam Hermitage in 1845, which provides crucial evidence for dating the text. Therefore, the owner of the Album of Complete Views of Seas and Mountains might have written the texts or asked someone else to transcribe them in the mid- or late nineteenth century. In this paper, I have inferred the producer of the Album of Complete Views of Seas and Mountains to be Kim Eung-hwan based on the painting style and the tradition of drawing scenic spots during official trips. Moreover, its affinity with the Handscroll of Pungak Mountain created by Kim Ha-jong(1793-after 1878) after 1865 is another decisive factor in attributing the album to Kim Eung-hwan. In contrast to the Album of Famous Mountains in Korea by Kim Hong-do, the Album of Complete Views of Seas and Mountains exerted only a minor influence on other painters. The Handscroll of Pungak Mountain by Kim Ha-jong is the sole example that employs the subject matter from the Album of Complete Views of Seas and Mountains and follows its painting style. In the Handscroll of Pungak Mountain, Kim Ha-jong demonstrated a painting style completely different from that in the Album of Seas and Mountains that he produced fifty years prior in 1816 for Yi Gwang-mun, the magistrate of Chuncheon. He emphasized the idea of "scholar thoughts" by following the compositions, painterly elements, and depictions of figures in the painting manual style from Kim Eung-hwan's Album of Complete Views of Seas and Mountains. Kim Ha-jong, a member of the Gaeseong Kim clan and the eldest grandson of Kim Eung-hwan, is presumed to have appreciated the paintings depicted in the nature of Album of Complete Views of Seas and Mountains, which had been passed down within the family, and newly transformed them. Furthermore, the contents and narrative styles of Yi Yu-won's writings attached to the paintings in the Handscroll of Pungak Mountain are similar to those of the fifty-one writings in Kim Eunghwan's album. This suggests a possible influence of the inscriptions in Kim Eung-hwan's album or the original texts from which these inscriptions were quoted upon the writings in Kim Ha-jong's handscroll. However, a closer examination will be needed to determine the order of the transcription of the writings. The Album of Complete View of Seas and Mountains differs from Kim Hong-do's paintings of his official trips and other painting albums he influenced. This album is a siginificant artwork in that it broadens the understanding of the art world of Kim Eung-hwan and illustrates another layer of real scenery landscape paintings in the late eighteenth century.