• Title/Summary/Keyword: self-occlusion

Search Result 78, Processing Time 0.024 seconds

Robust AAM-based Face Tracking with Occlusion Using SIFT Features (SIFT 특징을 이용하여 중첩상황에 강인한 AAM 기반 얼굴 추적)

  • Eom, Sung-Eun;Jang, Jun-Su
    • The KIPS Transactions:PartB
    • /
    • v.17B no.5
    • /
    • pp.355-362
    • /
    • 2010
  • Face tracking is to estimate the motion of a non-rigid face together with a rigid head in 3D, and plays important roles in higher levels such as face/facial expression/emotion recognition. In this paper, we propose an AAM-based face tracking algorithm. AAM has been widely used to segment and track deformable objects, but there are still many difficulties. Particularly, it often tends to diverge or converge into local minima when a target object is self-occluded, partially or completely occluded. To address this problem, we utilize the scale invariant feature transform (SIFT). SIFT is an effective method for self and partial occlusion because it is able to find correspondence between feature points under partial loss. And it enables an AAM to continue to track without re-initialization in complete occlusions thanks to the good performance of global matching. We also register and use the SIFT features extracted from multi-view face images during tracking to effectively track a face across large pose changes. Our proposed algorithm is validated by comparing other algorithms under the above 3 kinds of occlusions.

CHANGES OF DENTAL OCCLUSION AFTER STROKE: CASE REPORT (뇌졸중 이후의 교합관계의 변화 증례)

  • Lee, Sung-Jong;Lee, Eun-Young;Kim, Hye-Jung;Hwang, Ji-Young;Lee, Jae-Ho
    • The Journal of Korea Assosiation for Disability and Oral Health
    • /
    • v.4 no.1
    • /
    • pp.26-31
    • /
    • 2008
  • Cerebrovascular Accident(stroke) is that a sudden, nonconvulsive loss of neurologic function due to an ischemic or hemorrhagic intracranial vascular event. If stroke happens at the portion of trigeminal motor nucleus or its control part of cerebral cortex, masticatory muscles will be atrophy or paralyzed. So it is possible that dental occlusion changes after stroke. A 74-aged woman recurred mild stroke 2 month ago, who had experienced severe stroke 2 years ago. After recurrence, suddenly her upper full denture was dropped when lower denture contacted upper one. According to the her occlusion exam, her lower jaw moved back slightly compared with the occlusion of old denture. And her face had asymmetry and lower jaw dislocated to paralyzed side. A 50-aged man was treated because many cervical caries, which would occur because of an aftereffect of stroke, long-herm hospitalization and limits of self oral-care. 6 years ago he had cerebral hemorrhage and he claimed that he cannot bite exactly. Just two pairs of teeth was contact on biting, his lower jaw was located back, too. This two case suggests that dental occlusion can change after stroke.

  • PDF

Multi-Image Stereo Method Using DEM Fusion Technique (DEM 융합 기법을 이용한 다중영상스테레오 방법)

  • Lim Sung-Min;Woo Dong-Min
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.52 no.4
    • /
    • pp.212-222
    • /
    • 2003
  • The ability to efficiently and robustly recover accurate 3D terrain models from sets of stereoscopic images is important to many civilian and military applications. A stereo matching has been an important tool for reconstructing three dimensional terrain. However, there exist many factors causing stereo matching error, such as occlusion, no feature or repetitive pattern in the correlation window, intensity variation, etc. Among them, occlusion can be only resolved by true multi-image stereo. In this paper, we present multi-image stereo method using DEM fusion as one of efficient and reliable true multi-image methods. Elevations generated by all pairs of images are combined by the fusion process which accepts an accurate elevation and rejects an outlier. We propose three fusion schemes: THD(Thresholding), BPS(Best Pair Selection) and MS(Median Selection). THD averages elevations after rejecting outliers by thresholding, while BPS selects the most reliable elevation. To determine the reliability of a elevation or detect the outlier, we employ the measure of self-consistency. The last scheme, MS, selects the median value of elevations. We test the effectiveness of the proposed methods with a quantitative analysis using simulated images. Experimental results indicate that all three fusion schemes showed much better improvement over the conventional binocular stereo in natural terrain of 29 Palms and urban site of Avenches.

Semantic Occlusion Augmentation for Effective Human Pose Estimation (가려진 사람의 자세추정을 위한 의미론적 폐색현상 증강기법)

  • Hyun-Jae, Bae;Jin-Pyung, Kim;Jee-Hyong, Lee
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.11 no.12
    • /
    • pp.517-524
    • /
    • 2022
  • Human pose estimation is a method of estimating a posture by extracting a human joint key point. When occlusion occurs, the joint key point extraction performance is lowered because the human joint is covered. The occlusion phenomenon is largely divided into three types of actions: self-contained, covered by other objects, and covered by background. In this paper, we propose an effective posture estimation method using a masking phenomenon enhancement technique. Although the posture estimation method has been continuously studied, research on the occlusion phenomenon of the posture estimation method is relatively insufficient. To solve this problem, the author proposes a data augmentation technique that intentionally masks human joints. The experimental results in this paper show that the intentional use of the blocking phenomenon enhancement technique is strong against the blocking phenomenon and the performance is increased.

Real-time Human Pose Estimation using RGB-D images and Deep Learning

  • Rim, Beanbonyka;Sung, Nak-Jun;Ma, Jun;Choi, Yoo-Joo;Hong, Min
    • Journal of Internet Computing and Services
    • /
    • v.21 no.3
    • /
    • pp.113-121
    • /
    • 2020
  • Human Pose Estimation (HPE) which localizes the human body joints becomes a high potential for high-level applications in the field of computer vision. The main challenges of HPE in real-time are occlusion, illumination change and diversity of pose appearance. The single RGB image is fed into HPE framework in order to reduce the computation cost by using depth-independent device such as a common camera, webcam, or phone cam. However, HPE based on the single RGB is not able to solve the above challenges due to inherent characteristics of color or texture. On the other hand, depth information which is fed into HPE framework and detects the human body parts in 3D coordinates can be usefully used to solve the above challenges. However, the depth information-based HPE requires the depth-dependent device which has space constraint and is cost consuming. Especially, the result of depth information-based HPE is less reliable due to the requirement of pose initialization and less stabilization of frame tracking. Therefore, this paper proposes a new method of HPE which is robust in estimating self-occlusion. There are many human parts which can be occluded by other body parts. However, this paper focuses only on head self-occlusion. The new method is a combination of the RGB image-based HPE framework and the depth information-based HPE framework. We evaluated the performance of the proposed method by COCO Object Keypoint Similarity library. By taking an advantage of RGB image-based HPE method and depth information-based HPE method, our HPE method based on RGB-D achieved the mAP of 0.903 and mAR of 0.938. It proved that our method outperforms the RGB-based HPE and the depth-based HPE.

A Multi-Scale Parallel Convolutional Neural Network Based Intelligent Human Identification Using Face Information

  • Li, Chen;Liang, Mengti;Song, Wei;Xiao, Ke
    • Journal of Information Processing Systems
    • /
    • v.14 no.6
    • /
    • pp.1494-1507
    • /
    • 2018
  • Intelligent human identification using face information has been the research hotspot ranging from Internet of Things (IoT) application, intelligent self-service bank, intelligent surveillance to public safety and intelligent access control. Since 2D face images are usually captured from a long distance in an unconstrained environment, to fully exploit this advantage and make human recognition appropriate for wider intelligent applications with higher security and convenience, the key difficulties here include gray scale change caused by illumination variance, occlusion caused by glasses, hair or scarf, self-occlusion and deformation caused by pose or expression variation. To conquer these, many solutions have been proposed. However, most of them only improve recognition performance under one influence factor, which still cannot meet the real face recognition scenario. In this paper we propose a multi-scale parallel convolutional neural network architecture to extract deep robust facial features with high discriminative ability. Abundant experiments are conducted on CMU-PIE, extended FERET and AR database. And the experiment results show that the proposed algorithm exhibits excellent discriminative ability compared with other existing algorithms.

Management of Temporomandibular disorder (측두하악장애의 치료)

  • Jung, Da-Woon;Chung, A-Young;Kim, Seong-Taek
    • Journal of Dental Rehabilitation and Applied Science
    • /
    • v.28 no.4
    • /
    • pp.441-452
    • /
    • 2012
  • Most of signs and symptoms of temporomandibular disorder(TMD) is temporary and self-limiting as other musculoskeletal diseases. Conservative, reversible treatment; self care, behavior modification, physical therapy, pharmacotherapy, splint therapy should be considered as initial treatment for temporomandibular disorder rather than non conservative, irreversible treatment.

Comparison of the shear bond strength of self-etching dentin bonding agents to dentin (자가부식형 상아질 접착제와 상아질과의 전단결합강도 비교)

  • Noh, Su-Jeong;Kim, Bu-Sub;Chung, In-Sung
    • Journal of Technologic Dentistry
    • /
    • v.29 no.2
    • /
    • pp.141-150
    • /
    • 2007
  • The purpose of this study was to ascertain the bonding durability of self-etching dentin bonding agents to dentin by means of shear bonding strength. Several acid-etching dentin bonding system (ESPE Z100) and self-etching dentin bonding systems (DEN-FIL, GRADIA DIRET) were used. The occlusion surface of human molars were ground flat to expose dentin and treated with the etch bonding system according to manufactures instruction and followed by composite resin application. After 24hours of storage at 37$^{\circ}C$, the shear bonding strength of the specimens was measured in a universal testing machine with a 1mm/min crosshead speed. An one-way analysis of variance and the scheffe test were performed to identify significant differences (p<0.05). The bonded interfacial surfaces and treated dentin surfaces were examined using a SEM. Through the analysis of shear bond strength data and micro-structures of dentin-resin interfaces, following results are obtained. In dentin group, the shear bond strength of DEN-FIL showed statistical superiority in comparison to the other groups and followed by ESPE Z100 and GRADIA DIRECT (p<0.05).

  • PDF

Inadvertent Self-Detachment of Solitaire AB Stent during the Mechanical Thrombectomy for Recanalization of Acute Ischemic Stroke : Lessons Learned from the Removal of Stent via Surgical Embolectomy

  • Kang, Dong-Hun;Park, Jaechan;Hwang, Yang-Ha;Kim, Yong-Sun
    • Journal of Korean Neurosurgical Society
    • /
    • v.53 no.6
    • /
    • pp.360-363
    • /
    • 2013
  • We recently experienced self-detachment of the Solitaire stent during mechanical thrombectomy of acute ischemic stroke. Then, we tried to remove the detached stent and to recanalize the occlusion, but failed with endovascular means. The following diffusion weighted image MRI revealed no significant increase in infarction size, therefore, we performed surgical removal of the stent to rescue the patient and to elucidate the reason why the self-detachment occurred. Based upon the operative findings, the stent grabbed the main thrombi but inadvertently detached at a severely tortuous, acutely angled, and circumferentially calcified segment of the internal carotid artery. Postoperative angiography demonstrated complete recanalization of the internal carotid artery. The patient's neurological deficits gradually improved, and the modified Rankin scale score was 2 at three months after surgery. In the retrospective case review, bone window images of the baseline computed tomography (CT) scan corresponded to the operative findings. According to this finding, we hypothesized that bone window images of a baseline CT scan can play a role in terms of anticipating difficult stent retrieval before the procedure.

DEM Estimation Using Two Stage Stereo Matching Method (2단계 스테레오 정합기법을 이용한 DEM 추정)

  • Nam, Chang-Woo;Woo, Dong-Min
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.49 no.12
    • /
    • pp.659-666
    • /
    • 2000
  • A stereo matching has been an important tool for reconstructing three dimensional terrain. By using stereo matching technique, DEM(Digital Elevaton Map) can be generated by the disparity from a reference image to a target image. Generally disparity map can be evaluated by matching the reference image to the target image and if the role of the reference and the target are interchanged, a different DEM can be obtained. In this paper, we propose a new fusion technique to estimate the optimal DEM by eliminating the false DEM due to occlusion. To detect the false DEM, we utilize two measure of accuracy: self-consistency and cross-correlation score. We test the effectiveness of the proposed methods with a quantitative analysis using simulated images. Experimental result indicate that the proposed methods show 24.4% and 33.1% improvement over either DEM.

  • PDF