• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2004.05b
• /
• pp.603-607
• /
• 2004

The vision-based driver fatigue detection is one of the most prospective commercial applications of facial expression recognition technology. The facial feature tracking is the primary technique issue in it. Current facial tracking technology faces three challenges: (1) detection failure of some or all of features due to a variety of lighting conditions and head motions; (2) multiple and non-rigid object tracking and (3) features occlusion when the head is in oblique angles. In this paper, we propose a new active approach. First, the active IR sensor is used to robustly detect pupils under variable lighting conditions. The detected pupils are then used to predict the head motion. Furthermore, face movement is assumed to be locally smooth so that a facial feature can be tracked with a Kalman filter. The simultaneous use of the pupil constraint and the Kalman filtering greatly increases the prediction accuracy for each feature position. Feature detection is accomplished in the Gabor space with respect to the vicinity of predicted location. Local graphs consisting of identified features are extracted and used to capture the spatial relationship among detected features. Finally, a graph-based reliability propagation is proposed to tackle the occlusion problem and verify the tracking results. The experimental results show validity of our active approach to real-life facial tracking under variable lighting conditions, head orientations, and facial expressions.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.2
• /
• pp.39-46
• /
• 2023

We present an efficient packet transmission strategy for massively multiplayer online first-person shooter (MMOFPS) games using movement-adaptive packet transmission interval. The player motion in FPS games shows a wide spectrum of movement variability both in speed and orientation, where there is room for reducing the number of packets to be transmitted to the server depending on the predictability of the character's movement. In this work, the degree of variability (nonlinearity) of the player movements is measured at every packet transmission to calculate the next transmission time, which implements the adaptive transmission frequency according to the amount of movement change. Server-side prediction with a few auxiliary heuristics is performed in concert with the incoming packets to ensure reliability for synchronizing the connected clients. The comparison of our method with the previous fixed-interval transmission scheme is presented by demonstrating them using a test game environment.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.18 no.3
• /
• pp.35-41
• /
• 2018

In this paper, we define a haptic rendering algorithm for a situation that has collision between static object and single object. We classified video scenes into four categories which can be easily seen in video sequence. The proposed algorithm can detect which frame is suitable for haptic rendering by detecting the change of direction using motion estimation and change of shape using object tracking. As a result, a total of 13 frames are extracted from the sample video and playing time of these frames were calculated. We confirmed that the haptic effect appears in expected playing time by adding the appropriate haptic generating waveform thtough the haptic editing program.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.11a
• /
• pp.191-194
• /
• 2009

본 논문에서는 효율적인 다시점 비디오 부호화를 위해 히스토그램(histogram)을 이용한 다시점 비디오의 휘도(luminance)와 색차(chrominance)성분 보상 기법을 제안한다. 다시점 비디오는 카메라의 기하학적인 위치 차이와 여러 대의 카메라가 동일한 특성을 가지도록 완벽히 조정되지 못함으로 인해 동일한 시간대에 촬영된 인접한 시점 영상 간에 휘도와 색상의 차이가 발생할 수 있다. 이러한 특성은 인접한 카메라로부터 획득된 영상을 참조하여 시점간 움직임 예측 시에 오정합의 원인이 되어 부호화 효율을 떨어뜨리게 된다. 본 논문에서는 효율적인 다시점 비디오 부호화를 위해 시점간의 히스토그램을 비교하여 정합하는 휘도 및 색차 보상 기법을 수행한다. 일정한 시간 대역(time interval)에서 다시점 비디오의 평균 누적 히스토그램을 이용하여 참조 영상을 생성하고 각 시점별로 정합 함수를 통해 다시점 영상 간의 휘도와 색상의 불일치성을 보상한다. 제안하는 조명 보상 기법을 통하여 다시점 비디오 부호화 효율을 높일 수 있었다.

• The Journal of the Korea Contents Association
• /
• v.18 no.4
• /
• pp.164-177
• /
• 2018

As the market for IoT devices grows, it is expected that the scale of malware attack will be considerable. Accordingly, the improvement of related legislation has been actively promoted, the recently strengthened Information and Communication Network Act was enforced. Because IoT related accidents can lead to not only financial damages but also human accidents, IoT device Security has been attracted a great deal of attention. In this paper, IoT devices provide essential security functions through legal and technical perspectives, and analyze related technologies. This can be used to a reference for the Start-up developer and IoT device designer.

• Proceedings of the Korean Information Science Society Conference
• /
• 2007.10d
• /
• pp.435-439
• /
• 2007

최근 저가형 이미지 센서 기술의 발전과 무선 센서 네트워크기술의 발전으로 인해 WMSN(Wireless Multimedia Sensor Networks) 기술이 활발히 연구되고 있다. WMSN은 기존의 무선 센서 네트워크 기술에 멀티미디어 컨텐츠를 센싱하고 전송 및 처리하는 기반기술을 포함한다. 멀티미디어 컨텐츠는 많은 데이터 가지므로 이를 처리하기 위해서는 많은 계산량과 데이터 전송량을 필요로 하게 된다. 저사양의 센서 노드에서 멀티미디어 컨텐츠를 수용하기 위해서는 에너지 소모를 고려한 압축 기법 및 효율적인 전송에 대한 연구가 필요하다. 본 논문에서는 무선 센서 네트워크에서 이미지를 효율적으로 압축하고 전송하기 위하여 웨이블릿의 Resolution Scalability 특성을 이용한 4가지 움직임 보상/예측 기법을 제안한다. 이를 지원하기 위해 시스템에서 사용하는 각 압축 기법들의 조합에 따른 압축 성능이 적절함을 알아보았다.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.41 no.6
• /
• pp.165-173
• /
• 2004

H.264 is the newest international video coding standard that provides high coding efficiency. A macroblock in H.264 has 7 different motion-compensation block sizes in the Inter mode, and several different prediction directions in the Intra mode. In order to achieve as highest coding efficiency as possible, H.264 reference model employs complex mode decision technique based on rate-distortion (RD) optimization which requires high computational complexity. In this paper, we propose two techniques -'early SKIP mode decision' and 'selective intra mode decision' - which can further reduce the computational complexity. Simulation results show that without considerable performance degradation, the proposed methods reduce encoding time by 30% on average and save the number of computing rate-distortion cost by 72%.

• Journal of Institute of Control, Robotics and Systems
• /
• v.16 no.10
• /
• pp.927-932
• /
• 2010

Estimation methods of motion intention from bio-signal present challenges in man machine interaction(MMI) to offer user's command to machine without control of any devices. Measurements of meaningful bio-signals that contain the motion intention and motion estimation methods from bio-signal are important issues for accurate and safe interaction. This paper proposes a novel motion estimation sensor based on a geometrical muscle changes, and a motion estimation method using the sensor. For estimation of the motion, we measure the circumference change of the muscle which is proportional to muscle activation level using a flexible piezoelectric cable (pMAS, piezo muscle activation sensor), designed in band type. The pMAS measures variations of the cable band that originate from circumference changes of muscle bundles. Moreover, we estimate the elbow motion by applying the sensor to upper limb with least square method. The proposed sensor and prediction method are simple to use so that they can be used to motion prediction device and methods in rehabilitation and sports fields.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.9 no.2
• /
• pp.81-86
• /
• 2014

In the scalable video coding standard, inter-layer prediction based on the coding information of the base layer was adopted to increase the coding performance. This prediction tool results in new syntax elements called motion_prediction_flag (mPF) and residul_prediction_flag(rPF), which are carried to notify the motion vector predictor (MVP) and reference block required in the motion compensation of the decoder. In this paper, an efficient coding method for mPF is proposed to enhance coding efficiency of the salable video coding standard. Through an analysis on the transmission of mPF based on the relationship between the MVPs, we discover the conditions where mPF is unnecessary at the decoder and suggest a modified rate-distortion (RD) cost function to make RD optimization more effective. Simulation results show that the proposed method offers BD rate savings of approximately 1.4%, compared with the conventional SVC standard.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2013.11a
• /
• pp.161-164
• /
• 2013

본 논문에서는 다양한 멀티미디어 코덱을 고속으로 처리하기 위하여 전용하드웨어가 아닌 병렬 어레이 프로세서 기반의 U-Chip(Universal-Chip) 구조를 제안하고 TSMC 80nm 공정을 사용하여 11,865,090개의 게이트 수를 가지는 칩으로 개발하였다. U-Chip은 역양자화(IQ), 역변환(IT), 움직임 보상(MC) 연산을 위한 $4{\times}16$ 개의 프로세싱 유닛으로 구성된 병렬 어레이 프로세서와 문맥적응적 가변길이디코딩(CAVLC)을 위한 비트스트림 프로세서와 인트라 예측(IP), 디블록킹필터(DF) 연산을 위한 순차 프로세서와 DMAC의 데이터 전송 및 각 프로세서를 제어하여 병렬 파이프라인 스케쥴링을 처리하는 시퀀서 프로세서 등으로 구성된다. 1개의 프로세싱 유닛에 1개의 매크로블록 데이터를 맵핑하여 총 64개의 매크로블록을 병렬처리 하였다. 64개 매크로블록의 대용량 데이터 전송 시간과 각 프로세서들의 연산을 동시에 병렬 파이프라인 함으로서 전체 연산 성능을 높일 수 있는 이점이 있다. 병렬 파이프라인 구조의 H.264 디코더 프로그램을 개발하였고 제작된 U-Chip을 통해 $720{\times}480$ 크기의 베이스라인 프로파일 영상에 대하여 코어 192MHz 동작, DDR 메모리 96MHz 동작에서 30fps의 처리율을 가짐을 확인하였다.