• 제목/요약/키워드: ToF camera

검색결과 219건 처리시간 0.025초

Artificial Neural Network Method Based on Convolution to Efficiently Extract the DoF Embodied in Images

  • Kim, Jong-Hyun
    • 한국컴퓨터정보학회논문지
    • /
    • 제26권3호
    • /
    • pp.51-57
    • /
    • 2021
  • 본 논문에서는 카메라의 포커싱과 아웃포커싱에 의해 이미지에서 뿌옇게 표현되는 피사계 심도(Depth of field, DoF) 영역을 효율적인 합성곱 신경망을 통해 찾는 방법을 제안한다. 우리의 접근 방식은 RGB채널기반의 상호-상관 필터를 이용하여 DoF영역을 이미지로부터 효율적으로 분류하고, 합성곱 신경망 네트워크에 학습하기 위한 데이터를 구축하며, 이렇게 얻어진 데이터를 이용하여 이미지-DoF가중치 맵 데이터 쌍을 설정한다. 학습할 때 사용되는 데이터는 이미지와 상호-상관 필터 기반으로 추출된 DoF 가중치 맵을 이용하며, 네트워크 학습 단계에서 수렴률을 높이기 위해 스무딩을 과정을 한번 더 적용한 결과를 사용한다. 테스트 결과로 얻은 DoF 가중치 이미지는 입력 이미지에서 DoF영역을 안정적으로 찾아내며, 제안하는 방법은 DoF영역을 사용자의 ROI(Region of interest)로 활용하여 NPR렌더링, 객체 검출 등 다양한 곳에 활용이 가능하다.

로봇 축구 대회를 위한 마이크로 로봇 시스템의 개발 (The development of a micro robot system for robot soccer game)

  • 이수호;김경훈;김주곤;조형석
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1996년도 한국자동제어학술회의논문집(국내학술편); 포항공과대학교, 포항; 24-26 Oct. 1996
    • /
    • pp.507-510
    • /
    • 1996
  • In this paper we present the multi-agent robot system developed for participating in micro robot soccer tournament. The multi-agent robot system consists of micro robot, a vision system, a host computer and a communication module. Mcro robot are equipped with two mini DC motors with encoders and gearboxes, a R/F receiver, a CPU and infrared sensors for obstacle detection. A vision system is used to recognize the position of the ball and opponent robots, position and orientation of our robots. The vision system is composed of a color CCD camera and a vision processing unit. Host computer is a Pentium PC, and it receives information from the vision system, generates commands for each robot using a robot management algorithm and transmits commands to the robots by the R/F communication module. And in order to achieve a given mission in micro robot soccer game, cooperative behaviors by robots are essential. Cooperative work between individual agents is achieved by the command of host computer.

  • PDF

영상 기반 강아지의 이상 행동 탐지 (Camera-based Dog Unwanted Behavior Detection)

  • 오스만;이종욱;박대희;정용화
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2019년도 춘계학술발표대회
    • /
    • pp.419-422
    • /
    • 2019
  • The recent increase in single-person households and family income has led to an increase in the number of pet owners. However, due to the owners' difficulty to communicate with them for 24 hours, pets, and especially dogs, tend to display unwanted behavior that can be harmful to themselves and their environment when left alone. Therefore, detecting those behaviors when the owner is absent is necessary to suppress them and prevent any damage. In this paper, we propose a camera-based system that detects a set of normal and unwanted behaviors using deep learning algorithms to monitor dogs when left alone at home. The frames collected from the camera are arranged into sequences of RGB frames and their corresponding optical flow sequences, and then features are extracted from each data flow using pre-trained VGG-16 models. The extracted features from each sequence are concatenated and input to a bi-directional LSTM network that classifies the dog action into one of the targeted classes. The experimental results show that our method achieves a good performance exceeding 0.9 in precision, recall and f-1 score.

Deep learning based Person Re-identification with RGB-D sensors

  • Kim, Min;Park, Dong-Hyun
    • 한국컴퓨터정보학회논문지
    • /
    • 제26권3호
    • /
    • pp.35-42
    • /
    • 2021
  • 본 연구에서는 3차원 RGB-D Xtion2 카메라를 이용하여 보행자의 골격좌표를 추출한 결과를 바탕으로 동적인 특성(속도, 가속도)을 함께 고려하여 딥러닝 모델을 통해 사람을 인식하는 방법을 제안한다. 본 논문의 핵심목표는 RGB-D 카메라로 손쉽게 좌표를 추출하고 새롭게 생성한 동적인 특성을 기반으로 자체 고안한 1차원 합성곱 신경망 분류기 모델(1D-ConvNet)을 통해 자동으로 보행 패턴을 파악하는 것이다. 1D-ConvNet의 인식 정확도와 동적인 특성이 정확도에 미치는 영향을 알아보기 위한 실험을 수행하였다. 정확도는 F1 Score를 기준으로 측정하였고, 동적인 특성을 고려한 분류기 모델(JCSpeed)과 고려하지 않은 분류기 모델(JC)의 정확도 비교를 통해 영향력을 측정하였다. 그 결과 동적인 특성을 고려한 경우의 분류기 모델이 그렇지 않은 경우보다 F1 Score가 약 8% 높게 나타났다.

Monitoring concrete bridge decks using infrared thermography with high speed vehicles

  • Hiasa, Shuhei;Catbas, F. Necati;Matsumoto, Masato;Mitani, Koji
    • Structural Monitoring and Maintenance
    • /
    • 제3권3호
    • /
    • pp.277-296
    • /
    • 2016
  • There is a need for rapid and objective assessment of concrete bridge decks for maintenance decision making. Infrared Thermography (IRT) has great potential to identify deck delaminations more objectively than routine visual inspections or chain drag tests. In addition, it is possible to collect reliable data rapidly with appropriate IRT cameras attached to vehicles and the data are analyzed effectively. This research compares three infrared cameras with different specifications at different times and speeds for data collection, and explores several factors affecting the utilization of IRT in regards to subsurface damage detection in concrete structures, specifically when the IRT is utilized for high-speed bridge deck inspection at normal driving speeds. These results show that IRT can detect up to 2.54 cm delamination from the concrete surface at any time period. It is observed that nighttime would be the most suitable time frame with less false detections and interferences from the sunlight and less adverse effect due to direct sunlight, making more "noise" for the IRT results. This study also revealed two important factors of camera specifications for high-speed inspection by IRT as shorter integration time and higher pixel resolution.

Vision-based support in the characterization of superelastic U-shaped SMA elements

  • Casciati, F.;Casciati, S.;Colnaghi, A.;Faravelli, L.;Rosadini, L.;Zhu, S.
    • Smart Structures and Systems
    • /
    • 제24권5호
    • /
    • pp.641-648
    • /
    • 2019
  • The authors investigate the feasibility of applying a vision-based displacement-measurement technique in the characterization of a SMA damper recently introduced in the literature. The experimental campaign tests a steel frame on a uni-axial shaking table driven by sinusoidal signals in the frequency range from 1Hz to 5Hz. Three different cameras are used to collect the images, namely an industrial camera and two commercial smartphones. The achieved results are compared. The camera showing the better performance is then used to test the same frame after its base isolation. U-shaped, shape-memory-alloy (SMA) elements are installed as dampers at the isolation level. The accelerations of the shaking table and those of the frame basement are measured by accelerometers. A system of markers is glued on these system components, as well as along the U-shaped elements serving as dampers. The different phases of the test are discussed, in the attempt to obtain as much possible information on the behavior of the SMA elements. Several tests were carried out until the thinner U-shaped element went to failure.

파라쿼트 농도에 따른 HepG2 세포의 물리적 특성 변화와 실시간 모폴로지 관찰 (Physical Property and Morphology Observation of HepG2 Cells by Various Concentration of Paraquat)

  • 이동윤;강현욱;;권영수
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2009년도 제40회 하계학술대회
    • /
    • pp.1232_1233
    • /
    • 2009
  • Paraquat is well-known to cause hepatotoxic responses in human and other mammal species. In solution, it forms free radicals and charge-transfer complex of which formation plays an important role in determination of its biological activity in the presence of various anions. The HepG2 cells were cultured onto a quartz crystal sensor which is possible to detect the density and a viscosity changes using the resonance frequency (F) and the resonance resistance (R). The plot of F-R diagram is able to explain the rheological change of cells onto the surface of the quartz crystal sensor. In this paper, we investigated the physical properties of the HepG2 cells cultured onto a ITO electrode of the quartz crystal sensor according to the paraquat injection at various concentrations (100 mM, 10 mM, 1 mM). We also observed the morphological changes with a micro CCD camera, simultaneously. The HepG2 cells were cultured onto the ITO electrode surface of the quartz crystal modified a collagen film in $CO_2$ incubator. After the paraquat injection, we observed the changes of the morphologies by the micro CCD camera depending on time and analyzed the physical changes of cells on the electrode surface of quartz crystal using F-R diagram. From all results, we proved the effect of paraquat at various concentrations which is led to an apoptosis such as weakening and death of the cells by oxidation and reduction reaction that were produced the superoxide anions and other free radicals.

  • PDF

돈사용 환기팬을 위한 돈사 내 온도 분포 특성 (Characteristics of Temperature Distribution of Pen for Exhaust Fan of Ventilation System)

  • 김현태;김웅
    • 한국축산시설환경학회지
    • /
    • 제20권4호
    • /
    • pp.155-160
    • /
    • 2014
  • This study was researched for use by data for the improvement of ventilation system of optimum environmental control systems. The ventilation system for windowless swine housing was installed negative pressure system that circular pipe duct for inlet was installed on the ceiling and axial flow fan for exhaust was installed on the sidewall. The temperatures in the pen was measured using infrared thermography camera and thermocouple with data-logger. The temperature measurement points was selected by infrared thermography camera is alley (G), inlet (A), front-upper (B), front-lower (C), rear-upper (D), rear-lower (E), forward fan (F). The temperature measured at those selected points for temperature distribution was $28^{\circ}C$ that was maintained setting temperature in suitably. The temperature deviations of F point and A~E points in windowless swine housing was less then average $0.5^{\circ}C$. The result of air velocity of measured points was suitable to the breeding of pigs.

스마트폰으로 검출된 객체의 음성합성 시스템 (Speech Synthesis System for Detected Objects by Smart Phone)

  • 권순각
    • 한국멀티미디어학회논문지
    • /
    • 제19권2호
    • /
    • pp.469-478
    • /
    • 2016
  • This paper designs an application for detecting various objects using a smart phone with camera sensor, then implements the application that detects the number of faces in front of a user by using the Face API provided by android and generates a speech to the user. For implementing the application, the GoF strategy pattern is applied to design the application. It provides some advantages; first, the algorithm development schedule can separate the whole application development schedule; next, it makes easier to add the algorithm. For example, another detecting algorithm for the other objects (character, motion detection) that may be developed in the future, or it may be replaced by a more high-performance algorithm. With the propose method, a general smart phone can make some advantages that can provide information of various objects (such as moving people and objects, and detected character from signboards) to the person who is visually impaired.

Automation for Oyster Hinge Breaking System

  • So, J.D.;Wheaton, F.W.
    • 한국농업기계학회:학술대회논문집
    • /
    • 한국농업기계학회 1996년도 International Conference on Agricultural Machinery Engineering Proceedings
    • /
    • pp.658-667
    • /
    • 1996
  • A computer vision system was developed to automatically detect and locate the oyster hinge line, one step in shucking an oyster. The computer vision system consisted of a personal computer, a color frame grabber, a color CCD video camera with a zoom lens, two video monitor, a specially designed fixture to hold the oyster, a lighting system to illuminate the oyster and the system software. The software consisted of a combination of commercially available programs and custom designed programs developed using the Microsoft CTM . Test results showed that the image resolution was the most important variable influencing hinge detection efficiency. Whether or not the trimmed -off-flat-white surface area was dry or wet, the oyster size relative to the image size selected , and the image processing methods used all influenced the hinge locating efficiency. The best computer software and hardware combination used successfully located 97% of the oyster hinge lines tested. This efficienc was achieve using camera field of view of 1.9 by 1.5cm , a 180 by 170 pixel image window, and a dry trimmed -off oyster hinge end surface.

  • PDF