• Title/Summary/Keyword: Vision Based Sensor

Search Result 428, Processing Time 0.024 seconds

Research of the Delivery Autonomy and Vision-based Landing Algorithm for Last-Mile Service using a UAV (무인기를 이용한 Last-Mile 서비스를 위한 배송 자동화 및 영상기반 착륙 알고리즘 연구)

  • Hanseob Lee;Hoon Jung
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.46 no.2
    • /
    • pp.160-167
    • /
    • 2023
  • This study focuses on the development of a Last-Mile delivery service using unmanned vehicles to deliver goods directly to the end consumer utilizing drones to perform autonomous delivery missions and an image-based precision landing algorithm for handoff to a robot in an intermediate facility. As the logistics market continues to grow rapidly, parcel volumes increase exponentially each year. However, due to low delivery fees, the workload of delivery personnel is increasing, resulting in a decrease in the quality of delivery services. To address this issue, the research team conducted a study on a Last-Mile delivery service using unmanned vehicles and conducted research on the necessary technologies for drone-based goods transportation in this paper. The flight scenario begins with the drone carrying the goods from a pickup location to the rooftop of a building where the final delivery destination is located. There is a handoff facility on the rooftop of the building, and a marker on the roof must be accurately landed upon. The mission is complete once the goods are delivered and the drone returns to its original location. The research team developed a mission planning algorithm to perform the above scenario automatically and constructed an algorithm to recognize the marker through a camera sensor and achieve a precision landing. The performance of the developed system has been verified through multiple trial operations within ETRI.

The development of pH reading system based on vision system (영상 기반 pH 산도 측정 시스템 개발)

  • Moon, Ha-Jung;Lee, Dong-Hoon
    • Journal of IKEEE
    • /
    • v.17 no.4
    • /
    • pp.398-406
    • /
    • 2013
  • Nuclear medicine imaging devices such as PET diagnose disease after injecting radiopharmaceuticals in human body for diagnosis. Radiopharmaceuticals should maintain the proper pH for human body safety. In general, pH paper is used to measure the pH of the radiopharmaceutical. pH of the sample compared with the standard color chart is used for measurement. However, the pH reading difference according to the experience of a rater can be generated. Also, a pH meter for measuring pH has a high sensitivity and contamination of the sensor must be avoided. In this paper, we developed the new hardware device for pH reading method and software was developed with vision algorithm to measure pH easily and simply.

Comparing State Representation Techniques for Reinforcement Learning in Autonomous Driving (자율주행 차량 시뮬레이션에서의 강화학습을 위한 상태표현 성능 비교)

  • Jihwan Ahn;Taesoo Kwon
    • Journal of the Korea Computer Graphics Society
    • /
    • v.30 no.3
    • /
    • pp.109-123
    • /
    • 2024
  • Research into vision-based end-to-end autonomous driving systems utilizing deep learning and reinforcement learning has been steadily increasing. These systems typically encode continuous and high-dimensional vehicle states, such as location, velocity, orientation, and sensor data, into latent features, which are then decoded into a vehicular control policy. The complexity of urban driving environments necessitates the use of state representation learning through networks like Variational Autoencoders (VAEs) or Convolutional Neural Networks (CNNs). This paper analyzes the impact of different image state encoding methods on reinforcement learning performance in autonomous driving. Experiments were conducted in the CARLA simulator using RGB images and semantically segmented images captured by the vehicle's front camera. These images were encoded using VAE and Vision Transformer (ViT) networks. The study examines how these networks influence the agents' learning outcomes and experimentally demonstrates the role of each state representation technique in enhancing the learning efficiency and decision- making capabilities of autonomous driving systems.

One-way Short-range Communication using Channel Symbol of Color Light Signal based on USN environment (USN 환경에서 색 광신호를 채널 부호화한 단거리 단방향 통신)

  • Lee, Gong;Jeon, Young-Jun;Shin, Seung-Ho
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.34 no.4C
    • /
    • pp.437-445
    • /
    • 2009
  • Node of USN(Ubiquitous Sensor Network) environments uses radio based communication mechanism for a delivering message. Thus the multiple hop flooding is necessary for considering limited power and communicating unknown node long-range. However if there are many unknown nodes located in users' vision, the flooding of the radio base is insufficient alternative. Thus as a flash may be used to find a key in a darkness, a more direct and short range communication system is required. This study shall resolve such question through 2 different steps. First a Two kind of code method that convert Text message to color code shall be suggested. Second a hardware module, which may deliver various LED(light-emitting diode) color signal, shall be developed. The experiment may take place by fixing the entry angle of light and distance by setting a specific element as a standard mean.

RealBook: A Tangible Electronic Book Based on the Interface of TouchFace-V (RealBook: TouchFace-V 인터페이스 기반 실감형 전자책)

  • Song, Dae-Hyeon;Bae, Ki-Tae;Lee, Chil-Woo
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.12
    • /
    • pp.551-559
    • /
    • 2013
  • In this paper, we proposed a tangible RealBook based on the interface of TouchFace-V which is able to recognize multi-touch and hand gesture. The TouchFace-V is applied projection technology on a flat surface such as table, without constraint of space. The system's configuration is addressed installation, calibration, and portability issues that are most existing front-projected vision-based tabletop display. It can provide hand touch and gesture applying computer vision by adopting tracking technology without sensor and traditional input device. The RealBook deals with the combination of each advantage of analog sensibility on texts and multimedia effects of e-book. Also, it provides digitally created stories that would differ in experiences and environments with interacting users' choices on the interface of the book. We proposed e-book that is new concept of electronic book; named RealBook, different from existing and TouchFace-V interface, which can provide more direct viewing, natural and intuitive interactions with hand touch and gesture.

A Short-term Dynamic Displacement Estimation Method for Civil Infrastructures (사회기반 건설구조물의 단기 동적변위 산정기법)

  • Choi, Jaemook;Chung, Junyeon;Koo, Gunhee;Kim, Kiyoung;Sohn, Hoon
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.30 no.3
    • /
    • pp.249-254
    • /
    • 2017
  • The paper presents a new short-term dynamic displacement estimation method based on an acceleration and a geophone sensor. The proposed method combines acceleration and velocity measurements through a real time data fusion algorithm based on Kalman filter. The proposed method can estimate the displacement of a structure without displacement sensors, which is typically difficult to be applied to earthquake or fire sites due to their requirement of a fixed rigid support. The proposed method double-integrates the acceleration measurement recursively, and corrects an accumulated integration error based on the velocity measurement, The performance of the proposed method was verified by a lab-scale test, in which displacement estimated by the proposed method are compared to a reference displacement measured by laser doppler vibrometer (LDV).

Design for Back-up of Ship's Navigation System using UAV in Radio Frequency Interference Environment (전파간섭환경에서 UAV를 활용한 선박의 백업항법시스템 설계)

  • Park, Sul Gee;Son, Pyo-Woong
    • Journal of Advanced Navigation Technology
    • /
    • v.23 no.4
    • /
    • pp.289-295
    • /
    • 2019
  • Maritime back-up navigation system in port approach requires a horizontal accuracy of 10 meters in IALA (International Association of Lighthouse Authorities) recommendations. eLoran which is a best back-up navigation system that satisfies accuracy requirement has poor navigation performance depending signal environments. Especially, noise caused by multipath and electronic devices around eLoran antenna affects navigation performance. In this paper, Ship based Navigation Back-up system using UAV on Interference is designed to satisfy horizontal accuracy requirement. To improve the eLoran signal environment, UAVs are equipped with camera, IMU sensor and eLoran antenna and receivers. This proposed system is designed to receive eLoran signal through UAV-based receiver and control UAV's position and attitude within Landmark around area. The ship-based positioning using eLoran signal, vision and attitude information received from UAV satisfy resilient and robust navigation requirements.

Determination and evaluation of dynamic properties for structures using UAV-based video and computer vision system

  • Rithy Prak;Ji Ho Park;Sanggi Jeong;Arum Jang;Min Jae Park;Thomas H.-K. Kang;Young K. Ju
    • Computers and Concrete
    • /
    • v.31 no.5
    • /
    • pp.457-468
    • /
    • 2023
  • Buildings, bridges, and dams are examples of civil infrastructure that play an important role in public life. These structures are prone to structural variations over time as a result of external forces that might disrupt the operation of the structures, cause structural integrity issues, and raise safety concerns for the occupants. Therefore, monitoring the state of a structure, also known as structural health monitoring (SHM), is essential. Owing to the emergence of the fourth industrial revolution, next-generation sensors, such as wireless sensors, UAVs, and video cameras, have recently been utilized to improve the quality and efficiency of building forensics. This study presents a method that uses a target-based system to estimate the dynamic displacement and its corresponding dynamic properties of structures using UAV-based video. A laboratory experiment was performed to verify the tracking technique using a shaking table to excite an SDOF specimen and comparing the results between a laser distance sensor, accelerometer, and fixed camera. Then a field test was conducted to validate the proposed framework. One target marker is placed on the specimen, and another marker is attached to the ground, which serves as a stationary reference to account for the undesired UAV movement. The results from the UAV and stationary camera displayed a root mean square (RMS) error of 2.02% for the displacement, and after post-processing the displacement data using an OMA method, the identified natural frequency and damping ratio showed significant accuracy and similarities. The findings illustrate the capabilities and reliabilities of the methodology using UAV to evaluate the dynamic properties of structures.

Drowsy Driving Detection Algorithm Using a Steering Angle Sensor And State of the Vehicle (조향각센서와 차량상태를 이용한 졸음운전 판단 알고리즘)

  • Moon, Byoung-Joon;Yeon, Kyu-Bong;Lee, Sun-Geol;Hong, Seung-Pyo;Nam, Sang-Yep;Kim, Dong-Han
    • 전자공학회논문지 IE
    • /
    • v.49 no.2
    • /
    • pp.30-39
    • /
    • 2012
  • An effective drowsy driver detection system is needed, because the probability of accident is high for drowsy driving and its severity is high at the time of accident. However, the drowsy driver detection system that uses bio-signals or vision is difficult to be utilized due to high cost. Thus, this paper proposes a drowsy driver detection algorithm by using steering angle sensor, which is attached to the most of vehicles at no additional cost, and vehicle information such as brake switch, throttle position signal, and vehicle speed. The proposed algorithm is based on jerk criterion, which is one of drowsy driver's steering patterns. In this paper, threshold value of each variable is presented and the proposed algorithm is evaluated by using acquired vehicle data from hardware in the loop simulation (HILS) through CAN communication and MATLAB program.

A Remote Control of 6 d.o.f. Robot Arm Based on 2D Vision Sensor (2D 영상센서 기반 6축 로봇 팔 원격제어)

  • Hyun, Woong-Keun
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.17 no.5
    • /
    • pp.933-940
    • /
    • 2022
  • In this paper, the algorithm was developed to recognize hand 3D position through 2D image sensor and implemented a system to remotely control the 6 d.o.f. robot arm by using it. The system consists of a camera that acquires hand position in 2D, a computer that controls robot arm that performs movement by hand position recognition. The image sensor recognizes the specific color of the glove putting on operator's hand and outputs the recognized range and position by including the color area of the glove as a shape of rectangle. We recognize the velocity vector of end effector and control the robot arm by the output data of the position and size of the detected rectangle. Through the several experiments using developed 6 axis robot, it was confirmed that the 6 d.o.f. robot arm remote control was successfully performed.