• The Journal of the Korea Contents Association
• /
• v.13 no.12
• /
• pp.575-584
• /
• 2013

Data types used for big-data analysis are very widely, such as news, blog, SNS, papers, patents, sensed data, and etc. Particularly, the utilization of web documents offering reliable data in real time is increasing gradually. And web crawlers that collect web documents automatically have grown in importance because big-data is being used in many different fields and web data are growing exponentially every year. However, existing web crawlers can't collect whole web documents in a web site because existing web crawlers collect web documents with only URLs included in web documents collected in some web sites. Also, existing web crawlers can collect web documents collected by other web crawlers already because information about web documents collected in each web crawler isn't efficiently managed between web crawlers. Therefore, this paper proposed a distributed web crawler. To resolve the problems of existing web crawler, the proposed web crawler collects web documents by RSS of each web site and Google search API. And the web crawler provides fast crawling performance by a client-server model based on RMI and NIO that minimize network traffic. Furthermore, the web crawler extracts core content from a web document by a keyword similarity comparison on tags included in a web documents. Finally, to verify the superiority of our web crawler, we compare our web crawler with existing web crawlers in various experiments.

• Journal of Korean Society of Environmental Engineers
• /
• v.34 no.12
• /
• pp.863-870
• /
• 2012

The market trends of automatic meter reading associated with smart water meters were investigated. Also, recent developments and field applications of key technology for automatic meter reading associated with smart water meters were analyzed. Smart water meters have been manufactured mostly in United States and Europe and have been expanded their business to Asia. Integrated water management system combining with the additional functions such as real-time consumption metering, cost notification, water conservation, leak detection, water quality monitoring, and flow control have been operated in automatic meter reading. Both water quality and quantity data measured from smart water meters and sensors were transferred to data concentration units through neighborhood area network, and then were transferred to integrated server through wide area network. The data transfer methods were determined by comprehensively considering urban scale, density of smart water meters, power supply and network topologies. Common data collection methods such as fixed network to data concentation units, vehicles drive by, people walk by, and drone fly by have been applied. The automatic meter reading associated with smart water meters are spread throughout the world, and both water and energy savings result in saving the money and reducing the greenhouse gases emission.

• The KIPS Transactions:PartD
• /
• v.14D no.3 s.113
• /
• pp.355-362
• /
• 2007

With development of mobile communications terminal and expansion of mobile Internet, a large number of users can use mobile web contents at anytime and anywhere and will demand service of greater contents. Due to such demand, many studies are being carried out on transcoding contents so that wired web contents can be used in mobile web. However, transcoding and creation of mobile web contents involve difficulties because specifications available from telecommunications companies and mobile terminals have not been standardized. Especially, in order for serving dynamic object of wired web page contents to dynamically change according to time or user, it is required not only to program scripts to suit each terminal, but also to transcode the resources used in advance. for solution to this problem, this study uses the hierarchy structure of DOM (document object model) to display structural characteristics of wired web page. In other words, this study proposes the following technique. Wired web pages are analyzed and the results are established as data structure. Then, dynamic object is extracted and the domain is indexed so that, when serving mobile web page, information can be extracted at the indexed position to create mobile web contents for service on real-time basis. Also, this study aims at developing an editing device to edit mobile web contents and mobile web service server to service the edited contents by applying the above technique.

• Spatial Information Research
• /
• v.20 no.1
• /
• pp.91-103
• /
• 2012

Recently, there has been much interest in the middleware that can smoothly acquire and analyze Geosensor information which includes sensor readings, location, and its surrounding spatial information. In relation to development of the middleware, researchers have proposed various algorithms for energy-efficient information filtering in Geosensor networks and have proposed Geosensor web technologies which can efficiently mash up sensor readings with spatial information on the web, also. The filtering algorithms and Geosensor Web technologies have contributions on energy-efficiency and OpenAPI, however the algorithms and technologies could not support easy and rapid development of u-GIS applications that need various Geosensor networks. Therefore, we propose a new Geosensor network middleware that can dramatically reduce the time and cost required for development of u-GIS applications that integrate heterogeneous Geosensor networks. The proposed middleware has several merits of being capable of acquiring heterogeneous Geosensor information using the standard SWE and an extended SQL, optimally performing various attribute and spatial operators, and easily integrating various Geosensor networks. Finally, we clarify our middleware's distinguished features by developing a prototype that can monitor environmental information in realtime using spatial information and various sensor readings of temperature, humidity, illumination, imagery, and location.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.46 no.4
• /
• pp.28-38
• /
• 2009

In this study, a remote air quality monitoring system for underground spaces was developed by using NDIR-based CO$_2$ sensor. And the remote monitoring system based on wireless sensor networks was installed practically on the subway station platform. More than 6.5 million citizens commutate everyday by the Seoul subway transportation that is the most typical public transportation. They concern about air quality with increasing interest on public health or many workers in subway stations or underground shopping centers. Recently, the Korean Ministry of Environment has operated the air quality monitoring system in some subway stations for testing phase. However, it showed many defects which are large-scale, high-cost and maintenance of precision sensors imported from abroad. Therefore this research includes the reliability test and a theoretical study about the inexpensive commercialized CO$_2$ sensor for reliable measurement of air quality which changes rapidly by the surrounding environments. And then we develop the wireless sensor nodes and the gateway applied for remote air quality monitoring. In addition, web server program was realized to manage air quality in the subway platform. This result will be valuable for a basic research for air quality management in underground spaces for future study.

• 전자공학회논문지 IE
• /
• v.49 no.1
• /
• pp.12-17
• /
• 2012

Fast development of ubiquitous technology prompted the broadening of the related application area. Application of ubiquitous techniques and system into the construction sites may give us many benefits. There are always a lot of hazard situations in construction sites, and the falling is known to have the high accident rate. To prevent the falling, there has been a lot of efforts including safety education and use of safety gears. In this study, we designed, fabricated and tested a system that can monitor the worker's safety and location informations in real time by using the wireless technology of TOA and RSSI. We used ATmegal28 that is popular in the industrial equipments as MCU and NanoPan 5357 module from Nanotron and CC2500 chipset from TI for radio circuits. We also used 3-axis accelerometer and pressure MEMS sensors to obtain the environmental information, and therefore to aquire the informations of the worker's movement and altitude. We used Labview software from National Instrument to monitor and control the system. We developed the system to send the warning alarms to the server operator and the workers when the workers in the danger zone did not wear the safety hook.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2007.10a
• /
• pp.441-444
• /
• 2007

In present, physical distribution industry fields are offering more convenient services using RFID, but there is plenty of room for improvement. And then, utilizing advantages of RFID which quick and simple manages goods and GPS which gets information of position at the present, we implemented a physical distribution management system can manages the information for distribution process of goods easier. We can get much information that the number of loaded goods, the data of goods, the state of distribution, whether or not missing, etc. as attached a RFID reader to the truck. and when truck is moving, we can also obtain much information consumer want that the real time data of position, distribution routes, etc. for loaded goods as received a latitude and longitude from GPS. These information have recorded, managed, and linked Google map, we can grasp the distribution information of goods on World Wide Web service. Because this service is focus on the image not the text can give the information required by the consumer on visual, it is different from the existing service. At this point of time that the RFID and GPS have used in overall industry, If these services have researched and developed with transportation, tour, etc. industry as well as physical distribution, it is possible to utilize more widely.

• Korean Journal of Agricultural and Forest Meteorology
• /
• v.22 no.3
• /
• pp.117-127
• /
• 2020

The Early Warning System for agrometeorological hazard of the Rural Development Administration (Korea) forecasts detailed weather for each farm based on the meteorological information provided by the Korea Meteorological Administration, and estimates the growth of crops and predicts a meteorological hazard that can occur during the growing period by using the estimated detailed meteorological information. For verification of early warning system, automated weather observation network was constructed in the study area. Moreover, a real-time web display system was built to deliver near real-time weather data collected from the observation network. The meteorological observation system collected diverse meteorological variables including temperature, humidity, solar radiation, rainfall, soil moisture, sunshine duration, wind velocity, and wind direction. These elements were collected every minute and transmitted to the server every ten minutes. The data display system is composed of three phases: the first phase builds a database of meteorological data collected from the meteorological observation system every minute; the second phase statistically analyzes the collected meteorological data at ten-minutes, one-hour, or one-day time step; and the third phase displays the collected and analyzed meteorological data on the web. The meteorological data collected in the database can be inquired through the webpage for all data points or one data point in the unit of one minute, ten minutes, one hour, or one day. Moreover, the data can be downloaded in CSV format.

• Journal of the Institute of Electronics Engineers of Korea TC
• /
• v.47 no.10
• /
• pp.17-26
• /
• 2010

This is concerned with the technology to monitor the vehicle operation, failure and disorder by using WiBro portable device. More precisely, the technology makes it possible that the information collection device is connected to both ECU(Electronic Control Unit) which is the device for controlling engine, transmission, brake, air-bag, etc that are connected to in-vehicle network and OBD-II connector that is for data collection from various sensors. In addition, with a WiBro portable device (cell phone, PDA, PMP, UMPC, etc). equipped with a vehicle diagnostic programs, information for operation, failure and malfunction can be obtained and analyzed in real-time, and alarm is alerted when the vehicle is in abnormal status, which makes the early reactions to the status. Furthermore, the collected data can be sent through WiBro network to the server managed by the company specialized in managing the vehicles, thus the technology could help the drivers who have less knowledge about their auto-vehicles have safe and economic driving. There is always a possibility of malfunction due to various types of noise that are caused by wring-harness when the device is wired-connected. In this research, in order to overcome this problem, we propose a system configuration that can do monitoring and diagnosis with a device for collecting data from vehicle and a personal WiBro device. Also, we performed research on data acquisition and interlock for the system defined by the definition for information and data sharing platform.

• Spatial Information Research
• /
• v.9 no.2
• /
• pp.239-261
• /
• 2001

A large suite of official statistical data sets has been compiled for geographical units under the national directives, and it is the quantitative regional analysis procedures that could add values to them. This paper reports our attempts at prototyping a statistical GIS which is capable of serving over the Web a variety of regional analysis routines as well as value-added statistics and maps. A pilot database of some major statistical data was ingested for the city of Seoul. The baseline subset of regional analysis methods of practical usage was selected and accommodated into the business logic of the target system, which ranges from descriptive statistics, regional structure/inequality measures, spatial ANOVA, spatial (auto) correlation to regression and residual analysis. The leading-edge information technologies including the application server were adopted in the system design and implementation so that the database, analysis modules and analytic mapping components may cooperate seamlessly behind the Web front-end. The prototyped system supports tables, maps, and files of downloadable format for input and output of the analyses. One of the most salient features of out proposed system is that both the database and analysis modules are extensible via the bi-directional interface for end users; The system provides users with operators and parsers for algebraic formulae such that the stored statistical variables may be transformed and combined into the newly-derived set of variables. This functionality eventually leads to on-the-fly fabrication of user-defined regional analysis algorithms. The stored dataset may also be temporarily augmented by user-uploaded dataset; The extension of this form, in essence, results in a virtual database which awaits for users commands as usual. An initial evaluation of the proposed system confirms that the issues involving the usage and dissemination of information can be addressed with success.