• Title/Summary/Keyword: long memory process

Search Result 161, Processing Time 0.028 seconds

An Optimization of Hashing Mechanism for the DHP Association Rules Mining Algorithm (DHP 연관 규칙 탐사 알고리즘을 위한 해싱 메커니즘 최적화)

  • Lee, Hyung-Bong;Kwon, Ki-Hyeon
    • Journal of the Korea Society of Computer and Information
    • /
    • v.15 no.8
    • /
    • pp.13-21
    • /
    • 2010
  • One of the most distinguished features of the DHP association rules mining algorithm is that it counts the support of hash key combinations composed of k items at phase k-1, and uses the counted support for pruning candidate large itemsets to improve performance. At this time, it is desirable for each hash key combination to have a separate count variable, where it is impossible to allocate the variables owing to memory shortage. So, the algorithm uses a direct hashing mechanism in which several hash key combinations conflict and are counted in a same hash bucket. But the direct hashing mechanism is not efficient because the distribution of hash key combinations is unvalanced by the characteristics sourced from the mining process. This paper proposes a mapped perfect hashing function which maps the region of hash key combinations into a continuous integer space for phase 3 and maximizes the efficiency of direct hashing mechanism. The results of a performance test experimented on 42 test data sets shows that the average performance improvement of the proposed hashing mechanism is 7.3% compared to the existing method, and the highest performance improvement is 16.9%. Also, it shows that the proposed method is more efficient in case the length of transactions or large itemsets are long or the number of total items is large.

Real-time PM10 Concentration Prediction LSTM Model based on IoT Streaming Sensor data (IoT 스트리밍 센서 데이터에 기반한 실시간 PM10 농도 예측 LSTM 모델)

  • Kim, Sam-Keun;Oh, Tack-Il
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.11
    • /
    • pp.310-318
    • /
    • 2018
  • Recently, the importance of big data analysis is increasing as a large amount of data is generated by various devices connected to the Internet with the advent of Internet of Things (IoT). Especially, it is necessary to analyze various large-scale IoT streaming sensor data generated in real time and provide various services through new meaningful prediction. This paper proposes a real-time indoor PM10 concentration prediction LSTM model based on streaming data generated from IoT sensor using AWS. We also construct a real-time indoor PM10 concentration prediction service based on the proposed model. Data used in the paper is streaming data collected from the PM10 IoT sensor for 24 hours. This time series data is converted into sequence data consisting of 30 consecutive values from time series data for use as input data of LSTM. The LSTM model is learned through a sliding window process of moving to the immediately adjacent dataset. In order to improve the performance of the model, incremental learning method is applied to the streaming data collected every 24 hours. The linear regression and recurrent neural networks (RNN) models are compared to evaluate the performance of LSTM model. Experimental results show that the proposed LSTM prediction model has 700% improvement over linear regression and 140% improvement over RNN model for its performance level.

Radar rainfall prediction based on deep learning considering temporal consistency (시간 연속성을 고려한 딥러닝 기반 레이더 강우예측)

  • Shin, Hongjoon;Yoon, Seongsim;Choi, Jaemin
    • Journal of Korea Water Resources Association
    • /
    • v.54 no.5
    • /
    • pp.301-309
    • /
    • 2021
  • In this study, we tried to improve the performance of the existing U-net-based deep learning rainfall prediction model, which can weaken the meaning of time series order. For this, ConvLSTM2D U-Net structure model considering temporal consistency of data was applied, and we evaluated accuracy of the ConvLSTM2D U-Net model using a RainNet model and an extrapolation-based advection model. In addition, we tried to improve the uncertainty in the model training process by performing learning not only with a single model but also with 10 ensemble models. The trained neural network rainfall prediction model was optimized to generate 10-minute advance prediction data using four consecutive data of the past 30 minutes from the present. The results of deep learning rainfall prediction models are difficult to identify schematically distinct differences, but with ConvLSTM2D U-Net, the magnitude of the prediction error is the smallest and the location of rainfall is relatively accurate. In particular, the ensemble ConvLSTM2D U-Net showed high CSI, low MAE, and a narrow error range, and predicted rainfall more accurately and stable prediction performance than other models. However, the prediction performance for a specific point was very low compared to the prediction performance for the entire area, and the deep learning rainfall prediction model also had limitations. Through this study, it was confirmed that the ConvLSTM2D U-Net neural network structure to account for the change of time could increase the prediction accuracy, but there is still a limitation of the convolution deep neural network model due to spatial smoothing in the strong rainfall region or detailed rainfall prediction.

Prediction of Music Generation on Time Series Using Bi-LSTM Model (Bi-LSTM 모델을 이용한 음악 생성 시계열 예측)

  • Kwangjin, Kim;Chilwoo, Lee
    • Smart Media Journal
    • /
    • v.11 no.10
    • /
    • pp.65-75
    • /
    • 2022
  • Deep learning is used as a creative tool that could overcome the limitations of existing analysis models and generate various types of results such as text, image, and music. In this paper, we propose a method necessary to preprocess audio data using the Niko's MIDI Pack sound source file as a data set and to generate music using Bi-LSTM. Based on the generated root note, the hidden layers are composed of multi-layers to create a new note suitable for the musical composition, and an attention mechanism is applied to the output gate of the decoder to apply the weight of the factors that affect the data input from the encoder. Setting variables such as loss function and optimization method are applied as parameters for improving the LSTM model. The proposed model is a multi-channel Bi-LSTM with attention that applies notes pitch generated from separating treble clef and bass clef, length of notes, rests, length of rests, and chords to improve the efficiency and prediction of MIDI deep learning process. The results of the learning generate a sound that matches the development of music scale distinct from noise, and we are aiming to contribute to generating a harmonistic stable music.

A case study on Urban Regeneration utilizing Community Cinema from Japan: Focused on Fukaya Cinema (일본 커뮤니티 시네마를 활용한 도시재생 사례 연구 - 후카야 시네마(深谷シネマ)를 중심으로 -)

  • Park, Dong-Ho
    • Korean Association of Arts Management
    • /
    • no.49
    • /
    • pp.149-176
    • /
    • 2019
  • It is a known fact that the spread of multiplexes has contributed to movie industry flourish and extending public rights for enjoying movies. However, in terms of Urban Discourse, Multiplexes centered in new downtown have given rise to Doughnut Phenomena in old downtown. It is especially regrettable that the local theaters which have been symbolic cultural spaces storing the 'memory of life' of local communities are disappearing due to a recession of business zone in old downtown. Japan has long been worked in various activities spotlighting on movie/image contents as the major means of creative urban regeneration. Among them, the 'Community Cinema' has made a contribution to regional revitalization by improving movie screening environment of the local community through renewal of local theaters and further creating related culture and industry in the local area. In this study, I focus on 'Fukaya Cinema' which started from NPO(Non-Profit Organization) and reused a closed industrial facility to a movie theater in cooperation with local TMO(Town Management Organization). Fukaya Cinema, which operates in the form of a business community, plays important roles as the core cultural facility in the local community and is regarded as a significant case showing a possibility of urban regeneration using movie/image contents. I investigate the specific founding process and activities of Fukaya Cinema and intend to derive the implications from that. Through this, I aim to provide the basic urban regeneration data utilizing movie/media contents.

A Symbolic Characteristic of Mimetic Words in Published Cartoon: Focusing on Works of Heo, Young Man (허영만의 작품에서 나타난 효과태의 상징어적 특징과 활용)

  • O, Yul Seok;Yoon, Ki Heon
    • Cartoon and Animation Studies
    • /
    • s.30
    • /
    • pp.169-199
    • /
    • 2013
  • In various directions of cartoon, vertical stroll direction is opposite to the page direction of existing published cartoon with the popularity of webtoon and established new genre. Lots of studies on published cartoon focus on the cut direction by page, but webtoon doesn't have any concept of page. The pivot of cartoon oriented people is changed from paper to computer monitor as times go by, characteristics of media are changed and media is gradually diversified. Like the strengthening of mobile caused by smart phone's popularity, tablet PC's propagation in public education, etc. cartoon is included to the environment of media which is rapidly changed. In this situation, one of cartoon's unchanged important identities can be the direction made by harmony between picture and text. This thesis analyzed symbolic characteristics and effective value of hyogwatae, mimetic words of cartoon, focusing on works of Heo, Young Man. Hyogwatae just delivers not only sound but also shape, feeling, status, etc. and has significant characteristics by invoking the imaginary structure of literature. Strengths of modern Korean, various linguistic expressions and syllabic systems, let people feel minute feeling of language and difference of emotion and remember the memory through the direct and indirect experiences, so it makes it nuance. Because of the characteristics, representative works of Heo, Young Man have commercialization and writer characteristics, have communicated with people for a long time and have plentiful knowledge of Korean cartoon. The characteristics of hyogwatae in Heo, Young Man's cartoon make a lot of effects for the expression and delivery of cartoon more than the general expectation. When conducting the study focusing on the symbolic process of language, uncertainty and vague standard of judgement caused by the wide factors of study on the direction of general cartoon could be endured. And, through the Heo, Young Man's deep analysis on hyogwatae's direction, readers enjoy the process while inferring actually and intellectually between pictures and sentences. In the process, the equipment stimulating imagination more than pictures, effects and dialogues is hyogwatae. It's reader's equipment of active participation and its strength is symbolic structure.

'The Same Scenery' and 'a Different Landscape' Included in "Real-Scenery Landscape Painting", an Essay to Determine Meaning - Centering around Paintings of Chong Seok Jeong in the 18th-19th Centuries - (실경산수화에 담긴 '같은 경관' 그러나 '다른 풍경', 그 의미 찾기 - 18.19C 총석정 그림을 중심으로 -)

  • Rho, Jae-Hyun;Jang, Il-Young
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.36 no.5
    • /
    • pp.82-93
    • /
    • 2008
  • This research focused on the process in which 'the same scenery' is recognized and represented as 'a different landscape' to determine the symbols and meaning of the scenery and landscape included in real-scenery landscape paintings of the 18th-19th centuries. As a result of analyzing the visual points, the content and expressions of 25 real-scenery landscape paintings of Chong Seok Jeong(叢石亭), it can be seen that the transmission of a kind of semiotic landscape on the basis of a specific symbol was accomplished naturally through imitation and representation for the purpose of the expression of Chong Seok Jeong-like idealized scenery. This shows that the unique images of Chong Seok Jeong have long been passed down after taking root as a unique benchmark The meaningful symbol of 'a strange Saseonbong(四仙峰)', which is broken by the spray after rising high, and 'a pine forest' have both been transmitted as being in the manner of Chong Seok Jeong. This has been equipped with the stereo-type scene by being a collective symbolization as the psycho-scenes in memory element of Chong Seok Jeong. Through the pictures of both Gyeomjae(謙齋) and Danweon(檀園), the process by which a specific painter's pictures become acculturated is highly interesting. The scenery expressed in these pictures was clearly that of a landscape of which its particularly emotions and remembrances were repainted through the experience of several places and original sketches. This can be explained as the concept in which the image from 'a specific scenery' gained through actual experience, that is, a personal feeling, has been expressed. The picture that was expressed as a different figure even at the same visual point for the same scenery is the result that was redefined through the scenery subject's recognition. Also, the modification of the scenery object can be colorful through meditation and Sachu(邪推: guessing with wicked doubt). The scenery recognized newly through adoption, omission and emphasis, it is 'the specific scenery' in the heart and is a figure having been more similar to 'a landscape' if the objective life reproduction before being acculturated is a figure similar to the scenery. So, the concept looks like being very persuasive that 'the nature with objectivity captured sensuously' simply is the scenery, and that 'the subjective phenomenon having acquired the cultural nature by being introspected in the method of aesthetic nostalgia is a landscape'.

Improving Bidirectional LSTM-CRF model Of Sequence Tagging by using Ontology knowledge based feature (온톨로지 지식 기반 특성치를 활용한 Bidirectional LSTM-CRF 모델의 시퀀스 태깅 성능 향상에 관한 연구)

  • Jin, Seunghee;Jang, Heewon;Kim, Wooju
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.1
    • /
    • pp.253-266
    • /
    • 2018
  • This paper proposes a methodology applying sequence tagging methodology to improve the performance of NER(Named Entity Recognition) used in QA system. In order to retrieve the correct answers stored in the database, it is necessary to switch the user's query into a language of the database such as SQL(Structured Query Language). Then, the computer can recognize the language of the user. This is the process of identifying the class or data name contained in the database. The method of retrieving the words contained in the query in the existing database and recognizing the object does not identify the homophone and the word phrases because it does not consider the context of the user's query. If there are multiple search results, all of them are returned as a result, so there can be many interpretations on the query and the time complexity for the calculation becomes large. To overcome these, this study aims to solve this problem by reflecting the contextual meaning of the query using Bidirectional LSTM-CRF. Also we tried to solve the disadvantages of the neural network model which can't identify the untrained words by using ontology knowledge based feature. Experiments were conducted on the ontology knowledge base of music domain and the performance was evaluated. In order to accurately evaluate the performance of the L-Bidirectional LSTM-CRF proposed in this study, we experimented with converting the words included in the learned query into untrained words in order to test whether the words were included in the database but correctly identified the untrained words. As a result, it was possible to recognize objects considering the context and can recognize the untrained words without re-training the L-Bidirectional LSTM-CRF mode, and it is confirmed that the performance of the object recognition as a whole is improved.

A Study on Risk Parity Asset Allocation Model with XGBoos (XGBoost를 활용한 리스크패리티 자산배분 모형에 관한 연구)

  • Kim, Younghoon;Choi, HeungSik;Kim, SunWoong
    • Journal of Intelligence and Information Systems
    • /
    • v.26 no.1
    • /
    • pp.135-149
    • /
    • 2020
  • Artificial intelligences are changing world. Financial market is also not an exception. Robo-Advisor is actively being developed, making up the weakness of traditional asset allocation methods and replacing the parts that are difficult for the traditional methods. It makes automated investment decisions with artificial intelligence algorithms and is used with various asset allocation models such as mean-variance model, Black-Litterman model and risk parity model. Risk parity model is a typical risk-based asset allocation model which is focused on the volatility of assets. It avoids investment risk structurally. So it has stability in the management of large size fund and it has been widely used in financial field. XGBoost model is a parallel tree-boosting method. It is an optimized gradient boosting model designed to be highly efficient and flexible. It not only makes billions of examples in limited memory environments but is also very fast to learn compared to traditional boosting methods. It is frequently used in various fields of data analysis and has a lot of advantages. So in this study, we propose a new asset allocation model that combines risk parity model and XGBoost machine learning model. This model uses XGBoost to predict the risk of assets and applies the predictive risk to the process of covariance estimation. There are estimated errors between the estimation period and the actual investment period because the optimized asset allocation model estimates the proportion of investments based on historical data. these estimated errors adversely affect the optimized portfolio performance. This study aims to improve the stability and portfolio performance of the model by predicting the volatility of the next investment period and reducing estimated errors of optimized asset allocation model. As a result, it narrows the gap between theory and practice and proposes a more advanced asset allocation model. In this study, we used the Korean stock market price data for a total of 17 years from 2003 to 2019 for the empirical test of the suggested model. The data sets are specifically composed of energy, finance, IT, industrial, material, telecommunication, utility, consumer, health care and staple sectors. We accumulated the value of prediction using moving-window method by 1,000 in-sample and 20 out-of-sample, so we produced a total of 154 rebalancing back-testing results. We analyzed portfolio performance in terms of cumulative rate of return and got a lot of sample data because of long period results. Comparing with traditional risk parity model, this experiment recorded improvements in both cumulative yield and reduction of estimated errors. The total cumulative return is 45.748%, about 5% higher than that of risk parity model and also the estimated errors are reduced in 9 out of 10 industry sectors. The reduction of estimated errors increases stability of the model and makes it easy to apply in practical investment. The results of the experiment showed improvement of portfolio performance by reducing the estimated errors of the optimized asset allocation model. Many financial models and asset allocation models are limited in practical investment because of the most fundamental question of whether the past characteristics of assets will continue into the future in the changing financial market. However, this study not only takes advantage of traditional asset allocation models, but also supplements the limitations of traditional methods and increases stability by predicting the risks of assets with the latest algorithm. There are various studies on parametric estimation methods to reduce the estimated errors in the portfolio optimization. We also suggested a new method to reduce estimated errors in optimized asset allocation model using machine learning. So this study is meaningful in that it proposes an advanced artificial intelligence asset allocation model for the fast-developing financial markets.

Application of MicroPACS Using the Open Source (Open Source를 이용한 MicroPACS의 구성과 활용)

  • You, Yeon-Wook;Kim, Yong-Keun;Kim, Yeong-Seok;Won, Woo-Jae;Kim, Tae-Sung;Kim, Seok-Ki
    • The Korean Journal of Nuclear Medicine Technology
    • /
    • v.13 no.1
    • /
    • pp.51-56
    • /
    • 2009
  • Purpose: Recently, most hospitals are introducing the PACS system and use of the system continues to expand. But small-scaled PACS called MicroPACS has already been in use through open source programs. The aim of this study is to prove utility of operating a MicroPACS, as a substitute back-up device for conventional storage media like CDs and DVDs, in addition to the full-PACS already in use. This study contains the way of setting up a MicroPACS with open source programs and assessment of its storage capability, stability, compatibility and performance of operations such as "retrieve", "query". Materials and Methods: 1. To start with, we searched open source software to correspond with the following standards to establish MicroPACS, (1) It must be available in Windows Operating System. (2) It must be free ware. (3) It must be compatible with PET/CT scanner. (4) It must be easy to use. (5) It must not be limited of storage capacity. (6) It must have DICOM supporting. 2. (1) To evaluate availability of data storage, we compared the time spent to back up data in the open source software with the optical discs (CDs and DVD-RAMs), and we also compared the time needed to retrieve data with the system and with optical discs respectively. (2) To estimate work efficiency, we measured the time spent to find data in CDs, DVD-RAMs and MicroPACS. 7 technologists participated in this study. 3. In order to evaluate stability of the software, we examined whether there is a data loss during the system is maintained for a year. Comparison object; How many errors occurred in randomly selected data of 500 CDs. Result: 1. We chose the Conquest DICOM Server among 11 open source software used MySQL as a database management system. 2. (1) Comparison of back up and retrieval time (min) showed the result of the following: DVD-RAM (5.13,2.26)/Conquest DICOM Server (1.49,1.19) by GE DSTE (p<0.001), CD (6.12,3.61)/Conquest (0.82,2.23) by GE DLS (p<0.001), CD (5.88,3.25)/Conquest (1.05,2.06) by SIEMENS. (2) The wasted time (sec) to find some data is as follows: CD ($156{\pm}46$), DVD-RAM ($115{\pm}21$) and Conquest DICOM Server ($13{\pm}6$). 3. There was no data loss (0%) for a year and it was stored 12741 PET/CT studies in 1.81 TB memory. In case of CDs, On the other hand, 14 errors among 500 CDs (2.8%) is generated. Conclusions: We found that MicroPACS could be set up with the open source software and its performance was excellent. The system built with open source proved more efficient and more robust than back-up process using CDs or DVD-RAMs. We believe that the operation of the MicroPACS would be effective data storage device as long as its operators develop and systematize it.

  • PDF