• Title/Summary/Keyword: Batch processing

Search Result 292, Processing Time 0.026 seconds

Analyzing the Impact of Multivariate Inputs on Deep Learning-Based Reservoir Level Prediction and Approaches for Mid to Long-Term Forecasting (다변량 입력이 딥러닝 기반 저수율 예측에 미치는 영향 분석과 중장기 예측 방안)

  • Hyeseung Park;Jongwook Yoon;Hojun Lee;Hyunho Yang
    • The Transactions of the Korea Information Processing Society
    • /
    • v.13 no.4
    • /
    • pp.199-207
    • /
    • 2024
  • Local reservoirs are crucial sources for agricultural water supply, necessitating stable water level management to prepare for extreme climate conditions such as droughts. Water level prediction is significantly influenced by local climate characteristics, such as localized rainfall, as well as seasonal factors including cropping times, making it essential to understand the correlation between input and output data as much as selecting an appropriate prediction model. In this study, extensive multivariate data from over 400 reservoirs in Jeollabuk-do from 1991 to 2022 was utilized to train and validate a water level prediction model that comprehensively reflects the complex hydrological and climatological environmental factors of each reservoir, and to analyze the impact of each input feature on the prediction performance of water levels. Instead of focusing on improvements in water level performance through neural network structures, the study adopts a basic Feedforward Neural Network composed of fully connected layers, batch normalization, dropout, and activation functions, focusing on the correlation between multivariate input data and prediction performance. Additionally, most existing studies only present short-term prediction performance on a daily basis, which is not suitable for practical environments that require medium to long-term predictions, such as 10 days or a month. Therefore, this study measured the water level prediction performance up to one month ahead through a recursive method that uses daily prediction values as the next input. The experiment identified performance changes according to the prediction period and analyzed the impact of each input feature on the overall performance based on an Ablation study.

Effects of High Molecular Hardwood Lignin on Anaerobic Digestion at Different Temperatures and Sludge Concentrations (혐기성 소화에 미치는 온도와 슬러지의 농도별 고분자 활엽수 리그닌의 영향)

  • Yin, Cheng-Ri;Seo, Dong-Il;Lee, Sung-Taik;Jin, Yin-Shu
    • Journal of Korean Society of Environmental Engineers
    • /
    • v.22 no.12
    • /
    • pp.2197-2204
    • /
    • 2000
  • Lignin is a major component of wastewater generated in the chemical processing of wood. Because it is recalcitrant, it inhibits biological treatment of wastewater of pulp manufacturing, especially high concentration of lignin may inhibit the anaerobic digestion. The objective of this study was to evaluate the toxicity of high molecular hardwood lignin (lignosulfonate, MW $\geq$ 20,000) on aceticlastic methanogens in the batch reactors at different temperatures with different sludge concentrations, using anaerobic serum bottles. The hardwood lignin was found to inhibit anaerobic conversion of acetate to methane and carbon dioxide, shown with a long lag-phase before methanogenesis started. The methanogens assumed not to be able to acclimate to the lignin were found to be acclimated slowly in the batch experiments, finally reaching non-toxic levels in which methane production could start. The hardwood lignin was found not to be bacteriocidal but bacteriostatic to aceticlastic methanogens. Hardwood lignin(lignosulfonate) at 1.3, 2.6, and 3.9%(w/w) inhibited the acetateutilizing methanogens of anaerobic digester sludge by 14.5, 17.8, 21.1 days(in noninhibitory condition it took 10 days) to produce the same amount of methane. The inhibitory effect of lignin was examined at temperature ranges of $30^{\circ}C$ to $50^{\circ}C$. When 2.6% of lignin was contained in wastewater, methane production was highest at $30^{\circ}C$ during initial 8 days. At $4^{\circ}C$, methane production rapidly increased after 12 days of digestion, the value became higher than that at $30^{\circ}C$ after 14 days. However, the methane production was completely inhibited during whole digestion period at $50^{\circ}C$. High ratio of lignin concentration to initial anaerobic sludge concentration gave tolerance to the inhibition. In this experiment, high molecular hardwood lignin was not degraded and decolorized.

  • PDF

Using IoT and Apache Spark Analysis Technique to Monitoring Architecture Model for Fruit Harvest Region (IoT 기반 Apache Spark 분석기법을 이용한 과수 수확 불량 영역 모니터링 아키텍처 모델)

  • Oh, Jung Won;Kim, Hangkon
    • Smart Media Journal
    • /
    • v.6 no.4
    • /
    • pp.58-64
    • /
    • 2017
  • Modern society is characterized by rapid increase in world population, aging of the rural population, decrease of cultivation area due to industrialization. The food problem is becoming an important issue with the farmers and becomes rural. Recently, the researches about the field of the smart farm are actively carried out to increase the profit of the rural area. The existing smart farm researches mainly monitor the cultivation environment of the crops in the greenhouse, another way like in the case of poor quality t is being studied that the system to control cultivation environmental factors is automatically activated to keep the cultivation environment of crops in optimum conditions. The researches focus on the crops cultivated indoors, and there are not many studies applied to the cultivation environment of crops grown outside. In this paper, we propose a method to improve the harvestability of poor areas by monitoring the areas with bad harvests by using big data analysis, by precisely predicting the harvest timing of fruit trees growing in orchards. Factors besides for harvesting include fruit color information and fruit weight information We suggest that a harvest correlation factor data collected in real time. It is analyzed using the Apache Spark engine. The Apache Spark engine has excellent performance in real-time data analysis as well as high capacity batch data analysis. User device receiving service supports PC user and smartphone users. A sensing data receiving device purpose Arduino, because it requires only simple processing to receive a sensed data and transmit it to the server. It regulates a harvest time of fruit which produces a good quality fruit, it is needful to determine a poor harvest area or concentrate a bad area. In this paper, we also present an architectural model to determine the bad areas of fruit harvest using strong data analysis.

A Benchmark of AI Application based on Open Source for Data Mining Environmental Variables in Smart Farm (스마트 시설환경 환경변수 분석을 위한 Open source 기반 인공지능 활용법 분석)

  • Min, Jae-Ki;Lee, DongHoon
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 2017.04a
    • /
    • pp.159-159
    • /
    • 2017
  • 스마트 시설환경은 대표적으로 원예, 축산 분야 등 여러 형태의 농업현장에 정보 통신 및 데이터 분석 기술을 도입하고 있는 시설화된 생산 환경이라 할 수 있다. 근래에 하드웨어적으로 급증한 스마트 시설환경에서 생산되는 방대한 생육/환경 데이터를 올바르고 적합하게 사용하기 위해서는 일반 산업 현장과는 차별화 된 분석기법이 요구된다고 할 수 있다. 소프트웨어 공학 분야에서 연구된 빅데이터 처리 기술을 기계적으로 농업 분야의 빅데이터에 적용하기에는 한계가 있을 수 있다. 시설환경 내/외부의 다양한 환경 변수는 시계열 데이터의 난해성, 비가역성, 불특정성, 비정형 패턴 등에 기인하여 예측 모델 연구가 매우 난해한 대상이기 때문이라 할 수 있다. 본 연구에서는 근래에 관심이 급증하고 있는 인공신경망 연구 소프트웨어인 Tensorflow (www.tensorflow.org)와 대표적인 Open source인 OpenNN (www.openn.net)을 스마트 시설환경 환경변수 상호간 상관성 분석에 응용하였다. 해당 소프트웨어 라이브러리의 운영환경을 살펴보면 Tensorflow 는 Linux(Ubuntu 16.04.4), Max OS X(EL capitan 10.11), Windows (x86 compatible)에서 활용가능하고, OpenNN은 별도의 운영환경에 대한 바이너리를 제공하지 않고 소스코드 전체를 제공하므로, 해당 운영환경에서 바이너리 컴파일 후 활용이 가능하다. 소프트웨어 개발 언어의 경우 Tensorflow는 python이 기본 언어이며 python(v2.7 or v3.N) 가상 환경 내에서 개발이 수행이 된다. 주의 깊게 살펴볼 부분은 이러한 개발 환경의 제약으로 인하여 Tensorflow의 주요한 장점 중에 하나인 고속 연산 기능 수행이 일부 운영 환경에 국한이 되어 제공이 된다는 점이다. GPU(Graphics Processing Unit)의 제공하는 하드웨어 가속기능은 Linux 운영체제에서 활용이 가능하다. 가상 개발 환경에 운영되는 한계로 인하여 실시간 정보 처리에는 한계가 따르므로 이에 대한 고려가 필요하다. 한편 근래(2017.03)에 공개된 Tensorflow API r1.0의 경우 python, C++, Java언어와 함께 Go라는 언어를 새로 지원하여 개발자의 활용 범위를 매우 높였다. OpenNN의 경우 C++ 언어를 기본으로 제공하며 C++ 컴파일러를 지원하는 임의의 개발 환경에서 모두 활용이 가능하다. 특징은 클러스터링 플랫폼과 연동을 통해 하드웨어 가속 기능의 부재를 일부 극복했다는 점이다. 상기 두 가지 패키지를 이용하여 2016년 2월부터 5월 까지 충북 음성군 소재 딸기 온실 내부에서 취득한 온도, 습도, 조도, CO2에 대하여 Large-scale linear model을 실험적(시간단위, 일단위, 주단위 분할)으로 적용하고, 인접한 세그먼트의 환경변수 예측 모델링을 수행하였다. 동일한 조건의 학습을 수행함에 있어, Tensorflow가 개발 소요 시간과 학습 실행 속도 측면에서 매우 우세하였다. OpenNN을 이용하여 대등한 성능을 보이기 위해선 병렬 클러스터링 기술을 활용해야 할 것이다. 오프라인 일괄(Offline batch)처리 방식의 한계가 있는 인공신경망 모델링 기법과 현장 보급이 불가능한 고성능 하드웨어 연산 장치에 대한 대안 마련을 위한 연구가 필요하다.

  • PDF

Comparison of Methanol with Formamide on Extraction of Nitrogen Heterocyclic Compounds Contained in Model Coal Tar Fraction (모델 콜타르 유분 중에 함유된 질소고리화합물의 추출에 관한 메탄올과 포름아마이드의 비교)

  • Kim, Su Jin
    • Applied Chemistry for Engineering
    • /
    • v.26 no.2
    • /
    • pp.234-238
    • /
    • 2015
  • The separation of nitrogen heterocyclic compound (NHC) contained in a model coal tar fraction was compared by the methanol and formamide extraction. The model coal tar fraction comprising four kinds of NHC (NHCs : quinoline, iso-quinoline, indole, quinaldine) and three kinds of bicyclic aromatic compound (BACs : 1-methylnaphthalene, 2-methylnaphthalene, dimethylnaphthalene), biphenyl and phenyl ether was used as a raw material. The aqueous solution of methanol and formamide were used as solvents. A batch-stirred tank was used as the raw material - a solvent contact unit of this work. Independent of the solvent used, the distribution coefficient of NHCs sharply increased by decreasing the initial volume ratio of water to the solvent and increasing the equilibrium operation temperature, whereas, the selectivity of NHCs in reference to BACs decreased. Decreasing the initial volume ratio of solvent to feed resulted in deteriorating distribution coefficients, but the selectivity of NHCs in reference to BAC was almost the constant. The distribution coefficient of NHCs by the methanol extraction was 3~5 times higher than that of NHCs by the formamide extraction, inversely, the selectivity of NHCs based on BACs by the formamide extraction was 3~7 times higher than that of NHCs by the methanol extraction. Furthermore, two different solvent extraction methods by adding the extraction processing speed to the balance between solvency and selectivity of NHCs were compared.

Mediated ID based signature scheme and key updating signature scheme (중재자를 이용한 ID기반 전자서명과 키 업데이팅 전자서명 기법)

  • Ju, Hak-Soo;Kim, Dae-Youb
    • The KIPS Transactions:PartC
    • /
    • v.14C no.6
    • /
    • pp.463-470
    • /
    • 2007
  • Revocation is one of the main difficulties faced in implementing Public Key Infrastructures(PHs). Boneh, Ding and Tsudik first introduced a mediated cryptography for obtaining immediate revocation of RSA keys used in PKIs. Their method is based on the idea that each user's private key can be split into two random shares, one of which is given to the user and the other to an online security mediator(SEM). Thus any signature or decryption must be performed as a cooperation between a user and his/her associated SEM and revocation is achieved by instructing the mediator SEM to stop cooperating the user. Recently, Libert and Quisquater showed that the fast revocation method using a SEcurity Mediator(SEM) in a mRSA can be applied to the Boneh-Franklin identify based encryption and GDH signature schemes. In this paper we propose a mediated identity based signature(mIBS) with batch verification which apply the SEM architecture to an identity based signature. Libert's GDH siganture scheme is not forward secure even though forward security is an important and desirable feature for signature schemes. We propose an efficient key udating mediated signature scheme, mKUS based on mIBS and analyze its security and efficiency.

Characteristics of Heavy Metal Removal from Aqueous Solutions using Leather Industry by-products (피혁산업 부산물에 의한 용존 중금속 제거 특성)

  • Kim, Keun-Han;Lee, Nam-Hee;Paik, In-Kyu;Park, Jae-Hyung;Yang, Jae-Kyu
    • Journal of Korean Society of Environmental Engineers
    • /
    • v.32 no.5
    • /
    • pp.417-426
    • /
    • 2010
  • In this study, ten different bio-adsorbents were prepared by immobilization of vegetable tannins such as mimosa(Catechol Tannin) and chestnut(Pyrogallol Tannin) on the collagen matrix which was derived from during leather manufacturing processing. Removal efficiency of Cu(II), Cd(II), Zn(II), Pb(II), Cr(III) by each bio-adsorbent in synthetic wastewater was evaluated by a laboratory-scale batch reactor at different reaction conditions. When mimosa was used as a vegetable tannin, the penetration efficiency of mimosa into the inner bundle of fiber depended on the dose of the naphthalene condensated penetrant; 3% ${\geq}$ 1.5% > 0%. For all bio-adsorbents, removal of heavy metal ions was not observed below pH 3.0 but was rapidly increased between pH 3.0 and 6.0, showing near complete removal of all heavy metal ions except Zn(II) above pH 6.0. Removal of Cr(III) was quite similar for all bio-adsorbents while removal of Cu(II), Zn(II) and Pb(II) was higher by bio-adsorbents immobilized with chestnut than that by mimosa. Adsorption of Pb(II) and Cu(II) by S10 bio-adsorbent was little affected by the presence of monovalent and divalent electrolytes as well as variation of 1000 times ionic concentration with $NaNO_3$.

The Use of Open Global Network System Interconnection in E-Trading (전자무역의 글로벌 네트워크 개방시스템 상호연결 활용에 관한 연구)

  • Jeong, Boon-Do;Yun, Bong-Ju
    • International Commerce and Information Review
    • /
    • v.16 no.1
    • /
    • pp.207-226
    • /
    • 2014
  • A trade logistic informatization system under Open Systems Interconnection(OSI) includes a Port Management Information System, a Maritime Information System, and an Export and Import Batch Processing System. These have made a great contribution in the creation of more convenient and efficient management for the logistics industries in our country. However, this management is exposed to the technological problems of networks due to the explosive use in the sending and receiving of e-documents. For our country to grow as a center for port and logistic information, we should make the best use of the control systems using networks and further advance the export and import logistic systems. Therefore, this study aims to propose management systems for a composite network and an invasion detection system for efficient management of an e-trade network under OSI. Methods to rationalize the internal organizations such as coordination of organizations and human resources according to alloted network functions, commissions and arbitrary decisions, and reorganization of relevant regulations are not discussed here. This study looked at trade network under OSI from the aspect of practical business affairs and presented a basis for further interpretation.

  • PDF

Development of Practical Advanced Oxidation Treatment System for Decontamination of Soil and Groundwater Contaminated with Chlorinated Solvents (TCE, PCE): Phase II (염소계 화합물(TCE, PCE)로 오염된 토양 및 지하수 처리를 위한 실용적 고도산화처리시스템 개발 (II))

  • Kim, Sang-Yeek;Sohn, Seok-Gyu;Kong, Sung-Ho
    • Journal of Soil and Groundwater Environment
    • /
    • v.15 no.2
    • /
    • pp.10-17
    • /
    • 2010
  • Advanced oxidation processes (AOPs) have advantages to reduce the processing time and mineralize contaminants dissolved in groundwater. Recently, remediation techniques for organic contamination in groundwater have been studied, and technology using $UV/H_2O_2$ is generally accepted as one of the most powerful and reliable alternative for the remediation of groundwater contamination. In this study, $UV/H_2O_2$ technology, which generates hydroxyl radical ($\cdot$ OH) as known for strong non-selective oxidant, was used to degrade chlorinated solvents (TCE and PCE), and it was expanded to apply continuous stirred tank reactor (CSTR) system (i.e. combinations of three CSTR). The tested parameters for CSTR system were retention time and groundwater/$H_2O_2$ injection volume ratio. To find optimum parameters for CSTR system, various retention time (6 min ~ 90 min) and groundwater/$H_2O_2$ injection volume ratio (5/1 ~ 119/1) were tested. Other conditions for CSTR were adapted from the batch test results, which concentration of $H_2O_2$ and UV dose were 29.4 mM (0.1%) and 4.3 kWh/L, respectively. Based on the experimental results, the optimum parameters for CSTR system were 20 min for retention time and 119/1 for groundwater/$H_2O_2$ injection volume ratio. Applying these optimum conditions, chlorinated solvents (TCE and PCE) were removed at 99.9% and 99.6%. Moreover, the effluent concentrations of TCE and PCE are 0.036 mg/L and 0.087 mg/L, respectively, which are satisfied the regulatory level (TCE 0.3 mg/L, PCE 0.1 mg/L). Consequently, the CSTR system using $UV/H_2O_2$ technology can achieve high removal efficiency in the event of treatment of groundwater contaminated by chlorinated solvents (TCE and PCE).

Quality Characteristics of High Acidity Apple Vinegar Manufactured Using Two Stage Fermentation (2단계 발효에 의한 고산도 사과식초의 품질특성)

  • Sung, Na-Hye;Woo, Seung-Mi;Kwon, Joong-Ho;Yeo, Soo-Hwan;Jeong, Yong-Jin
    • Journal of the Korean Society of Food Science and Nutrition
    • /
    • v.43 no.6
    • /
    • pp.877-883
    • /
    • 2014
  • This study investigated the manufacturing conditions of apple vinegar with high acetic acid content following fermentation according to alcohol concentration without any nutrients. We compared and analyzed the quality characteristics of high acetic acid fermentation by varying the initial alcohol content (6%, 7%, 8%, and 9%). In the results, it was possible to manufacture high acetic acid vinegar with 12% titratable acidity and an alcohol content of 6% and 7%. Lower initial alcohol content was associated with higher yield due to a shorter lag phase. For quality characteristics of the high acetic acid apple vinegar, pH was 2.91~3.20, titratable acidity was 12.0%, and organic acid consisted of acetic acid, malic acid, critic acid and oxalic acids. Based on the results, high acetic acid apple vinegar was produced using a two stage fermentation process after alcohol fermentation but the further research is needed to reduce the time of fermentation in fed-batch culture for industrial use.