• Title/Summary/Keyword: Quasi-Newton(bariable metric) method

Search Result 1, Processing Time 0.014 seconds

REVISING THE TRADITIONAL BACKPROPAGATION WITH THE METHOD OF VARIABLE METRIC(QUASI-NEWTON) AND APPROXIMATING A STEP SIZE

  • Choe, Sang-Woong;Lee, Jin-Choon
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.118-121
    • /
    • 1998
  • In this paper, we propose another paradigm(QNBP) to be capable of overcoming Limitations of the traditional backpropagation(SDBP). QNBPis based on the method of Quasi -Newton(variable metric) with the nomalized direction vectors and computes step size through the linear search. Simulation results showed that QNBP was definitely superior to both the stochasitc SDBP and the deterministic SDBP in terms of accuracy and rate of convergence and might sumount the problem of local minima. and there was no different between DFP+SR1 and BFGS+SR1 combined algrothms in QNBP.

  • PDF