ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Large-Margin Training of Dependency Parsers Using Pegasos Algorithm

  • Received : 2009.11.24
  • Accepted : 2010.02.26
  • Published : 2010.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

This letter presents a modified Pegasos algorithm for graph-based dependency parsing. We show that the modified Pegasos algorithm outperforms the margin infused relaxed and passive aggressive algorithms in three languages.

Keywords

References

  1. J. Nivre and R. McDonald, "Integrating Graph-Based and Transition-Based Dependency Parsers," Proc. ACL-HLT, 2008, pp. 950-958.
  2. R. McDonald and F. Pereira, "Non-Projective Dependency Parsing Using Spanning Tree Algorithms," Proc. HLT-EMNLP, 2005, pp. 523-530.
  3. R. McDonald and F. Pereira, "Online Learning of Approximate Dependency Parsing Algorithms," Proc. EACL, 2006, pp. 81-88.
  4. R. McDonald et al., "Multilingual Dependency Analysis with a Two-Stage Discriminative Parser," Proc. CoNLL, 2006, pp. 216-220.
  5. K. Crammer et al., "Online Passive-Aggressive Algorithms," J. Machine Learning Research, vol. 7, 2006, pp. 551-585.
  6. L. Bottou and O. Bousquet, "The Tradeoffs of Large Scale Learning," NIPS, vol. 20, 2008, pp. 161-168.
  7. S. Shalev-Shwartz et al., "Pegasos: Primal Estimated Sub-GrAdient SOlver for SVM," Proc. ICML, 2007, pp. 807-814.
  8. S. Buchholz and E. Marsi, "Conll-x Shared Task on Multilingual Dependency Parsing," Proc.CoNLL, 2006, pp. 149-164.
  9. I. Tsochantaridis et al., "Support Vector Machine Learning for Interdependent and Structured Output Spaces," Proc. ICML, 2004, p. 104.
  10. C. Lee and M. Jang, "A Modified Fixed-Threshold SMO for 1-Slack Structural SVMs," ETRI J., vol. 32, no. 1, Feb. 2010, pp. 120-128. https://doi.org/10.4218/etrij.10.0109.0425
  11. C. Lee and M. Jang, "Fast Training of Structured SVM Using Fixed-Threshold Sequential Minimal Optimization," ETRI J., vol. 31, no. 2, 2009, pp. 121-128. https://doi.org/10.4218/etrij.09.0108.0276
  12. J. Nivre et al., "Labeled Pseudo-Projective Dependency Parsing with Support Vector Machines," Proc. CoNLL, 2006, pp. 221-225.

Cited by

  1. Structural SVM 기반의 한국어 의미역 결정 vol.42, pp.2, 2015, https://doi.org/10.5626/jok.2015.42.2.220
  2. Constructing a paraphrase database for agglutinative languages vol.123, pp.None, 2010, https://doi.org/10.1016/j.datak.2017.07.007