The particle sizes and heavy metal concentrations (Pb, Zn, Cu, Cd, Hg, As, Cr, Ni, Li, Al) of surface sediments of the Yeongsan River were analyzed to assess the distribution and pollution level of heavy metals. The distribution of particle sizes was dominated by sand in the upstream sites (MS1-MS7) and by silt loam in the downstream sites (MS8-ML3), but MS3 and MS6, located slightly upstream of the two weirs, were found to be loamy sand and silt loam, respectively. The concentrations of Pb, Zn, Cu, Cd and Hg were higher at the upstream sites, while As, Cr, Ni and Li were higher at the downstream sites. The heavy metals of crustal origin (As, Cr, Ni and Li) were strongly correlated with particle size, while the other heavy metals (Pb, Zn, Cu, Cd and Hg) were weakly correlated with particle size. Considering their concentrations, most of heavy metals were evaluated as having almost no toxic effects on benthic organisms, at all sites. In addition, anthropogenic contamination by the $I_{geo}$, EF and CF were found to have no impact at most sites, with only low levels of pollution at the others. Using the PLI method, the MS2 and MS3 sites, located upstream, were assessed to be affected by anthropogenic contamination. Most importantly, Zn, Cu and Hg were found to be the elements responsible for most pollution, and they were highest at the upstream sites, implying pollution by domestic sewage and urban discharge.