In this study, a new method is proposed generating 3D wire-frames of building using the lowest level topology, points, which are input by human operators. Through the procedure, it is possible to make prediction occlusion points and generate the topology automatically among points, lines, surfaces from buildings. In order to adjust the error of initial values which are input manually, the least squares adjustment for model-image fitting is carried out using the edge information of aerial imagery. And also, model fitting procedure is done making all surfaces plane of buildings by the least squares adjustment. As a result of those procedure, 3D building models are refined similar to real figures of buildings.