In this paper, it proposes the technique to restore from a binary image in the color image. The color image is composed of three element images of red, green and blue. Therefore, the color image is first divided into a red, green, and blue element, and the Inverse Halftoning$\sim$ is processed to each element images. Finally, each element images is collectively displayed. In that case, the Kalman filter was applied to the Inverse Halftoning for the restoration accuracy improvement of the image. As a result, it was possible to restore it in the color image as well as the time of a monochrome image. Moreover, the result that the restoration accuracy had improved even when which combining with the technique by using the Kalman filter for the Inverse Halftoning so far came out.