In this paper, we describe a compact system for real-time detection of moving objects. In this system, we realized real-time computation of the optical flow and the stereo vision by area-based matching with one FPGA. By combining the optical flow and the stereo vision, we can detect moving objects and distances to the objects, which are very important for vision systems of autonomous vehicles. The system implemented on XC2V6000 runs at 68 MHz, which is fast enough to process more than 30 images (640 × 480 pixels) in one second.