A designing method for monitoring and control the process of driver licence test video by autonomous robot is presented in this paper. Based on differential of sequential video frame and quadratic frame, an enhanced HSI differential model is built to realize characteristic analysis and target detection & distinguish. Finite-state machine (FSM) is adopted to describe the full states of autonomous robots judgment process. All states switch of robot and vehicle judgment are realized. Kaiman predictor is introduced to predict one step estimation and two step incremental control algorithm of target. Rapid and smooth tracking control driver is also realized. The...