This paper presents an implemented embedded vision based tracking system for single object. The paper describes implementation a one object tracking of each colour. It also describes the measurement angle for each colour Red and Blue. However, some of these studies suffer from numerous problems have been manipulated such as many camera motion and time delay in image capture, therefore object tracking is a challenging problem. Consequently, in this paper design and implemented of tracking one object (color) utilizing FPGA-SoC. The proposed method has adopted a passive tracking vision system based on platform DE1-SoC and D5M camera. As a result of our project is can be tracking of one objects each color (colors).