The region-margin line segment stereo match algorithm is proposed based on the research on binocular stereo vision. The geometric characteristics of margin line segment and the color characteristics of the region are used to realize integrate matching. Using the information of color and color gradient direction
the integrate match is realized depend on all information of the geometric characteristics of the margin line segment and the region of the line segment. The experiment of attitude recognition of manipulator is done by the algorithm and the result shows that the algorithm could recognize the attitude of manipulator by higher accuracy in complicated background. The recognition accuracy reach to 0.017 and the expected aim is reached.