Sketching on 3D structured surfaces

This paper presents a sketching tool that enables its users to draw and paint on 3D structured surfaces. Users of the proposed system take a picture of target objects and sketch with reference to the taken picture. They can not only sketch on the pictures but can also change their viewpoint of the sketched environment, since the system captures 3D structure by using a depth sensor as well as RGB data. Trial usage of the system shows that our users can rapidly extract their target objects/space and extend their ideas by taking pictures and drawing/painting on them. This paper also discusses the feasibility of extension of the simple idea from personal usage to collaborative spatial designing by multiple designers, by enabling the merging of 3D sketch spaces.