DETAILED DESCRIPTION OF THE INVENTION (Excerpts)



[0095] If the background within a screen is set to a real world captured by the camera 122, augmented reality (AR), in which a virtual object is incorporated into a real world, can be implemented. In this case, if the camera 122 is attached to the user, the images of blocks being assembled and changed into an object captured from the user's viewpoint can also be displayed. When AR is implemented using blocks, since the real blocks form a virtual object, the interaction between the virtual object and an object in the real world can be expressed within the display screen. For example, when a book on the desk is pushed over by the block tool, a virtual object within the screen moves in the same way, so that the real book on the desk being pushed over can also be displayed.



[0096] FIG. 11 shows another example of transitions of a block tool and a display screen. The way of illustrating is the same as shown in FIG. 10. The block tool 228a in the first state is formed by an L-shaped block tool, in which two square-pillar blocks arranged one above the other make a right angle. The angle made by the upper and lower blocks is variable, and the angle is measured by an angle sensor. If such an L shape is registered in the registered shape storage unit 26 and related to an object model of a pistol therein, a pistol 260 will be displayed on the screen as shown on the display screen 230a.



[0097] As with the case of FIG. 10, if a user holds and moves the lower block of the block tool 228a, the direction or position of the pistol 260 on the display screen 230a can be changed. Although only the pistol 260 appears within the display screen 230a, if the technique of operating a character within the screen according to the motion of the user's body is used together, a game in which the character fights against an enemy with the pistol 260 as a weapon can be implemented, for example.



[0098] In the block tool 228b in the second state, another square-pillar block is connected to the upper block of the block tool 228a in the first state so as to extend downward. If such a shape is registered besides the shape of the block tool 228a in the first state and related to an object model of a machine gun, the object within the screen will change from the pistol 260 to a machine gun 262 at the time when the another block is connected (the display screen 230b). Conversely, if the another block is detached and the block tool is returned to the block tool 228a in the first state, the object within the screen will also return from the machine gun 262 to the pistol 260 (the display screen 230a).



[0099] In the block tool 228c in the third state, the bend angle made by the two blocks in the block tool 228a in the first state, i.e., the right angle, is eliminated, so that the block tool forms a straight rod-like shape. If such a shape is registered besides the shape of the block tool 228a in the first state and related to an object model of a sword, the object within the screen will change from the pistol 260 to a sword 264 at the time when the bend angle is eliminated (the display screen 230c).



[0100] With such configurations, even if the content is the same, variations can be provided in the object model within the screen operated by a user by changing the shape of the block tool. Also, using the characteristic of the variable shape of the block tool, if a registered shape of the block tool is made closer to the shape of an object model related thereto, the situation can be made more realistic and intuitive operation is enabled. Further, by providing an embodiment in which the addition of more blocks can cause emergence of a more powerful weapon or a more attractive character in a virtual world, the collection or assembly of the blocks can also be made amusing.