ok

so i want to make a model in modelling software of a real object that is sitting in my real room

once modelled, i imagine i would move the camera in the software so that it is at the perspective and point of veiw as my eyeballs are to the real object
then i want to project the image that i render using a hd projector onto that real object...... masking out the unwanted spaces, and ... well i dont really know from there.
i guess i will be able to make some pretty good illusions from this method though.

Only problem im having is i dont really know how to get the perspectives the same. it could be trouble with spherical problems with lenses of cameras if i use this to capture an image then try to recreate that perspective in the software.

Not many tutes on the internet for this one.... anyone have any suggestions?