I think it all depends on why they are watching you, if you feel that they dont trust you it can be uncomfortable, the ones that are just inquisitive are not so bad but i know what you mean, i get worried in the nicer houses where you think you could easily break something, and still get a bit aprehensive going to a new job stupid i know, once i am in and meet them its ok