I think I may have experienced something similar seven years ago when my Mum came to visit me....
Here's the story :
It was an autumn day and we decided to go for a drive in the countryside close to my home... We both have a liking for old ruined buildings, achitectural follies & derelict churches - that sort of thing, so imagine our delight when we turned a corner to find an old derelict house !
This was too much to resist, so we pulled the car over and went to have a nose around ..... It was a lovely old place, with what would have been a nice facade, five windows and a door facing the road and a very pretty roof with small terracotta tiles. It was autumn, so I couldn't tell for definate, but it appeared to be covered in some sort of Virginia Creeper that has lost all it's leaves... It was so neglected though - the windows had no glass and some of the tiles were coming off the roof..
Anyway, we liked the place, and luckily I had my camera, so I took a picture of my Mum standing outside the house (I've still got this at home somewhere).. but the strangest thing was that however many times in subsequent months and years I have driven along that road since (I know the area very well) I have never found the house again or any evidence of it having been there at all !!