A ghost story was part of the backdrop to a Melbourne Cup lunch at a mansion in Albury