You were on the wrong 'Set' Of ghosts.

Theres 3 'Sets' and you have to follow that set or you dont get the robes

http://www.zybez.net/misc.php?id=33