Okay so I just tried the castle solo with my enchantress again, and it was not bad at all. Only one death before Harpo. I think the difference this time was carrying a wand and shield (or whatever those bobbly wrist things are called). With a staff, I had a much harder time surviving, but it was fairly easy with better armor.