This would be cool.
The spectator mode should be an option enabled or disabled by the game host.
Other than that sounds really new and fun.