Just waiting times in spectator mode is annoying. After waiting ends, lobby owner should return to the main menu in order you to join his game. You should be able to play directly when the game ends with him if there is available slot.
GameplayMultiplayerPerformanceReplayability