Surely part of the fun is the idiocy of both parts of the team? The inept and fumblign dungeoneer, guided by his dull witted cohorts who can't get Treguards heavy handed hints...
I think my least favourite bits were when teams were obviously just allowed to win for no real reason than to actually have some winners. Series 4 when Merlin runs out of nowhere to save a team who have completed their quest springs to mind.