Former PM wants to prove a point by staying the course, but other Tories said to be mulling their own early exit