Big-game hunters commonly fire a shot at game, then lower their rifle to work the action and see what’s going on out front. That remains a good idea on shots of 50 yds. and closer, because a scope’s narrow field of field may not reveal the whole picture, such as other game running into the line of fire.
At longer distances however, it’s best to keep the rifle on the shoulder and continue looking through the scope, so no time is wasted re-acquiring the target. With the rifle still on the shoulder, the handle of a bolt-action rifle should easily lift with the fingers or palm of the hand.