This should not be happening. Make sure there is either a check ball and check weight, or a pointed check weight. Seat the check ball using a brass drift punch and tap lightly.
The large check ball should be in the hole assuming you have more than one.
Non vented gas cap can cause this. The tank will build up pressure and force fuel into the carburetor.
Plugged idle tube is another problem.