That usually happens because you have multiple tolerances being added together, which is called tolerance stacking. Take a look at the dimensions of the part shown above, can you see the problem?