Put it just after the annoying action in your edit, then follow it with the punch sound for a comic hit or the vine boom for a bigger reaction. Keep it as the response to what just happened, not as background, and let the next clip carry the laugh.