Place it at the end of a short reaction sequence, after the setup line and before the punchline sound, so the agreement becomes the payoff. Pair it with an awkward moment first, then follow with eh eh ehhhh when the joke needs a second beat.