don't go there

1. Don't imagine or even think such a thing. It is often used in a slightly risqué context.