It's not really a button, just a confirm box, and I don't think there's an option to say "No". As mentioned elsewhere, you have no clue what is happening or where, unless you're lucky to be looking at where the action is, which is usually only when you start the combat.
I've lost a starport without knowing for many turns.
