Decline their invitation (sparring)