Someone should remind Karzai of what happened to President Ngo Dinh Diem of South Vietnam when he became seriously inconvenient. Diem was ousted and murdered in a U.S.-backed coup.
Like Vietnam, Afghanistan is a violent place. Karzai doesn't want to discover the point at which he becomes seriously inconvenient.