Generally yes.
With the credentials of a deleted / deactivated API key it is no longer possible to generate a new access token.
However, a token that was already created before deletion still keeps its validity and is therefore also functional until the access_token_expires_at time is reached.
An access token is valid for 24 hours from the time of creation.