Cabinet minister says he had ‘frank conversation’ with Starmer, as PM considers future