Ex-health minister Dan Poulter, who also works as a hospital doctor, says Conservatives have become ‘nationalist party of the right’