Workers Party of Britain leader said that nobody supports staying in Britain any longer