The musician has insisted his shows are apolitical, prompting a fierce backlash