Exeter College ploughs on with Flowerpot Fields classrooms construction amid mounting public anger