Independence Party 'must look inward if others are to work with it'