Is it legally permissible to utilise an unused, adjoining sector of land in order to build a house?

There may be no particular legal reason why this should not take place, however, local residents and neighbours have the right to object, and may do so, which can cause considerable delay.