Family name origins & meanings English (chiefly southern) and Dutch : topographic name for a dweller in a hollow (see Hole).English (chiefly southern) : topographic name for a dweller by a holly tree or on an island, from Middle English holm (see Holme) + man.