If my router didn’t have built in DNS, could I still connect from system to system in my LAN by host name?

Or would I have to connect directly by IP?