The name Pont Neuf was given to distinguish it from older bridges that were lined on both sides with houses, and has remained after all of those were replaced.
The decision not to include houses on the bridge can be traced back directly to Henry IV, who decided against their inclusion on the grounds that houses would impede a clear view of the Louvre, which the newly built galerie du bord de l’eau linked to the Tuileries Palace.
response was on that linked Wikipedia page ☞