Using a public IP instead of a private IP

I am thinking about using public IP addresses instead of internal private IP addresses in the setup of my servers. What are the disadvantages of using public IP addresses? My clients would all use private IP addresses on a class A network. Someone told me once that I wouldn't want to use public IP addresses because all of my clients would have to go through the Internet to get their home directories.