Login Delay

I just setup a new XServe with LDAP server enabled and making services available to other servers. There is a 30 - 45 second delay when logging in at the server itself. The login button doesn't even respond for a while to indicate that it has been clicked. Any thoughts on where to start troubleshooting?