As described here, to use multiple ldap servers for failover, use the following:
passdb backend = ldapsam:"ldap://master.quenya.org ldap://slave.quenya.org"
You must make sure that /etc/ldap.conf lists all these servers as well, eg:
host 127.0.0.1 10.0.0.20