Make sure the configuration directory exists and that it's usable