Help prevent the indexing of your files and directories that if indexed by themselves could frustrate a viewer's search experience and possibly alienate them.

For instance, a viewer could become discouraged after clicking on a link that only shows your photos without any way to reach your web site.