User-agent: * Disallow: /img/ # Block the /img/directory. Disallow: *.pdf # Block pdf files. Non-standard but works for major search engines.