One of the objectives a website owner will most probably have is to have their website effectively crawled by search engines. They often miss a common pitfall of being crawled and that is the efficiency of search engines.