Fork me on GitHub Open Source
Knowledgebase
Commentics > Support > Knowledgebase

Search help:


What should I add to robots.txt?

Solution

The robots.txt file is a text file which resides in the root of your website. The purpose of the file is to tell the search engines that visit your website what they can and can not index in their results pages. With regard to Commentics, it is suggested that you add the following:

Disallow: /commentics/

This is because there is nothing inside the /commentics/ folder that you would want indexed by a search engine.

Note 1: Not all search engines choose to obey the file.
Note 2: Do not enter any secret admin directories as the file is accessible to the public too.
Note 3: Further reading, http://www.robotstxt.org/.

 
Was this article helpful? yes / no
Related articles How do I change the text?
How do I submit an add-on?
Can I turn off the 'Powered By' link?
Article details
Article ID: 6
Category: Tips
Date added: 2010-07-01 10:36:53
Views: 1363
Rating (Votes): Article rated 4.4/5.0 (25)

 
« Go back

 
Powered by Help Desk Software HESK, brought to you by SysAid