Robots.txt function is very important for a web or wap, robots.txt can be compared a sieve, which is useful to filter out anything that we want. Therefore robots.txt will filter from any search engine robots that can be accessed, and what should not be accessed by Google.
Google will search and browse the web or even wapsite are already listed in Google Webmaster. Thus Google will index the content of a website, such as the latest articles, and others. From the above we can conclude that the robots.txt will give direction or even ban to google what is allowed to index in search.
And what if in a website or wapsite not installed or in loadedcity robots.txt, then this will allow google to index all of the content from the web.
And as a result of google can index all the web content, including file confidential files and folders folder forbidden, it will be utilized by the h@cking to hijack the web.
Describe the function of the robots.txt is very useful for a website. Now I will share a little bit how to activate robots.txt in wapka mobi
- Blogger Comment
- Facebook Comment
Subscribe to:
Post Comments
(
Atom
)

0 comments:
Post a Comment
We Appreciate You Reading This Post, We Always Like To Hear From You, Please Take A Minute To Share Your Thoughts On The Comments Board Below.