Results 1 to 9 of 9

Thread: Why We Use robot.txt file In Seo..?

  1. #1
    Member
    Join Date
    Aug 2016
    Posts
    48
    Rep Power
    0

    Why We Use robot.txt file In Seo..?

    Hello friends,

    Why We Use robot.txt file In Seo..?

  2. #2
    Junior Member
    Join Date
    Apr 2017
    Location
    Bangalore
    Posts
    24
    Rep Power
    0
    Robots.txt file is used to help search engine crawlers to crawl and index the webpages we want to display of our website

  3. #3
    Senior Member
    Join Date
    Apr 2017
    Posts
    100
    Rep Power
    1
    Robots.txt file that instructs search engine crawlers which webpages to crawl and which not to crawl for indexing.

  4. #4
    Member
    Join Date
    Mar 2017
    Location
    Noida
    Posts
    51
    Rep Power
    1
    Robots.txt is a simple text file webmaster create to instruct search engine robots how to crawl and indexed of their website.

  5. #5
    Senior Member
    Join Date
    Feb 2017
    Posts
    145
    Rep Power
    1
    Robots.txt file use for give permission for crawling own website's webpages to search engine.

  6. #6
    Junior Member
    Join Date
    Apr 2017
    Location
    India
    Posts
    26
    Rep Power
    0
    Generally Robot.txt file use to allow the crawler to crawl the website or we can give instruction to disallow the particular web page of the website.

  7. #7
    Senior Member
    Join Date
    Jun 2016
    Posts
    508
    Rep Power
    1
    Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
    Cheap VPS | $1 VPS Hosting
    Cheap Windows VPS
    Cheap Dedicated Hosting | Free Setup & IPMI

  8. #8
    Member
    Join Date
    Feb 2017
    Posts
    63
    Rep Power
    1
    robots.txt file is very important for any website to control the website indexing and crawling process.

  9. #9
    Junior Member
    Join Date
    Apr 2017
    Posts
    1
    Rep Power
    0
    It is use for indexing or no index url Google search engine.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •