Results 1 to 3 of 3
  1. 01-07-2012, 03:55 AM #1
    yaquieto
    yaquieto is offline
    Junior Member
    Points: 208, Level: 4
    Level completed: 16%, Points required for next Level: 42
    Overall activity: 20.0%
    Join Date
    Nov 2011
    Posts
    26
    Points
    208
    Level
    4
    Rep Power
    0

    is it too complicated to use robots.txt file ?

    Not many web master take the time to use a robots.txt file for their website. For search engine spiders that use the robots.txt to see what directories to search through, the robots.txt file can be very helpful in keeping the spiders indexing your actual pages and not other information. I was wondering that is it too complicated to use robots.txt file ?

    Thanks for any comment .
    Warning: This is an Old Thread
    This discussion is older than 120 days. information contained in it may no longer be current
    Enjoy yourselves when learning the language you like with Rosetta Stone Arabic Rosetta Stone Korean!
    Reply With Quote Reply With Quote
  2. 12-13-2012, 06:07 AM #2
    Steve smith
    Steve smith is offline
    Champion of the Naaru
    Points: 771, Level: 15
    Level completed: 43%, Points required for next Level: 29
    Overall activity: 95.0%
    Join Date
    Nov 2012
    Posts
    181
    Points
    771
    Level
    15
    Rep Power
    1

    Re: is it too complicated to use robots.txt file ?

    Robots.txt file is a special text file that is always located in your Web server's root directory. Robots.txt file contains restrictions for Web Spiders, telling them where they have permission to search. A Robots.txt is like defining rules for search engine spiders (robots) what to follow and what not to. It should be noted that Web Robots are not required to respect Robots.txt files, but most well written Web Spiders follow the rules you define.
    Website Designers in Orange County | Orange County Web Developers
    Reply With Quote Reply With Quote
  3. 01-10-2013, 09:54 AM #3
    jessicasilber1097
    jessicasilber1097 is offline
    Junior Member
    Points: 90, Level: 1
    Level completed: 80%, Points required for next Level: 10
    Overall activity: 99.9%
    Join Date
    Jan 2013
    Posts
    25
    Points
    90
    Level
    1
    Rep Power
    0

    Re: is it too complicated to use robots.txt file ?

    Robot.txt file is a simple text file through which we can instruct the search engine which page have to be cache or not.
    csschopper | no-refresh | logodesignsstudio | appschopper
    Reply With Quote Reply With Quote
« getting traffic to the website | An Introduction to new member »

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. dsiadvantages of HTML5 File API?
    By yaquieto in forum HTML, DHTML & Web Design
    Replies: 0
    Last Post: 12-07-2011, 08:15 AM
  2. download a file from my site
    By wonbueht in forum HTML, DHTML & Web Design
    Replies: 0
    Last Post: 12-02-2011, 04:12 AM
  3. Suggestions for file serving host
    By congwuq in forum Web Hosting
    Replies: 3
    Last Post: 11-06-2011, 05:35 PM
  4. Robots and Revisit-After
    By congwuq in forum Search Engine Optimization
    Replies: 0
    Last Post: 10-25-2011, 07:45 AM
  5. file attach to a flash button
    By congwuq in forum Web Programming
    Replies: 0
    Last Post: 10-15-2011, 04:39 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules