Statistics for Knight's Dad's Gifts And Home Decor     Date: 4/19/2006 16:14

Main URL: http://www.giftsandhomedecor.com/  (not case sensitive)

Number of URLs listed total: 271
Number of URLs listed to be included: 269
Number of URLs listed to be crawled: 269
Number of URLs still waiting in the crawler: 0 (may include some already listed)
Number of URLs aborted in the crawler: 0

Top 20 oldest included URLs:
    http://www.giftsandhomedecor.com/ (0 days)
    http://www.giftsandhomedecor.com/about-us/info_1.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/bird-figurines/cat_49.html (0 days)
    http://www.giftsandhomedecor.com/automotive/cat_13.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/african-american-heritage/cat_42.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/african-heritage/cat_36.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/animal-figurines/cat_37.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/cat_4.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/classic-wheels/cat_40.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/cork-sculpture/cat_35.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/dolls/cat_44.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/far-east-collection/cat_41.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/figurines/cat_33.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/frosted-items/cat_51.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/glasswares/cat_45.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/hong-tze-collection/cat_38.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/medieval/fantasy-collection/cat_39.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/miniatures/cat_34.html (0 days)
    http://www.giftsandhomedecor.com/collectibles/musical-items/cat_47.html (0 days)

Ban URLs with these texts in them from being crawled:
    /_vti_bin/
    fsforum/

Drop these parts of URLs being crawled:


Remove these parameters when specified while being crawled:
    phpsessid

ROBOTS.TXT from 4/17/2006 21:40:
    User-agent: * 
    Disallow: /index.php?act=login
    Disallow: /index.php?act=taf 
    Disallow: /admin/
    Disallow: /cgi-bin/
    Disallow: /classes/
    Disallow: /docs/ 
    Disallow: /extra/
    Disallow: /images/
    Disallow: /includes/
    Disallow: /install/
    Disallow: /js/
    Disallow: /language/ 
    Disallow: /modules/ 
    Disallow: /pear/  
    Disallow: /skins/
    Disallow: /tellafriend/
    Disallow: /shop.php/tellafriend/
    Disallow: /shop/tellafriend/
    Disallow: /cart.php
    Disallow: /confirmed.php 
    Disallow: /download.php
    Disallow: /offLine.php
    Disallow: /spiders.txt
    Disallow: /switch.php
    
    


End of data.