Welcome Guest! You can login or register.
Login or Register.
Friday, November 30, 2012 11:56:24 AM(UTC)
I hit up your top 10 feature just moments ago.. the characters per post one to be precise.
Right after that, the number of guests went into the 100's.
Could it be, the query is firing off as guest within the framework?
Pack93z attached the following image(s):
Guest accounts PH.JPG
Friday, November 30, 2012 12:17:35 PM(UTC)
Friday, November 30, 2012 12:19:43 PM(UTC)
Couldn't see the IP address of the guests.. just seemed to be timed too perfectly.
Friday, November 30, 2012 12:30:05 PM(UTC)
100 Marine Parkway
Redwood City, CA 94065
Domain name: SCOUTJET.COM
Friday, November 30, 2012 12:31:20 PM(UTC)
ScoutJet web crawler
ScoutJet is the web crawler for blekko, a new Silicon Valley based search engine created by the founders of DMOZ and Topix.
We are developing next generation search technology, and kindly request that you permit ScoutJet access to your site so that we may refine our relevance algorithms with the broadest variety of content available from the Internet.
ScoutJet obeys robots.txt
You can prevent ScoutJet from indexing all or part of your site by including the following lines in your http://www.yoursite.com/robots.txt
file:# Allow only specific directories
You can also limit the rate at which ScoutJet crawls your page using the Crawl-delay directive:
# Limit ScoutJet's crawl rate (example is to crawl no more than 1 page every 5 seconds)
In addition, ScoutJet understands wildcards and Allow.
ScoutJet crawls from the following IP ranges:
199.87.248.*, 199.87.249.*, 199.87.250.*, 199.87.251.*, 199.87.252.*, 199.87.253.*, 199.87.254.*, 199.87.255.*
38.99.96.*, 38.99.97.*, 38.99.98.*, 38.99.99.*
ScoutJet tries its best to crawl politely. But if you do experience a problem with ScoutJet, please let us know at crawler (at) blekko (dot) com.
Why can't I submit my site?
We don't currently accept URL submissions. We discover and add new sites to our index by link-crawling. Basically you just need to make sure that you allow ScoutJet to crawl your site, and then we will need to discover it via links from other sites.
Users browsing this topic
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.