Status of http://www.sausalitoartgalleries.com

G

GoldnGate

Thank you for your prompt response and assistance, your effort and spirit of cooperation speaks well of you personally and of dmoz.

Best Wishes,
Richard
 
G

GoldnGate

Question .... how does one know their site has been "Crawled" by DMOZ?? and what identifier might one look for in their website hosting log, to identify that DMOZ has crawled the site ???

Thanks in advance
Richard
 

beebware

Member
Joined
Mar 25, 2002
Messages
1,070
Short answer: No.

Long answer: ODP (aka dmoz.org) does not 'crawl' websites as it is not a search engine (such as Google). No site gets listed in the ODP without being manually reviewed by human eyes - hence why it is the largest, most comprehensive human-edited directory of the Web. It is constructed and maintained by a vast, global community of volunteer editors. (similar to Yahoo! but we are bigger and don't charge for submissions).

The only 'crawler' (or, to give them their proper names, web robots or 'spiders') that the ODP has is only called ' Robozilla' (see here for more details). All Robo does is check the links already listed in the ODP, and if any of them return known error codes or are otherwise unreachable - then the link is marked as 'Errored' (also referred to as 'red' links as that is the color they appear to editors). If a link is marked as errored, it is _not removed_ from the directory - but mearly waits until a human has double-checked it: then the editor can either mark the link as 'OK', or search for the new URL of the site, move it to the unreviewed queue for later review, or delete the site. We only have Robozilla to assist us in keeping the ODP 'dead-link' free, but "he" does not do any editing himself <img src="/images/icons/smile.gif" alt="" />

When an editor goes from an ODP edit-side page to your site, they _may_ leave an appropriate trace in your web servers log file - but this does NOT indicate anything. An editor may have just been checking your site and left it in the 'unreviewed' queue for later review (or moved it elsewhere), they may have added it to one of our 'holding areas' (such as the editor Bookmarks section) for their own reference or just keyed in your URL just to check some other details. Likewise, a _lack_ of the reference in your log files doesn't mean an editor _hasn't_ visited: they may have launched your website in a new window, they may have a firewall installed which blocks the HTTP_REFERER header, they may have cut'n'pasted (or copied) the URL to a new window etc etc.
 
This site has been archived and is no longer accepting new content.
Top