My site is blocked?

[jagoda]

Hello,

I have a website, In this site I have a section for Dmoz, showing links to sites in your current location, language chosen, and search queries.

In the past 3 months this section is not working.

I use there XMLHTTP.request to get the data.

when I'm checking if I have connection to other sites - it works.

 

is it possible that DMOZ blocked my site?

The site is hosted on GoDaddy.com servers.

 

thanks in advance!

 

Jagoda

[chaos127]

If numerous requests coming from a particular internet address would potentially have a detrimental effect on others who might be trying to use a particular web server, then I'm suer you can understand why it might be necessary to block that address for the benefit of everyone else (particularly if your use falls outside the intended usage).

 

I don't know the details of any blocking policy that may or may not exist, but have you read the following: http://www.dmoz.org/robots.txt ?

[windharp]

The preferred method for sites using our data, is to download the RDF dumps and build a local copy of the directory. This is especially true for sites generating large amounts of traffic.

 

In the past, staff has repeatedly blocked data users that caused to much traffic, to force them to use the RDF instead of screen scraping. Unfortunately, only staff has access to the list of blocked IPs, so we can't tell you if your site is on is blocked or not. If you are on a "public" godaddy server, you might of couse not be the one who generated to much traffic, but since blocking is most effectively done by IP...

[jagoda]

Thankyou for the answer.

well I'm not sure if it is considered lots of traffic, but it was about 50 to 200 pageviews per day.

 

I tried to send mail to the staff, I got reply that their mailbox is full...

 

Is there any other way to contact them?

I guess they do prefer that I use the Dump-file but I dont know how to use it and I already done it with XMLHTTP.... and I dont think that it is so "heavy" on their servers...

[kazhar]

I don't see the goal to use data using XMLHTTPRequest as when you do it, non-javascript browsers doesn't have access to the content.

 

Anyway, if you're using PHP, you can use the dmoz2mysql project to load the RDF in an SQL database.

I did a tutorial to do it. But it's in french I'm sorry. Maybe I'll translate it into english one day or an other. But it's not my main priority.

http://www.aef-dmoz.org/blog/rdf-dmoz/

[drdrew]

Any Interface or Front-End for this parser?

 

Is there any one out there who has found or developed an interface(front-end) for this wonderful parser?

If so, I would love to have a copy.

 

Thanks in advance.

[textlink969]

i will also like to see that parser.