dmoz search vs ODP RDF dumps

gopher

New Member
Joined
Feb 24, 2011
Messages
4
Hi,
I've noticed that there is a new updated set of ODP RDF dumps @ http://rdf.dmoz.org/rdf/ as of 18-Feb-2011 17:07
I've found a number of sites that can be found by using the search feature on DMOZ, yet they are not in the most recent RDF files.
Additionally, when browsing to the category returned by 'search', they are not listed.
It appears that the category listings are up to date, yet the search database function is using outdated data.

ex: (hope this is not against rules of posting link, as I'm posting an internal DMOZ link...)
http://www.dmoz.org/search?q=u:torchlit.net returns 1 result.
Yet the category: http://www.dmoz.org/Games/Video_Games/Roleplaying/T/Torchlight/ does not list the site

Question: How soon is the search function updated to use the most current data? if at all?

Thanks
 

windharp

Meta/kMeta
Curlie Meta
Joined
Apr 30, 2002
Messages
9,204
Generally, search is based on the most current RDF file, which is copied over to the search server automatically. But as it happened quite frequently after RDF generation problems in the past, I assume the automatic update of the search server is not working yet.

In DMOZ 1.0 the date of the used RDF file was shown on the search results. Unfortunately it currently isn't, which makes it less obviuos which date the search data has.
 

photofox

Curlie Admin
RZ Admin
Joined
Jun 9, 2010
Messages
2,092
Location
[Right here]
With the implementation of DMOZ 2.0 search no longer uses the RDF, the search database updates daily (roughly every 6 hours if I remember correctly). There is a bug causing removed listings to still show in search results even after the database updates. AOL is aware of the problem and is working to correct it.
 

gopher

New Member
Joined
Feb 24, 2011
Messages
4
re: the bug. shouldn't be to difficult to fix. ( :2cents: )
I caught the discrepancy while developing a php script that uses the RDF data.
If AOL needs help, I'd be happy to lend a hand... heh :lol:

ok, thank you for your replies.
 
This site has been archived and is no longer accepting new content.
Top