Adding New Blogs
Some of you have noticed an increasing number of blogs added to the index in the past week (click the image for a larger view).
While the impact isn't huge, yet, it has the potential to grow very quickly. Last Spring, our former Admin (and still friend) AdamF developed a solution called CleanFeed. The basic concept is to take in the content of the ping cloud and sort out the wheat from the chaff. SubWolf and I have been working over the last couple of weeks to tidy up and get CleanFeed online, permanently. It's moving along pretty nicely, but there are still some limitations on what the system can do.
The numbers are pretty staggering. In the course of a few minutes, we grab 30-50 thousand pings from the cloud. About 9% of those appear to be "good" blogs. Our blacklists screen out 46%, and unsafe file extensions or banned top level domains filter out 31%. We also see 6% with no dates or not enough posts, 6% time out, and 3% return an error when CleanFeed tries to read them.
For now, you should see an average of 10 entries per minute added to the index. You'll have lots of opportunities for chips, karma and sigma from voting these new blogs and killing off our mistakes. If you see any patterns emerging, please let us know so we can tweak the filters.
--
Ken
Comments
Lembaga Seni Bela Diri Hikmatul Iman Indonesia ranting UIN Bandung
Posted by: LSBD HI UIN Bandung | September 26, 2008 09:13 PM
Ah... nice, but lest opportunity for sigma gains by adding new blogs manually.
:(
Posted by: Eyedee Tentee | September 27, 2008 04:50 PM
how to submit blog directory
Posted by: neeraj | October 1, 2008 04:19 AM
my space.
Posted by: anna | October 1, 2008 10:16 PM
i am not here
Posted by: virtuelfeeling | October 3, 2008 05:06 PM
larelboc
Posted by: bocrela | October 7, 2008 09:40 PM
no comment
Posted by: Ris Fandi Yanto | October 15, 2008 05:29 AM
yandex blogs
Posted by: blogs | October 16, 2008 10:44 AM
hi uin bandung blog
Posted by: Hikmatul Iman ranting UIN Bandung | October 17, 2008 10:23 AM
hi uin bandung blog
Posted by: Hikmatul Iman ranting UIN Bandung | October 17, 2008 10:24 AM
This company stock (ROKE) is set to take off. Worldwide client base in the mobile communications space. See the details at www.icoft.com/roke.html
Posted by: icoft123 | October 18, 2008 01:11 AM
WORLDWIDE client base in the cell phone sector. Tremendous opportunity to get in the stock now. Check out how big the opportunity is at www.icoft.com/roke.html
Posted by: icoft123 | October 18, 2008 01:13 AM