Saturday, February 28, 2009

need help: importing wikipedia

few months ago i wrote blueprint for importing wikipedia articles into plone. (reason was this post)
since then i didnt have enough resources (my leptop is not that fast) to import bigger set of articles into plone. i reached 25 000 articles then job was pushing and i need cpu for work. i would really like to see how far plone could go. is it possible to import whole wikipedia into plone? would be nice for promotion of plone... "look you can have wikipedia is that big enough for you sir" :P

well if you have some testing server that has spare cpu power and you are also wondering how far plone could go drop me an email and lets try too push it to the limits.


Anonymous said...

I'd love to see this happen. I'm guessing that there are a lot of edge cases with indexing, storage and other things that would show up.

Talk to Tom Lazar and Ross Patterson (tell them I sent you ;), they are working on setting up a nightly test suite for Plone so we can monitor the performance and memory usage of Plone 4 development. This way, we can answer questions like "Plone became 20% slower on May 3rd, what happened?"

Rok Garbas said...

i ment this to be more for promotion purposes, but if this could be used also for monitoring plone development, this would be even better.