Python script to export Zwiki pages to text output --Win Myint Aung, Thu, 01 Mar 2007 08:50:54 +0000 reply

I looking the python script that can export Zwiki contents in Zope to text output. please help me.

wiki.zope.org news --Simon Michael, Wed, 07 Mar 2007 22:13:23 +0000 reply

An update on the wiki.zope.org/*.zwiki.org server for 2007/3/7:

Uptime troubles and investigations continue, and there have been significant outages as I haven't always been able to respond quickly. Thanks for your patience; we are making progress.

I have been watching the server processes and tuning various things. Sascha Welter implemented http conditional-get handling for zwiki, and also configured httpcaches for several of the (dynamic) front pages. We have reduced cpu load a lot, and made loading of previously-visited pages a lot more snappy!

(Note there is an open issue with conditional-get: Firefox and Mozilla users with default settings will often have to reload after an edit to see the changes. We have some ideas to prevent this, until then I might have to revert this feature.)

Edit operations, especially those touching many pages, can still be rather slow as we are still memory-constrained (~250M quota). The server is currently running two zope threads with cache-size 3000. When it exceeds quota (be it through normal growth or memory leak) it is restarted; this is still happening one or more times per day. Restarting and warming up the caches is quite slow (can be 5-10 minutes if I'm not mistaken).

I have gone from 7-day to 2-day nightly packs to keep zodb size around the 1G mark (and within the 8G disk quota).

Martijn Faassen is pursuing a possible new, beefier hosting situation.

Thanks also to Sascha Welter, Michael Haubenwallner, Christian Theune and anyone else I've forgotten, for dropping by #zwiki on irc.freenode.net and helping to troubleshoot and fix issues.

Cheers! - Simon

PS I seem to have too many places to post such news: - zope-web list/gmane.comp.web.zope.websites newsgroup - http://wiki.zope.org/AboutThisSite - http://wiki.zope.org/zope3/AboutThisSite - http://wiki.zope.org/zope2/AboutThisSite - http://zwiki.org/GeneralDiscussion I will probably pick just the first 2 or 3 henceforth.

Firefox and Mozilla issue, see also... --betabug, Thu, 08 Mar 2007 09:46:01 +0000 reply

the issue #1316 FireFox doesn't load changes after editing with 304 enabled - we're working on a solution and there is a workaround.

wiki.zope.org news --EmmaLaurijssens, Thu, 08 Mar 2007 09:52:49 +0000 reply

> (Note there is an open issue with conditional-get: > Firefox and Mozilla users with default settings will often > have to reload after an edit to see the changes. > We have some ideas to prevent this, until then I might have to revert this feature.)

I guess that telling them to upgrade their broken browsers to IE is out of the question? ;-)

wiki.zope.org news --betabug, Thu, 08 Mar 2007 11:10:50 +0000 reply

> I guess that telling them to upgrade their broken browsers to IE is out of the question?

They could work around the problem, by making their browser behave like all the others with a config change... it's what most web apps tell their users to do. We'll find out if we can give them a better service.

adding tagging --jmax, Fri, 09 Mar 2007 00:48:10 +0000 reply

I'm thinking about hacking in a general tagging field -- something more flexible than subtopics or badges -- and am wondering if you have any general advice, especially re: hooking in to the catalog. Thanks.

adding tagging --betabug, Fri, 09 Mar 2007 09:17:12 +0000 reply

jmax, your description reads a bit vague to me, maybe you have to sketch out a little bit more what exactly you want to achieve. The term "tagging" is used for a number of related things. If your description gets longer - and if you want - make a new page, so discussion could get a bit more focussed there.

adding tagging --DeanG, Fri, 09 Mar 2007 22:29:02 +0000 reply

I'd LOVE that feature! See: ZWikiTaggingDiscussion

In the past I've been shot-down by badges and keyword searches seemingly meeting 80% of user needs, but tagsonomy sites seem to have flourished and not fizzled, so I think you're on to something. The folks who want to easily add a sortable field to ZwikiIssueTracker will also thank you.

adding tagging --betabug, Sat, 10 Mar 2007 08:27:11 +0000 reply

> I'd LOVE that feature

Uhmm, what feature? I have yet to see some kind of description of what exactly you want. I don't know about sm or anybody else hacking on Zwiki, but if I am trying to implement something, I want to have an idea what it's going to look like. So there is a field somewhere? Then what? Are the contents of the field simply searched with the search form? Are they used for anything else? I can't read anybody's mind, so people who want a feature will have to give details.

Based on detailed descriptions of a candidate feature programmers can decide on how hard it's gonna be to do it, if it's worth it, how to implement it, all that stuff. So far all I see is a war of the buzzwords.

adding tagging --jmax, Sat, 10 Mar 2007 15:34:19 +0000 reply

OK, here's how I see it, as the simplest possible implementation: On each page is a single input field called "tag this page", which can be used to add a tag phrase to a list of tags already added to that page (or empty, if none so far). That's basically it for the UI. The tags added to each page, though, need to go into the ZWiki catalog so that they can be searched. I think it would be an adequate first step to integrate this with the existing search, but there's an obvious use case for making it a separate search (i.e. with its own UI) from the existing one.

Here's the rationale: trying to do tagging by organizing existing pages (using the parent/subtopic hierarchy) means you have to actually HAVE an existing wiki page in order to use that as a categorizing element. A free-form tagging facility would allow people to put in arbitrary terms which may at some later date become wiki pages (or not). Using wiki badges is a little better in this regard, but it's a bit of a kludge and doesn't integrate nicely into the UI, unless you're prepared to turn the wiki inside out and make backlinks into a first class navigational element.

So, simplest possible thing: add one field, which goes to a list property on each page, and catalog them so they come up in the searches.

adding tagging --simon, Sat, 10 Mar 2007 19:49:10 +0000 reply

Not to be a damp squib, I'm not too enthusiastic about this, because

You could make the existing wiki-ish tagging more accessible through better UI, maybe ?

adding tagging --simon, Sat, 10 Mar 2007 19:55:19 +0000 reply

I see Dean anticipated my friendly fire.

In other news, I have installed MaildropHost?. Posting comments on heavily-subscribed pages should be a second or two now instead of 15.

adding tagging --simon, Sat, 10 Mar 2007 19:59:35 +0000 reply

As did jmax. :) Well never mind, I'll re-read the previous comments more carefully, please hack on!

MaildropHost? install --betabug, Sun, 11 Mar 2007 07:50:28 +0000 reply

Great! I don't know if it's a coincidence, but memory usage seems to be slightly lower too. Simon, any chance of a little writeup of your experience setting MaildropHost? up? I've seen you comment on it on #zope... there is awfully little about MaildropHost? on the web and I think it is of great interest to Zwiki admins.

#14 --EmmaLaurijssens, Mon, 12 Mar 2007 18:02:28 +0000 reply

I've sent a patch for #14, but it's not really clean code, so do with it whatever you want :)

See http://zwiki.ictio.nl/IssueTracker

Yay --EmmaLaurijssens, Wed, 14 Mar 2007 14:29:43 +0000 reply

Finally got my darcs repo working, including darcsweb! The urls are on CodeRepos.

Yay --Simon Michael, Wed, 14 Mar 2007 17:50:25 +0000 reply

Congrats! What trouble were you having ?

Yay --Simon Michael, Wed, 14 Mar 2007 18:22:35 +0000 reply

PS I seem to be not getting the stylesheet on your darcsweb interface.

nice example --Simon Michael, Wed, 14 Mar 2007 18:23:59 +0000 reply

On Wed, 2007-03-14 at 18:19 +0000, simon wrote:

> Frank - I especially liked your literate-programming style writeup, explaining each change and making this very understandable; your live demo, making it easy to try this out; and your darcs repo, making it easy to preview the exact changes (v key) and pull them now or at any time in the future without fear of forgetting. Here are my two concerns about this patch: 1. IssueTracker.dtml is becoming even harder to comprehend 2. in particular, without more investigation I don't know that adding yet another catalog field won't hurt our scalability; it seems to mean more work and conflict opportunities for zope. But the goodness of your patch submission conquered these fears! In it goes, thanks!

nice example --Simon Michael, Wed, 14 Mar 2007 18:27:10 +0000 reply

Sorry.. see http://zwiki.org/14MakeTheZwikitrackerListAllowFilteringSorting for context. A non-trivial change was made easy to accept by good patch submission practice.

Yay --EmmaLaurijssens, Wed, 14 Mar 2007 20:59:40 +0000 reply

Trouble? IIS6 on Windows 2003. I said this to Sascha earlier today, I don't have 6he illusion that I can convince my customers that their Windows shops should be converted to Linux shops, but I can introduce open source applications, as long as they run on Windows. Unfortunately many open source projects are largely Linux oriented. Understanding how to overcome this might push things in the right direction.

I'll look at the style sheet first thing in the morning :)

adding tagging --betabug, Thu, 15 Mar 2007 12:13:19 +0000 reply

See http://www.trac-hacks.org/wiki/TagsPlugin for an example implementation on a different project. I'll also add a "wishlist" issue, even though it' not "my" issue, as that's the proper way to get this in the wishlist queue :-) #1318 Tags interface

Add zwiki page to the wrong location --bmoon, Thu, 15 Mar 2007 14:29:29 +0000 reply

When I use the Add to Folder - Wiki page option, I get a wiki page on my Plone root, instead of in the wiki folder. This happens no matter which page I have displayed. So rather than the items being parented under FrontPage, they are singletons. I guess I have something configured incorrectly, though I have created wiki pages in the past. thanks for any help!

how to add network drive --birb, Fri, 16 Mar 2007 13:05:20 +0000 reply

Hi How can I add a link to a windows network drive (share)

Thanks

how to add network drive --EmmaLaurijssens, Fri, 16 Mar 2007 16:08:02 +0000 reply

Client-side: use the 'file://servername/sharename/pathname' format, or 'file:///drive:/pathname'.

Server-side: you need an extra product to do that. If you have Plone, PloneLocalFolderNG? is the best choice, otherwise you could try to use something like LocalFS. I can't guarantee that they work with UNC paths.

Add zwiki page to the wrong location --EmmaLaurijssens, Fri, 16 Mar 2007 17:55:52 +0000 reply

Parenting has nothing to do with folders in Plone. All wiki pages reside in the same folders, zwiki keeps track of the page hierarchy internally. If you want to create subtopics, you need to use the controls below the comment area, like on the bottom of this page.

If you have put your wiki in a Plone folder, the 'create' button might be missing due to issue #1220. Make sure you have the 'ZWiki: Add pages' permission checked in the ZMI.

Footnotes --Ben, Wed, 21 Mar 2007 11:33:50 +0000 reply

I can't seem to find the answer to this. I'm using Zwiki in a Plone site. I want a footnote to be created, so I use [1]?_ as described in the documentation. Where I want the footnote to appear, I use .. [1]?

This seems to work, in that the footnote marker will link to the actual footnote. However, zwiki puts a ? next to the footnote, as it thinks I'm specifying a Zwiki page. I'm using reSt. Any ideas on how to fix this?

Footnotes --betabug, Wed, 21 Mar 2007 11:48:42 +0000 reply

Ben, is that the same thing as Issue #512 describes?

Footnotes --Ben, Wed, 21 Mar 2007 12:08:44 +0000 reply

Yes, looks like it. Any sniff of a fix or a workaround?

Footnotes --betabug, Wed, 21 Mar 2007 12:13:56 +0000 reply

Hmm, there are some hints in the issue notes from Bob McElrath. I will have a closer look at it soonish, but can't promise anything.

darcs send problems --betabug, Wed, 21 Mar 2007 14:03:01 +0000 reply

Simon, mails with patches I send to darcs are accepted by the mail server at mail.joyful.com, but no processing seems to happen...

changing mail server --simon, Wed, 21 Mar 2007 17:19:25 +0000 reply

I am switching mail server, from from qmail to postfix.. any disruptions in mail flow should be resolved soon.

changing mail server --Encolpe Degoute, Thu, 22 Mar 2007 14:47:13 +0000 reply

friday comes early this week ;)

convert html --birb, Fri, 23 Mar 2007 07:51:03 +0000 reply

Hi How can I easely convert simple html and text page into zwiki format page ? Thanks

Footnotes --betabug, Fri, 23 Mar 2007 08:56:57 +0000 reply

Ben, I've got it fixed. I have some problems getting it into darcs, but if you want to get it fixed right now, go grab the patch from the issue page (#512).

convert html --betabug, Fri, 23 Mar 2007 13:58:31 +0000 reply

birb, no need to convert anything if you don't want to. You can put your existing html and plaintext files directly into Zwiki, without changing them. The plaintext pages can also be put into RST type pages and can be enhanced with minimal work effort. You can then work on growing your wiki from the existing files.

MaildropHost? install --Simon Michael, Sat, 24 Mar 2007 05:59:02 +0000 reply

> any chance of a little writeup of your experience setting MaildropHost? up?

Summary: it wasn't easy; it seems to be working well now. I haven't reported bugs; here's a start at least.

I installed http://wiki.zope.org/zope2/MaildropHost . I couldn't figure out the svn checkout command so downloaded the 1.19 tarball.

There is a helper daemon in MaildropHost?/maildrop; setting this up was a bear. I tried putting things in a number of different places. There are a number of pieces to configure and they handle paths inconsistently. I think I might have fixed/hard-coded a path or two, but since this isn't an svn checkout I've forgotten where.

The daemon died silently several times a day. I didn't get around to playing with the debug flag to find out why. When that happened the maildrop.pid file remains and maildropctl start doesn't work, but I found that maildropctl restart does reliably work. So I run that hourly with cron and that takes care of keeping maildrop running. (I researched daemontools, supervisor2 etc. but haven't needed them). I still run a checkmaildrop script to alert me if it finds the process missing.

I haven't seen this yet, but in past experience many kinds of unexpected content in emails caused it to break, which led to undelivered mail backing up in the queue. The checkmaildropqueue script will alert me when/if that happens.

Here's the final setup that works for me. I installed:

/zopeproducts/MaildropHost
/zopeproducts/MaildropHost/__init__.py
/zopeproducts/MaildropHost/CHANGES.txt
/zopeproducts/MaildropHost/config.py
/zopeproducts/MaildropHost/COPYRIGHT.txt
/zopeproducts/MaildropHost/dtml
/zopeproducts/MaildropHost/dtml/addMaildropHost_form.dtml
/zopeproducts/MaildropHost/dtml/manageMaildropHost.dtml
/zopeproducts/MaildropHost/help
/zopeproducts/MaildropHost/help/MaildropHost.py
/zopeproducts/MaildropHost/help/MaildropHost.stx
/zopeproducts/MaildropHost/help/MaildropHost_Add.stx
/zopeproducts/MaildropHost/help/MaildropHost_Edit.stx
/zopeproducts/MaildropHost/INSTALL.txt
/zopeproducts/MaildropHost/LICENSE.txt
/zopeproducts/MaildropHost/maildrop
/zopeproducts/MaildropHost/maildrop/.cvsignore
/zopeproducts/MaildropHost/maildrop/bin
/zopeproducts/MaildropHost/maildrop/bin/maildrop-redhat
/zopeproducts/MaildropHost/maildrop/bin/maildrop-suse
/zopeproducts/MaildropHost/maildrop/bin/maildropctl
/zopeproducts/MaildropHost/maildrop/bin/README
/zopeproducts/MaildropHost/maildrop/bin/start_maildrop
/zopeproducts/MaildropHost/maildrop/bin/start_maildrop.bat
/zopeproducts/MaildropHost/maildrop/bin/stop_maildrop
/zopeproducts/MaildropHost/maildrop/maildrop.py
/zopeproducts/MaildropHost/maildrop/testing
/zopeproducts/MaildropHost/maildrop/testing/config.py
/zopeproducts/MaildropHost/maildrop/testing/make_emails.py
/zopeproducts/MaildropHost/maildrop/testing/README.txt
/zopeproducts/MaildropHost/maildrop/testing/start_maildrop
/zopeproducts/MaildropHost/maildrop/testing/stop_maildrop
/zopeproducts/MaildropHost/MaildropHost.py
/zopeproducts/MaildropHost/README.txt
/zopeproducts/MaildropHost/SAMPLE_MAIL.txt
/zopeproducts/MaildropHost/seleniumtests
/zopeproducts/MaildropHost/seleniumtests/test1_instantiation.html
/zopeproducts/MaildropHost/seleniumtests/test3_deletion.html
/zopeproducts/MaildropHost/tests
/zopeproducts/MaildropHost/tests/__init__.py
/zopeproducts/MaildropHost/tests/test_Email.py
/zopeproducts/MaildropHost/tests/test_MaildropHost.py
/zopeproducts/MaildropHost/TransactionalMixin.py
/zopeproducts/MaildropHost/VERSION.txt
/zopeproducts/MaildropHost/www
/zopeproducts/MaildropHost/www/maildrop.gif

I added (for an ubuntu server):

/etc/init.d/zopemaildropctl
/etc/rc0.d/K21zopemaildropctl -> ../init.d/zopemaildropctl
/etc/rc1.d/K21zopemaildropctl -> ../init.d/zopemaildropctl
/etc/rc2.d/S21zopemaildropctl -> ../init.d/zopemaildropctl
/etc/rc3.d/S21zopemaildropctl -> ../init.d/zopemaildropctl
/etc/rc4.d/S21zopemaildropctl -> ../init.d/zopemaildropctl
/etc/rc5.d/S21zopemaildropctl -> ../init.d/zopemaildropctl
/etc/rc6.d/K21zopemaildropctl -> ../init.d/zopemaildropctl
/usr/local/bin/maildropctl -> /zopeproducts/MaildropHost/maildrop/bin/maildropctl
/var/lib/maildrop/
/var/log/maildrop.log
/var/run/maildrop/
/var/spool/maildrop/

and these monitor scripts:

#!/bin/sh
# /usr/local/bin/checkmaildrop - check that MaildropHost's maildrop.py is running
ps auxww |grep -v grep |grep -q maildrop.py || (
 echo WARNING! maildrop.py is not running, please investigate.)
 )

#!/bin/sh
# /usr/local/bin/checkmaildropqueue - check for stale messages in MaildropHosts/maildrop's outbox
# (usually a couple fail delivery due to bad addresses and can be deleted,
# XXX better if these could be converted to bounces)
QUEUE=/var/spool/maildrop
find $QUEUE -mindepth 1 -maxdepth 1 -type f -cmin +160 |grep -q '' && (
 echo WARNING! mail in $QUEUE undelivered after two hours, please investigate.
 )

and these rules in /etc/crontab:

# keep zope maildrop process up
0 *     * * *   root    maildropctl restart

# report a missing maildrop process (just for interest, the above will fix it)
55 *     * * *   root    checkmaildrop

# report stale undelivered maildrop messages
55 *     * * *   root    checkmaildropqueue

interesting blog on the benefits of code review --Simon Michael, Sat, 24 Mar 2007 15:56:23 +0000 reply

Google Mondrian: web-based code review and storage http://www.niallkennedy.com/blog/archives/2006/11/google-mondrian.html

Zwiki 0.59 rc1 released! call for translations --Simon Michael, Sun, 25 Mar 2007 03:17:29 +0000 reply

A RELEASE! No, seriously..

I finally straightened out the tangled series of changes that was my skin cleanup, begun in november (!), I believe I have pushed all submitted patches that were awaiting approval, and I have just released 0.59 release candidate 1. The final release will be on april 2. Now is a very good time for TESTING and TRANSLATIONS*, so that 0.59 will be a good 'un.

There has been some amazing bugfixing activity in recent months, and not from just 2, 3 or 5 people. Awesome work everyone! I must especially name one name which you'll see all over the darcs log - Sascha 'betabug' Welter! Hurrah!

-Simon

POST woes --EmmaLaurijssens, Sun, 25 Mar 2007 10:07:04 +0000 reply

My proxy seems to be bugging me, POSTing? large text pages fails for some reason. I wanted to add this to the "upgrade" section of the ReleaseNotes, but I can't, though I think it's important:

  • The standard issuetracker and filterissues pages now support sorting on issue name and reverse sorting (#14). For this to work, the catalog needs to be extended. Be sure to visit somepage/!upgradeAll and somepage/!setupTracker, or both pages will break.
  • If you have customized IssueTracker and/or FilterIssues pages, you might want to replace them with the standard pages. To do this, carefully review the changes you made. Make backup copies if you wish. Then, delete both pages, and upgrade with somepage/!upgradeAll and somepage/!setupTracker?pages=1.

outage, rc2 --simon, Sun, 25 Mar 2007 16:27:31 +0000 reply

All wikis were down for several hours due to some new code I uploaded and thought was sufficiently tested. Sorry about that.

RC2 has been released! Fixes the above bug, where zwiki failed initialization unless you were in the ZWiki directory.

POST woes --simon, Sun, 25 Mar 2007 16:29:30 +0000 reply

Thanks Frank. I will add to darcs and the wiki page.

upgrading issuetracker --simon, Sun, 25 Mar 2007 16:33:23 +0000 reply

Any chance we could make it just work (ie, not break) without requiring any special action ?

upgrading issuetracker --Frank Laurijssens, Sun, 25 Mar 2007 20:51:08 +0000 reply

IMHO one should always read the release notes before upgrading, that's life (not just software). upgradeAll is there for a reason, isn't it?

POST woes --EmmaLaurijssens, Sun, 25 Mar 2007 22:33:17 +0000 reply

Thanks, in the end Ben pushed a button on my laptop and the change went through... I should have asked him to do that earlier on :)

Zwiki 0.59 rc1 released! call for translations --EmmaLaurijssens, Sun, 25 Mar 2007 22:34:26 +0000 reply

A new nl.po is on it's way. You may also pull it from my repo.

wiki spammer --EmmaLaurijssens, Mon, 26 Mar 2007 20:57:13 +0000 reply

Our wiki spam vandal is active again. :(

Zwiki 0.59rc3 released, po file updates --Simon Michael, Tue, 27 Mar 2007 23:06:10 +0000 reply

I've released 0.59 release candidate 3. Changes:

  • simplify issuetracker sorting-by-name setup
  • update pot and po files from code
  • translation updates from rosetta
  • stylesheet.css was ignored; now looks for "stylesheet.css" or "stylesheet", in that order
  • New nl.po (Frank Laurijssens)
  • upgrade notes for issue tracker (Frank Laurijssens)

Darcs-using translators might find a few more strings to work on now. Rosetta-using translators should wait until the purple bars at https://translations.launchpad.net/zwiki/0.x/+pots/zwiki disappear (which means the latest upload has been processed).

Thanks - Simon

We're thinking of using Zwiki within the Blackboard instance (our course management system) here at Northwestern. Just trying out the editor and functionality.

-Brian Nielsen, Academic Technologies, Northwestern University, Evanston, IL

Hi Brian, --EmmaLaurijssens, Thu, 29 Mar 2007 21:31:05 +0000 reply

You may want to use the SandBox page for testing instead of this one, or create your own page. Good luck!

Regards, Frank