]> http://www.translate.org.za/blogs/david/archives/cat_5/index.html David Fraser en-za David Fraser 2007-05-17T18:00:28+02:00 http://www.translate.org.za/blogs/david/archives/2007/05/17/T12_22_04/index.html 2007-05-17T12:22:04+02:00 David Fraser tools, development, ideas, opensource de-nuctifying the world I've started to investigate creating a Pidgin (formerly Gaim) plugin to control Skype. This means you're still using a closed network, but from an open program, which makes migrating easier (and allows people to try multiple networks from the same interface).

The Skype API docs are pretty good and it looks like the API can support at least controlling status, sending and receiving text messages, and making and receiving phone calls. So in principle a Skype plugin for Pidgin is a possibility.

There are a few docs on writing libpurple plugins for Pidgin but less comprehensively - the author of the Sametime plugin or the guy working on a MySpaceIM plugin probably know exactly how it works (the MySpaceIM plugin is a Google Summer of Code project that fits in with my idea very nicely). There is a C Plugin HOWTO in the source code which should get things started. Some ideas in the Adium Skype plugin bug as well.

On the way I read Silver Needle in the Skype which is an article on reverse-engineering Skype and using it - very interesting tech reading... but a shame they haven't made the code available

Well since it's 8 days till we leave Cape Town and head to Japan I'm not planning to actually do anything about this, but thought I'd write it up so I don't lose the links...

PS This blog doesn't currently have a comment mechanism so email comments are welcome to davidf at sjsoft dot com.]]> http://www.translate.org.za/blogs/david/archives/2007/05/14/T22_25_24/index.html 2007-05-14T22:25:24+02:00 David Fraser ideas, opensource
It started with Skype. Then xanga. And most recently it's been facebook. The speed with which facebook has spread amongst various of our friends is impressive. Some things about it are really good too - they're beginning to understand the sorts of things you can do with the Web.

But it's hard to explain that these sorts of things are the point of the Web as a Whole, rather than being a neat idea that can only work on a particular site. No-one understands the negative effects of a closed network. Or even more, the potential positive effects they're missing. Part of the problem is vocabulary - if you don't even have words to encapsulate the concepts to communicate, it's hard to argue for something. Open and closed networks are clear concepts to me but it's nice to embellish them somewhat.

So here's my attempt: A closed network utility under the control of one group that doesn't let you federate is called a nuct (a Network Utility Control Trap - don't let them innuct you into it). If you encounter one, you need a way of interacting with it that doesn't suck you in. The point of closed systems is of course, to prevent this.

But no-one seems to be doing the work required to break these things open We need a nuct-cracker suite (drum roll)

A simple start on easy ways to start breaking things open:

• open APIs to access data locked up in closed networks
  • a suite for different kinds of apps
  • social networks - same API to different ones
• plugins to open source open standards programs to interoperate with those networks
  • e.g. plugin to Gaim to control Skype
• open source servers with open APIs to replace the closed networks
• deploy and let the network effect take place

The trouble with tech pseudo-values: they're not the gospel. So on the one hand there comes a limit to avoiding things that would help good friendships because I think they could be done better. But more simply, I don't have enough time to actually create the online world the way I want it to be...

Is anyone doing something like this?]]> http://www.translate.org.za/blogs/david/archives/2006/10/05/T21_58_13/index.html 2006-10-05T21:58:13+02:00 David Fraser tools, ideas, opensource Code Search on open source code, I thought I would put it to good use: searching for pootle in filenames ending with .po helps you to quickly find some projects that are using Pootle to edit their PO files, and you can even see which version

Another nice way of showing how Pootle is gaining traction...]]> http://www.translate.org.za/blogs/david/archives/2006/03/03/T23_51_45/index.html 2006-03-03T23:51:45+02:00 David Fraser ideas, opensource Zimbra is a fantastic open source mail server. It basically wraps Postfix, and has a beautiful webmail interface including a great calendar system. Yes, AJAX, buzzwords, all apply.

I've been wanting to migrate my mail into an IMAP server with a nice webmail frontend for a while. The advantages: being able to use mail from more than one machine, including my laptop when away and disconnected, other members of the family being able to use mail, etc, etc. Zimbra seemed like the best fit I'd seen since my last set of investigations (which incorporated dovecot, Hula, etc, etc).

At first I thought I'd just try out moving my mail in and see what problems I hit. By the time I had that done, I thought it would be a waste of time to retreat so I advanced headlong into the fray... Thus eating up a week of time or so, in which I was mostly unable to do very much with mail or anything else. (I should have thought beforehand, "I'm not really a mail admin person").

Anyhow, at the end of the process I think its been very successful and am very happy with Zimbra. This post is basically a summary of what I've learnt in the hope that other people will try out Zimbra and I will feel relief at the sense of not having to go through that again...

I had around 270000 messages in my Mozilla folder hierarchy, some dating back to around 1996. Total size about 4GB. This meant that the actual process of copying the mails was fairly cumbersome, especially if I wanted to check that everything copied OK (don't want to lose mail in the process!)

I installed Zimbra on Fedora Core 4, on my normal development / server machine. Don't be too concerned about the admonition to use a separate server, you can run Zimbra happily alongside existing instances of MySQL, Apache etc (Zimbra installs its own, hopefully in the future you can integrate it into your existing apps). I just needed to set Zimbra to only serve https, then I can access webmail etc on that port and my normal Apache takes care of port 80.

I then ended up developing some Python code to be able to do the things I wanted to fix up my mailbox etc. I've called this pyzimbra. These don't really consist of bindings to Zimbra code yet, but rather code to interact with the database, the message store, etc.

Issues encountered included:

Messages that refused to be copied (like finding a needle in a haystack), - I still have to resolve this one, only a dozen or so.

Dates on messages that didn't have proper date headers came out as 1st Jan 1970. Dates in the webmail view showed the time the message was copied rather than its original time. To fix these problems I wrote modules to connect to the zimbra database, and find the message file corresponding to each message in the database. I then checked if the message lacked a Date header and gratuitously added one based on other headers like Received (I'm sure this is naughty...). I then update the received date in the database (and alter the content-length if I added a date header). It was quite fun finding my way around the database etc, and the modules for doing this are fairly generic.

I'd also like to retrieve the Mozilla Flags (replied to etc) but unfortunately they don't get stored in the headers on the IMAP server after copying so that would involve finding the original message in the Mozilla mailbox that corresponds to the one in the Zimbra store.

Migrating my Mozilla mail filters to Zimbra: Zimbra uses Sieve for mail filtering. There is a nice utility for converting Mozilla's msgFilterRules.dat to a Sieve script (Javascript in a web page - use "/" as a separator in the option): mozilla2sieve. The Sieve script is stored in an LDAP attribute that I couldn't seem to access. You can access it via the zmprov utility, but there are caching problems.

The more serious issues are that Zimbra's Sieve implementation uses regular expressions, which makes havoc when you try and download a few thousand messages that have been queuing up and none of them get filtered - it will only display errors with the script when it actually tries to filter them. Look out for [ and *!!! Interestingly the Webmail Filters page basically deals with an XML representation of the Sieve script that it sends back and forth to the server.

If you're just running a few accounts through Zimbra and your main domain is hosted elsewhere, the Split Domain article on the wiki is really helpful.

Since I'm on an ADSL connection with a changing IP address, I'm using fetchmail to retrieve my mail periodically. Refused SPAM messages give a 501 response to the SMTP instruction.

Finally I wrote some nice backup scripts and utilities. zimbra/scripts/linkfolders.py is quite neat - it creates a directory structure on disk like the Folder structure in Zimbra, and symlinks the messages to their home on the message store. Nice for working out disk allocation, and as an alternate backup mechanism.]]> http://www.translate.org.za/blogs/david/archives/2005/12/08/T11_42_37/index.html 2005-12-08T11:42:37+02:00 David Fraser ideas Ndiyo, a non-profit that's making ultra-thin clients called Nivo (Network-In, Video-Out). They're basically designing an FPGA that can support VNC or RDP and so creates a tiny little box that has a network connection, keyboard and mouse connectors, and a VGA out. Some of the team are the original VNC developers, which must help.

Absolutely brilliant idea. But the news since then has been silent. They're supposed to be working on a new version offering local USB ports etc, which would be an added bonus. Quentin Stafford-Fraser, one of the founders, blogged about it recently, but that's all. Newnham Research, the company they work with, is intentionally keeping a low profile...

I think it would be great if they made this available in its current form (costing less than 100 GBP to assemble at low volume!) or at least posted more news rather than disappearing into a developing hole.

Update (2006-02-17): more news has indeed emerged, though its not yet commercially available they're having trials (including in South Africa!) and seem to be doing cool stuff...]]> http://www.translate.org.za/blogs/david/archives/2005/11/29/T10_31_13/index.html 2005-11-29T10:31:13+02:00 David Fraser openoffice, language, tools, ideas KiLinux team on using ooo-build for building localized OpenOffice.org.

Kamusi Project Internet Living Swahili Dictionary is a good read, this is a great project.

Tanzanian government uses OSS for localisation shows how the government is realising the importance of free software.

Also found this article on the Guardian on Owning ideas a good read - not neccessarily technically right in everything, but has some good insight and is accessible to people unfamiliar with the debates... e.g. Patenting ideas rewards failure and makes success more difficult. ... This is madness. Ideas aren't things. They're much more valuable than that

Looks like Firefox 1.5 is going to be released shortly, thus making this a fun week Most of the issues in the translate toolkit for Firefox 1.5 have been resolved, there are still some that I'm working on but people seem able to produce their translations OK using it.]]> http://www.translate.org.za/blogs/david/archives/2004/07/06/T16_55_01/index.html 2004-07-06T16:55:01+02:00 David Fraser ideas Dwayne a while ago - why not use lamp posts to hold WiFi HotSpots - and start a mesh that edges from highways into suburbs...]]> http://www.translate.org.za/blogs/david/archives/2004/07/06/T12_26_42/index.html 2004-07-06T12:26:42+02:00 David Fraser ideas Metadata for the desktop by Edd Dumbill.

I've really been enjoying using KImDaBa to manage my photos. But it doesn't make it easy to share the photos in a categorized way with those not using Linux, or over the web... I wrote a little wxpython app that can read the database. But then I thought, actually a lot of the stuff in KImDaBa would be really useful for indexing other kinds of files (e.g. documents, music, sermon recordings)... but it would really need to be stored as metadata associated with each file.

And then I started reading on the semantic web and thought, this is really how it ought to be done, rather than the ad-hoc xml style of KImDaBa. In fact the article by Edd contains a good description of RDF and how applicable it could be on the desktop.

The real advantage would come if someone like FreeDesktop.org helped to define a standard way of attaching metadata to files (on a filesystem like Reiser, this can be done in the filesystem, but to work more broadly it would have to be in separate files), and perhaps even standard ways to index this metadata. Then KDE, GNOME, and even Windows tools could all work on top of this unified system. This should be done now, rather than waiting for new filesystems like WinFS which might simplify the process in the future. And an open source standard/architecture would gain a lot of traction...]]>