Format of pipermail/Mailman database/ files?

I'm wanting to write a tool that looks at some pipermail archives and creates a MessageID to URL table.

If I run `strings /var/lib/mailman/archives/public/discuss/database/2011-March-article` I can see that the information that I want is in these database files. If I look at /usr/lib/mailman/Mailman/Archiver/pipermail.py it looks like this is a baddb formatted file.

If I try to write a python script to read these files, all I get is:

bsddb._db.DBInvalidArgError: (22, 'Invalid argument -- /var/lib/mailman/archives/public/discuss/database/2011-March-article: unexpected file type or format')


Anyone have any ideas? I'm not a Python programmer, so it is quite possible that I'm just not understanding how to do things in Python. Any suggestions greatly appreciated.

Note: This is python-2.4.3-27.el5_5.3 , on a CentOS 5.5 machine. I'm running the following script on the same machine that is writing the files, so there won't be a version mismatch.

#!/usr/bin/python

import os, sys
import bsddb

path = "/var/lib/mailman/archives/public/discuss/database/2011-March-article"

db = bsddb.btopen(path)

Comments

Post a Comment

Popular posts from this blog

Will the Conservative Party choose to fail like the US Democrats?

As a current Conservative party member I have received fundraising calls from the Conservative party.  The worst so far was from someone who started by talking about the leadership race, and I mentioned I have made a donation to my candidate.  She then spoke about how this increases the donation limit for the year : that I can donate to the candidate and to the party. She then proceeded to list the party talking points, one of the first was how the Liberal carbon tax was a tax on everything.  To be honest, I didn't hear anything else she said as it was clear that there was no possibility I would be donating to my candidate -- Michael Chong -- and a party that was apparently campaigning against the only candidate that has resonated with me so far.  Michael Chong's revenue neutral green tax shift (from income to carbon) was the policy that made me take notice of the leadership race, and to learn about other policies we agreed on. As politely as I could I hung up ...
Read more

Taxpayers should pay authors for educational uses of works, not intermediaries

Replying to a Letter to the Editor in The Varsity . It is taxpayers and authors that are paying the costs of this ongoing dispute, one way or the other. What we are effectively discussing is a government funding program masquerading as copyright, and because of the misdirection that this is a copyright issue we are allowing intermediaries like educational institutions, collective societies, foreign publishers, and all their lawyers, to extract the bulk of the money. If Mr. Degen was focused on Canadian authors getting paid he would be agreeing with me that we need to redirect taxpayer money misspent with the current regime towards a program similar to the Public Lending Right . The existing Public Lending Right funds authors based on their works being loaned by libraries, and a "Public Education Right" could directly fund authors based on specific uses of their works in publicly funded educational institutions. This would be applied only to that very narrow area o...
Read more

Next steps for the Canadiana.org platform: IIIF, JHOVE

This is a new fiscal year.  I'm excited to discuss some of our current plans, and hopefully get some feedback and help from the community. Some related Internal Projects for our 3 person DevOps team include adoption of IIIF APIs, JHOVE , and updates to associated METS application profile and schemas. A quick note about when? The Phoenix Project describes how IT Operations only do 4 things . This work falls under Internal Projects, and will be bumped by Business Projects as well as Unplanned Work. While this work may be exciting to the DevOps team, other work will take precedence.  This means that while I can say we are working on it, we can't offer any useful idea of when there will be something other people can use. International Image Interoperability Framework The name gives an impression much less than what this community is doing.  It isn't only a common way to access images, but a community that is working on common APIs and documentation for institutions like ou...
Read more