Chris Green asked:
Are there any tools out there which will take a mbox file and remove duplicate messages? Removal on the basis of Message-Id: would be fine.
formail (which I think comes with procmail or delivermail, depending on your distribution) can do that for you.