[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[sup-devel] importing your sup email into heliotrope



Hi William,

Excerpts from William Morgan's message of 2011-12-30 20:31:24 +0000:
> 3. Import your mail sources into heliotrope. Mbox and maildir sources
>    should go pretty quick; IMAP, as usual, will be very slow. For each
>    source you can do this:
> 
>      $HELIOTROPE_DIR> ruby -Ilib bin/heliotrope-import --dir <mailstore dir> --sup-dumpfile <dumpfile> --mbox <mbox file>
I think you meant --sup-label-file, or you did not push some commits yet :).

>    Or replace "--mbox <mbox file>" with the corresponding argument to
>    your source (use --help to see them all).
FYI: I used the following command to get all my sources in one command line:
$ grep uri .sup/sources.yaml | sed 's/^[ \t]*uri: maildir://g' | tr '\n' ' '

The total time for importing was:
; scanned 133872, indexed 122314, skipped 9485 bad and 2073 seen messages in 12484.5s = 10.7 m/s

Which is awfully long. I took a look at the process list and saw lots of
html2text process running. Why are they run at all? Are they also run for
plain-text emails? Most of my emails surely are plain-text, without any need to
convert HTML.

> 5. Finally, reorder the index so that messages appear in order:
> 
>      $HELIOTROPE_DIR> ruby -Ilib bin/heliotrope-reindex --reorder --dir <mailstore dir>
>      $HELIOTROPE_DIR> mv <mailstore dir>/index <mailstore dir>/index-old
>      $HELIOTROPE_DIR> mv <mailstore dir>/index-reindexed <mailstore dir>/index
Ugh, this took a lot of time, too:
; reindexed 120451 messages, skipped 0 spam and 1863 deleted in 9509.3s = 12.7 m/s

Also, the numbers don’t add up. This is a bit confusing. Is there maybe no
printing of the *final* status? Or is this intended?

Best regards,
Michael
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel