Extremely Slow Read Speed from CFS with LZMA compression

Home Forums PFM Audit Package End User Support Extremely Slow Read Speed from CFS with LZMA compression

This topic contains 2 posts, has 2 voices, and was last updated by  Joe Lowe 2 days, 6 hours.

Viewing 2 posts - 1 through 2 (of 2 total)
  • Author
    Posts
  • Hi, I am getting between 15-20MB/sec read speed from CFS files created with LZMA and a maximum part size of 4.5GB (DVD5) (not sure if that’s relevant), just thought I’d mention it.

    Comparably, the same CFS file compressed with ZIP gets upwards of 100MB/sec read speed and in some cases, upwards of 300-350MB/sec when transfering to SSD. Clearly, zip decompresses fast enough that it doesn’t present a bottleneck.

    Is this normal behavior? Can CFS include options for fast decompression for LZMA?

    This is an issue for me because I’m trying to use CFS to store ROMs (Video game rips) that require frequent accessing, but due to the slow decompression or slow read speed, this causes hiccups, stalling, and other performance issues to occur for the emulator while it waits for a file inside the CFS to become fully decompressed and read.

    Thanks!


    Joe Lowe
    Posts: 90

    LZMA is not going to be comparable to zip regarding performance. For your application I would suggest you stick with zip.

    If the CFS/CISO reader used multi-core decompression it would scale up a bit more for sequential IO, but zip would still be faster and scale better than LZMA.

Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.