Skip to main content

SmallFileBuffer and BigFileBuffer

TeraCopy

Following up on previous comments in the multiprocessing feature request thread.

One of the most common workloads I have, is copy/move files from local disks to network disks - and back. The payload is usually a mix of millions of small files (10-512KB) and thousands of medium to large files (10MB to 100+GB).

Using separate, configurable, buffers for small files could speed up the process greatly.

Posted by Ole Aldric ·
Status: Planned3 comments

Log in to comment and vote

Comments3

  • Jason Jensen

    •

    May 18

    I don’t know much about this but what would be great (at least in my mind, which is untrained), would be to have TeraCopy optimize it’s file copy automatically. It knows the files it’s going to copy, so why not order them by size or other characteristics, then copy them accordingly. It can slowly adjust options to optimize as it goes. For example copy the small files first using options that are best for small files, then slowly change to optimize larger files, then finally with the biggest files, use optimizations for those. Think of it like a constantly adjusting gear. Feel free to tell me if this is a horrible idea. I can take it.

  • rick.schwabe

    •

    Aug 15, 2025

    @Code Sector Any update on this topic ?

    • Ole Aldric

      •

      Aug 15, 2025

      It’s in planning. They will update once it is ready for testing. It can take some time to implement something like this.