This is the mail archive of the cygwin mailing list for the Cygwin project.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]
Other format: [Raw text]

Re: copying a million tiny files?


Brian Dessent wrote:
sam reckoner wrote:

I'm not exaggerating. I have over one million small files that like to
move between disks. The problem is that even getting a directory
listing takes forever.

Is there a best practice for this?

I know it's heresy but if you just want to copy files why not use the native XCOPY? It will not suffer the performance degredation of having to emulate the POSIX stat semantics on every file, just like the native DIR command in a large directory does not take ages because it simply uses FindFirstFile/FindNextFile which are fairly efficient (but do not provide sufficient information to emulate POSIX.)

I'm sorry Brian. We put up with allot from you but I think we have to draw the line at heresy. What is the penalty for heresy around here anyway? Expulsion? Flogging? Burning at the stake? Whatever it is, I think we need to make an example of Brian.

--
Larry Hall                              http://www.rfk.com
RFK Partners, Inc.                      (508) 893-9779 - RFK Office
216 Dalton Rd.                          (508) 893-9889 - FAX
Holliston, MA 01746

_____________________________________________________________________

A: Yes.
> Q: Are you sure?
>> A: Because it reverses the logical flow of conversation.
>>> Q: Why is top posting annoying in email?

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]