Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Maximum number of files in a folder + NTFS performance

0 views
Skip to first unread message

Paul Moss

unread,
Jan 23, 2001, 11:06:43 AM1/23/01
to
Hello!

Couple of questions for you all:

* What's the maximum of files/folders that can exist in any given folder?
(on NTFS, NT4)

* Ignoring the maximum value, is their a practical limit on the number of
files in a folder, above which performance starts to degrade?

Thanks in advance,

Paul.

CHANGE username to just westes

unread,
Mar 28, 2001, 10:46:56 PM3/28/01
to
I've seen excellent performance in folders that have tens of thousands of
files. The key thing is to give the files very different names, so that
the indexing scheme NTFS is using won't find too many similar names to
search through. Naming files as "myfile00001, myfile00002, etc" is to be
avoided and better is "00001myfile, 00002myfile, etc".

One thing I have noticed is that if you create a folder with many thousands
of files, then delete those, that Windows doesn't shrink the data structures
it uses for the file directory, and this can create some very strange
performance side-effects as you continue to add and delete files. I guess
what I am saying is that if you plan to have 10,000 static files and not
change the contents dramatically every day, then you are probably okay.
But if you are going to have 10,000 files, delete them, create 10,000 new
files, delete them, and so on, you are going to end up with the data
structure that NTFS maintains for its directory continuously growing, maybe
fragmenting, and this will affect performance eventually. We found that
by just deleting the directory and recreating it you could reset things.
Knowing if your application requires a static or dynamic configuration is
very important to pursuing an efficient use of NTFS.

Our experimentation was with NTFS under Windows NT 4, and the new NTFS file
system may have changed things quite a bit.

--
Will

NOTE: To reply, CHANGE the username to westes AT uscsw.com

"Paul Moss" <pa...@9000i.com> wrote in message
news:94k9uj$g4l$1...@taliesin2.netcom.net.uk...

CHANGE username to just westes

unread,
Mar 28, 2001, 11:29:08 PM3/28/01
to
Actually, "00001myfile, 00002myfile, etc" isn't too hot either. :) You are
better off creating really random strings to prefix the filename.

--
Will

NOTE: To reply, CHANGE the username to westes AT uscsw.com

"CHANGE username to just westes" <DELETE...@uscsw.com> wrote in message
news:#k3T4LAuAHA.320@tkmsftngp05...

0 new messages