home Mail List
Info
Info
Meetings
Goals
Upcoming
Projects
FAQ
Security
Links

[Date Prev][Date Next] [Chronological] [Thread] [Top]

[NMLUG] Python tight loop causing massive CPU barfage



Peter Espen wrote:
> 
> Sorry, make that 4000 directories and 735,000 files in 9 minutes.
> 
> On Wed, 09 Feb 2005 18:15:04 -0500
>  Peter Espen <peter@espen.net> wrote:
> 
>>

I'm not getting nearly that close:

{'dirs': 57275, 'files': 23284, 'matches': 6057}

real    52m37.037s
user    0m22.750s
sys     0m15.908s

Hardware:
Dual Pentium III Xeon 900mhz (2mb cache)
Smbios(Compaq) Raid Array with 10k rpm scsi drivers
2gb RAM.

I think something went wrong there, as well - since I know there are 
well over 23,284 files in the directory scanned.... (the find binary 
finds 300,000 or so)

Usually, this machine is under some kind of load.  It runs an ungodly 
amount of junk.

With my (poorly written) original script I get:
336153 files
real    36m17.832s
user    0m26.343s
sys     0m18.342s

So I'm not sure... perhaps find is faster than os.walk.




Please send sugestions and comments to webmaster@nmlug.org.
Valid XHTML 1.1! Valid CSS! Powered by Debian Powered by Apache