[NMLUG] Python tight loop causing massive CPU barfage

[moegold2001 at yahoo.com (Moses Gold)]

could it be worth building a flat database containing the first 1k of each
file?

--- Paul Tietjens <paul.tietjens@moriarty.k12.nm.us> wrote:

> Tim Emerick wrote:
> > have you checked out fgrep?  I've not used it but looking at the man seemed
> > to do what you are looking to do.
> > 
> > Tim
> > 
> 
> fgrep would probably work, as would a combination of find/grep/rm - and 
> we've used these.
> 
> It takes around two hours for these tools to walk through 230k files. 
> Probably related to the fact that grep/fgrep looks at the entire file - 
> where my script looks only at the first 1024 bytes.
> 
> I suppose we could make a fancier script (output first few lines, grep 
> THAT, act on matches) and that's how we ended up with this python thing. :)
> _______________________________________________
> NMLUG mailing list
> NMLUG@nmlug.org
> http://www.nmlug.org/mailman/listinfo/nmlug
> 



		
__________________________________ 
Do you Yahoo!? 
All your favorites on one personal page ? Try My Yahoo!
http://my.yahoo.com