[NMLUG] Python tight loop causing massive CPU barfage

[paul.tietjens at moriarty.k12.nm.us (Paul Tietjens)]

Tim Emerick wrote:
> have you checked out fgrep?  I've not used it but looking at the man seemed
> to do what you are looking to do.
> 
> Tim
> 

fgrep would probably work, as would a combination of find/grep/rm - and 
we've used these.

It takes around two hours for these tools to walk through 230k files. 
Probably related to the fact that grep/fgrep looks at the entire file - 
where my script looks only at the first 1024 bytes.

I suppose we could make a fancier script (output first few lines, grep 
THAT, act on matches) and that's how we ended up with this python thing. :)