Heres the power of the commandline, i wrote up a tutorial so check it out:
Tutorial Ninjas » Blog Archive » Why Pipes Rock
'ls | xargs -n 1 du -lh | grep -v .conf' - will also go into folders(filtering out .conf)
or you could just do the grep -v ontop of your ls -s.