More people should do usability tests. They're easy (see Steve Krug's books on the subject), and very eye opening.

If I had to pick between programmer-written tests and usability tests (if! you don't, of course) I'd pick usability tests, because programmatic software can't tell you if you're building the wrong product.