Defining Search Relevancy

How do you measure the relevancy of search engines? That’s a topic of discussion right now in one of our forum threads, What Is Relevancy. I’ve dropped a post with a lot of background material on the subject into the thread. Have thoughts on this tricky subject? Please come by and contribute.