The LSI Controversy, That Wasn’t.

There seems to be a bit of debate on LSI lately.  I’m not going to say too much about all the commentary back and forth, because frankly I feel senior Theme Zoom engineer (this guy BUILDS search engines) Kelly Reynolds, said it best when he said,

There is no LSI Controversy.

“Latent Semantic Analysis is an algorithm. An idea. A tool. It has many applications for which it is ideally suited, and some for which it is not. Some of those applications include, but are not limited to (from Wikipedia):

• Compare the documents in the concept space (data clustering, document classification)
• Find similar documents across languages, after analyzing a base set of translated documents (cross language retrieval)
• Find relations between terms (synonymy and polysemy)
• Given a query of terms, translate it into the concept space, and find matching documents (information retrieval)

Obviously if you are a search engine, the information retrieval would be most interesting. If you have a huge amount of research abstracts that you are trying to categorize for research purposes, you’d be most interested in document classification. Cross language retrieval would be right up your alley if you are tracking the history and evolution of Indo-European languages using their dated written histories. If you are trying to discover all of the ways that a particular concept is thought of and referenced, you’d focus on synonymy and polysemy.”

I had to smile when I came across Ferny Ceballos’ blog and the LSI: Passive Agressive Attack or Misunderstanding post, both because of the great personal writing style he always uses, and the graphic image of the bull (doing his business) he used, which of course, I promptly swiped to use on my own blog, too.  (I know you won’t mind, Ferny).

~ Technology Goddess