Search Engine Index

[duckbrain]

Search is fast if limited one or a few books, but searching over the entire catalog is time consuming. An index should help with that.

This will require that the index be built when the books are being downloaded. There are currently no operations that occur on download of a book. This will have to change.

The index should be stored in an SQLite database next the catalog JSON file. eg: ~/.ldss/eng/index.db

[truesilver92]

There are many ways to improve the search, but a couple we really should consider including are:

• stemming (probably using porter stemmer)
• removal of stop words (and creation of stop word list)

maybe doing spell check, though browsers and phones have this as a feature already