# Search Engine One of my favourite engineering products to build. There are so many interesting problems! ## Topics - [[NDCG]] - [[Web Crawling]] - [[Okapi BM25]] - [[ChatGPT_20231206T181215634Z_BM25AlgorithmExplanation]] ## Alternative search engines - [Marginalia](https://www.marginalia.nu/) - [Kagi Search](https://kagi.com/) - [Lieu — webring search engine](https://lieu.cblgh.org/about) - [lieu — alexander cobleigh / cblgh.org](https://cblgh.org/lieu/) ## Technology - [[ElasticSearch]] - [[Lucene]] - [[SOLR]] - [[WARC]] - [[Heritrix]] ## Links - [[NOTES - Adrian Raudaschl - So you want to build a search engine]] Recommended links from the article above: - [Relevant Search](https://www.amazon.co.uk/Relevant-Search-Mr-Doug-Turnbull/dp/161729277X?&_encoding=UTF8&tag=iam46-21&linkCode=ur2&linkId=12ee4be3491a5a017fcabfee90ff6c05&camp=1634&creative=6738), Doug Turnbull and John Berryman (Book) - [What Every Software Engineer Should Know About Search](https://scribe.rip/p/what-every-software-engineer-should-know-about-search-27d1df99f80d), Max Grigorev - [Measuring Search: Metrics Matter](https://jamesrubinstein.medium.com/measuring-search-metrics-matter-de124c2f6f8c), James Rubinstein - [On Search Leadership](https://dtunkelang.medium.com/on-search-leadership-815b36c15df1), Daniel Tunkelang - [Search Product Management: The Most Misunderstood Role in Search?](https://jamesrubinstein.medium.com/search-product-management-the-most-misunderstood-role-in-search-2b7569058638), James Rubinstein - [The Future of Text](https://www.amazon.co.uk/Future-Text-2020-Vision-ebook/dp/B08NGB2S1G?&_encoding=UTF8&tag=iam46-21&linkCode=ur2&linkId=2602ea42ae0c00d1e430d29d241af8bd&camp=1634&creative=6738), Frode Hegland (Book) Also: - [Query Understanding](https://queryunderstanding.com/) (also Tunkelang)