There was a great line I couldn't quite remember from "One Hundred Years of Solitude" Search engines & ChatGPT couldn't recall it either from my bad description Wrote a little 20 line program to read the whole book and found it in a minute, cost 25 cents Wild times we live in

Dec 30, 2023 · 5:28 PM UTC

68
245
47
3,450
Being able to apply bulk ad-hoc intelligence to tasks like this makes so many things feasible that weren't before. Doing things like academic research where you need to crawl through huge tomes is going to get so fun and efficient.
3
5
1
446
Replying to @GrantSlatton
This is amazing with enormous potential for literary and archival research. Thanks for sharing, Grant.
1
33
It’s going to be so much easier to search digital archives with this tech. Put your dissertation topic into a program and kick off a script to run overnight and read a thousand books looking for relevant information.
2
5
75
more replies
Replying to @GrantSlatton
Didn't know about ai_fn before. Thanks for sharing!
1
1
1
89
@AskMarvinAI is a very useful little library for quick scripts like this
3
3
111
more replies
Replying to @GrantSlatton
curious if a text-embedding + cosine similarity would work well here too, then it'd be free!
1
18
Yep
Joseph D. Janizek @joejanizek
30 Dec 2023
For those allergic to paying for inference or who have data they may not want to send off to someone else's servers, this can easily be done locally. Using Nomic's Embed4All (which as far as I can tell is CPU-optimized SBert) and a cosine similarity search also finds the passage!
15
Replying to @GrantSlatton
Very interesting. For a total newbie, what are the tools here?
1
Grant Slatton
 @GrantSlatton
30 Dec 2023
Replying to @benmaritz
This is using the @AskMarvinAI library from @AAAzzam which makes writing these types of little scripts trivial. Internally it's delegating to the @OpenAI API (gpt-3.5-turbo, specifically).
1
Replying to @GrantSlatton
Also dang that is a good quote
1
5
Hit me like a truck the first time I read it. Stuck with me all these years but forgot the exact wording!
1
3
Load more