Large language model on M2 laptop
2023-02-02 19:36:10.173053+01 by Dan Lyke 0 comments
How to implement Q&A against your documentation with GPT3, embeddings and Datasette
Calculating embeddings with gtr-t5-large in Python
I've long wanted to run some kind of large language model on my own computer. Now that I have a M2 MacBook Pro I'm even more keen to find interesting ways to keep all of those CPU cores busy.
Running the Sentence Transformers gtr-t5-large model.
Via.