Flutterby™!
: Large language model on M2 laptop
Large language model on M2 laptop
2023-02-02 19:36:10.173053+01 by
Dan Lyke
0 comments
How to implement Q&A against your documentation with GPT3, embeddings and Datasette
Calculating embeddings with gtr-t5-large in Python
I've long wanted to run some kind of large language model on my own computer. Now that I have a M2 MacBook Pro I'm even more keen to find interesting ways to keep all of those CPU cores busy.
Running the Sentence Transformers gtr-t5-large model.
Via.
[ related topics:
Monty Python Sports Python
]
comments in ascending chronological order (reverse):
Comment policy
We will not edit your comments. However, we may delete your
comments, or cause them to be hidden behind another link, if we feel
they detract from the conversation. Commercial plugs are fine,
if they are relevant to the conversation, and if you don't
try to pretend to be a consumer. Annoying endorsements will be deleted
if you're lucky, if you're not a whole bunch of people smarter and
more articulate than you will ridicule you, and we will leave
such ridicule in place.
Flutterby™ is a trademark claimed by
Dan Lyke for the web publications at www.flutterby.com and www.flutterby.net.