Flutterby™! : Large language model on M2 laptop

Next unread comment / Catchup all unread comments User Account Info | Logout | XML/Pilot/etc versions | Long version (with comments) | Weblog archives | Site Map | | Browse Topics

Large language model on M2 laptop

2023-02-02 19:36:10.173053+01 by Dan Lyke 0 comments

How to implement Q&A against your documentation with GPT3, embeddings and Datasette

Calculating embeddings with gtr-t5-large in Python

I've long wanted to run some kind of large language model on my own computer. Now that I have a M2 MacBook Pro I'm even more keen to find interesting ways to keep all of those CPU cores busy.

Running the Sentence Transformers gtr-t5-large model.

Via.

[ related topics: Monty Python Sports Python ]

comments in ascending chronological order (reverse):