Sign up, and you'll be able to ignore users whose posts you don't want to see. Sign up
Sep 19, 2024
11:32:32am
franklyvulgar All-American
yes.. the new term is called RAG where you augment what the LLM does by
adding your 'accurate' data sources, the problem with long books is you'll have to copy and paste (chunk) them up and keep sending them to the LLM. you can also download like ollama and run a local language model and do the same thing (I've programmed those for clients that don't want their data going to openai across the internet and not having to pay their per token api cost), but yeah you'll need the text somehow, I think GPT can do OCR on the pages if you can take pictures of them, I haven't tried, but that sounds tedious. RAG sounds fancy but all it literally is just like copy and pasting into the LLM as part of the conversation.
This message has been modified
Originally posted on Sep 19, 2024 at 11:32:32am
Message modified by franklyvulgar on Sep 19, 2024 at 11:37:35am
Message modified by franklyvulgar on Sep 19, 2024 at 11:46:13am
Message modified by franklyvulgar on Sep 19, 2024 at 11:48:58am
Message modified by franklyvulgar on Sep 19, 2024 at 11:49:21am
franklyvulgar
Bio page
franklyvulgar
Joined
Sep 11, 2006
Last login
Sep 19, 2024
Total posts
27,057 (20 FO)