I want to interrogate a database of blog posts using AI but ChatGPT has token limits
What service can I use to ask questions about my database of blog posts? "Tell me everything you know about Grideon, my fictional character" etc
All the models will have token limits, especially if you're not paying for API access. You would have to tune a model based on the blog posts, but that's expensive, degrades model quality, and isn't easy to do.
Another thing you could do is have a model index the posts and then retrieve data based on search. The easiest way to do this would be download all the blog posts into a folder, then install cursor.com and open it on the folder. Cursor is for coding, but it will index your folder and then you can ask the model questions. You should be able to get this far with the free trial, but if you have a huge number of blog posts, it still won't work