Yes, databases (saved on a hard drive). SillyTavern has Smart Context but that seems not that easy to install so I have no idea how well that actually works in practice yet.
I honestly have no idea what you're referring to now. I never asked for any ideas.
I was being sarcastic. If you pay for a prostitute you might as well pay for an AI service such as novelai.
And I replied to that comment, without any mouth foaming.
If they're local they'd be basically useless due to a lack of computing power and potential lack of indexing for a search engine chatbot, so I doubt it. It would also have to be so polished that it wouldn't require further user knowledge / input, and that's just not a thing with any local LLM I've come across. Mozilla can gladly prove me wrong though. I certainly wouldn't mind if they generally can make the whole process of local LLMs easier and more viable.
Yes, but what would a local model do for you in this case? Chatbots in browsers are typically used as an alternative / more contextualized search engine. For that you need proper access to an index of search results. Most people will also not have enough computing power to make use of any complex chatbot / larger context sizes.
Kids will do that either way when they get to that age.
It's honestly stupid. They just go to less moderated sites, or if you're lucky, learn how to use a VPN and bypass all this nonsense anyway.
Yeah, I heard they're also very privacy friendly.
America moment.
All of those could be terrible to be honest, because AI is a data tracking vacuum. An AI adblocker or content filter sounds cool at first, but it would mean it reads and analyzes your data, just like the shit you do with chatbots too. Reading your mails? That's basically what Google does for years with gmail, that's why they have such a good spam filter. I agree that a chatbot would be kinda useless though, even if privacy friendly, which in of itself would be great but I just don't see the use. This could simply be outsourced to a website.
There's no way it would be running locally.
The answers to both of those things depends very heavily on the details. I think focusing on their main products is a good thing, but adding AI sounds like one of those likely terrible decisions. We definitely need privacy friendly & open source based AI though, in all areas, so I hope this is Mozilla pushing for something sensible here.
You need a little gpu server farm for proper models & context sizes though. Single consumer gpus don't have enough vram for that.
See my other reply for some basic info & pointers.
The bots (what the actual girlfriends or whatever other characters are) aren't the problem. You can find them on chub.ai for example or write them yourself fairly easily. The issue the software, and even more so the hardware. You need something like the mentioned Kobold.ccp or oobabooga, and then you'd also need a trained LLM model that you can get on huggingface.co, which is already where it gets complicated (they'll be loaded within kobold or oobabooga). You also need to understand how they work in regards to context sizes & bytes, because they need a lot, and I mean A LOT of vram to work properly. Basically, the more vram you have, the better the contextual understanding, their memory is. Otherwise you'd have a bot that maybe knows to only contextualize the last couple messages. For paid services like novelai.net you basically have your bots run through big ass server farms with lots of GPUs that bundle their vram and processing power, giving you "decent" context sizes (imo the greatest weak point of LLMs and it is deeply rooted in how they work) and decent speed. NovelAI also supports front-ends like SillyTavern which is great for local bot management and settings, regardless if you self host or use a paid service (NOT EVERY PAID SERVICE HAS AN API FOR THIS! OpenAI's ChatGPT technically does too but they do not allow NSFW content and can ban you for that if caught).
There's a bunch of "free" online services too, like janitorai.com but most of them have slow speeds and the chat degrades significantly after just a few messages, because they have low context sizes. The better / paid models suffer from this degradation too but it is slower and less noticeable, at least at first. You can use that to get an idea of how LLMs work though.
Edit: Should technically self explanatory / common sense, but I would advise not to share ANY personal information through online service chats that could identify you as a person!
I tried oobabooga and it basically always crashes when I try to generate anything, no matter what model I try. But honestly, as far as I can tell all the good models require absurd amounts of vram, much more than consumer cards have, so you'd need at least like a small gpu server farm to local host them reliably yourself. Unless of course you want like practically nonexistent context sizes.
"AI" is funny anyway because you're basically gaslighting them the whole time to have them behave as they're supposed to.
I'm in my first NG+ run. I've skipped the story, thinking it makes sense to grind out the temples first until you've maxed your powers and equipment but after finding 14 temples Vlad does not give me any new locations anymore and there's still 10 of the powers at level 1. I found a planet that has anomalies, but no temple quest triggered there either. So, can you only upgrade a limited amount of powers per run? If there's only about 14 temples per run, then I would need almost twice as many runs than the ones needed to get the last armor, no?
Or is this just bugged and I'm basically stuck on that save?
Edit: Bigot mods love to censor me I guess.
Okay, disclaimer this is just a "not even 5 minutes in" type of thing at this point, but I wanted to start the complaining about a few things already. ;) Also, I use it without an account at this point. I don't know if that affects any of the app features right now, besides the obvious ones to communicate & vote of course.
-
Compact mode thumbnails are microscopic in size. Thumbnail size is already a sore spot for me because most Reddit & Lemmy apps are also pretty bad in that regard (likely focusing more on the big cards, dunno), but this is by far the worst example I've seen. It's especially sad considering that the desktop kbin page is the polar opposite to this. In compact mode it actually fills the entire space out that is available to it.
-
Thumbnails also cannot be swapped to the left side.
-
I love that there's an option to have all comments collapsed. However, I'd like it if I manually collapse a comment again (if we talk about the top level one), that it does not collapse the entire thing, including the content, but goes back to its previous state. I assume this might've been a case of "afterwards it is already read so we don't need it" design choice, but I'd like to see an option where collapsing comments manually doesn't do that.
-
The "swipe left to go back" option does not seem to do anything, or I am misunderstanding how it is supposed to work?
-
After scrolling for even just a little bit the app starts to slow down significantly.
-
The Android icon could be improved instead of just being a small square in a circle (I believe that's like the stock default icon settings on the newer Android versions).
So, after EndeavourOS's GRUB comitted suicide, me being too stupid to understand chroot despite wiki "tutorials" and the community rather trolling & gaslighting me instead of helping I decided to give Nobara a go. Usually I am a Plasma KDE guy, but thought since it's been a long time I try it out, especially since you can have it in a more classic configuration those days again, even though I'd miss out of Wallpaper Engine.
Unfortunately my experience has been nothing but awful. A bunch of random bullet points of my experience:
- I had real trouble connecting my BT headphones. At first it was "connected", but not really. Tried a fresh pairing mode, but then it showed two headphones. Then it connected, but as soon as I tried to adjust the audio input / output settings it lost audio again and I had to repeat it yet again. Now it works, and I decided to never touch the audio settings ever again.
- "Files" is constantly crashing. Using the search? Crash. Going backwards? Crash. Try to do "something"? Crash. Do nothing? Probably also crash (hyperbolic).
- "Files" data transfer for copying & deleting files is slow as hell for whatever reason (on decent Samsung SSDs mind you).
- "Files" cannot multitask. If you're copying, scanning, deleting or whatever, it won't do anything else until that process is done.
- "Files" and other Gnome applications frequently bug out if you try too many things at once, freezing or crashing them.
- "Files", or even Gnome as a whole, is so incredibly scrapped for features to achieve its simplistic look, that it lacks actual functionality.
- Gnome's settings are also missing for everything, or hidden in a gazillion different config menus, some of which I already forgot how to access again.
- Scaling scales not just the UI, but also 3D applications like games, reducing their actual resolution and making them blurry. The UI seemed to be blurry as well.
- Mullvad VPN's tray icon somehow turned into some three dots with a weird background.
- In the tray menu there's also a VPN toggle, which shows Mullvad, but being turned off. Turning it on disables my connection and I have to reconnect through Mullvad, which turns the toggle off again. No way to remove the redundant toggle as far as I can tell, but maybe it's in some hidden settings menu that I have yet to find.
- OpenRGB in this does not work with my NZXT Hue 2 Ambient. Keeps asking for resize zones, which according to a search should not be necessary, and wasn't necessary with the one I used in EOS either. Selecting any color just turns the LEDs off.
- Launching the Battle.net launcher through Lutris it also opens some ghost "OpenGL Renderer" application with it, taking up space on the task bar.
- Battle.net launcher can't be maximized without constantly resetting or displaying information beneath the task bar.
- Can't launch .sh files unless I explicitly right click & Run as program.
- Unfortunately it then launches with an additional empty terminal window, yet again taking up space on the task bar.
- Had to create a new FF profile because using my old one somehow was unusable in regards to its performance.
- The weather location for the little clock thingy apparently can't find anything, city or country, except some locations that aren't near me.
- Can't remove my own review in the Software center for one of the apps that I did prematurely.
- Tray area also has this little tiling menu. I tried tiling, hated it. Couldn't find a way to remove that icon to save space on the task bar.
- After a lot of apps started to hang I tried restarting, just to be left in a blackscreen and the PC not shutting down. Had to hard reset to restart.
- No EurKey keyboard layout. There's a 'German (US)' one that's close but it's missing symbols.
- Maybe probably more things that I can't recall right now.
And that's just after a few hours of usage. I was making fun of the tiny issues in KDE before, but if I have to choose between that and this disaster then I'm probably going to switch to the KDE edition, if I cannot find solutions to all this. I really don't understand how people can deal with it? Or am I somehow the only one?