@arstechnica Would probably have to be something like 24GB as a realistic minimum. I can see why they'd need them loaded all the time though. It takes a little bit to load a LLM from a SSD with a fast desktop PC. A smartphone/tablet could be near useless if it only loaded on demand.
I guess it goes without saying this whole thing is just going to wreck battery life. And it's still probably going to phone home with insanely private info.