I wrote a post about how AI will interface with end-to-end encryption. TL;DR maybe not so well! https://blog.cryptographyengineering.com/2025/01/17/lets-talk-about-ai-and-end-to-end-encryption/
The average gaming PC already has plenty of GPU compute capacity to label your photos and misinterpret your text messages. I'd rather trust my home computer instead of anyone else's "private cloud." If we're really going to do AI to everything mobile, what's needed is an end-to-end encrypted link between phone and home computer. All the net-connected home appliances are in need of such connections as well. It's something to aim for.
The political situation is dangerous as always, but it's good to be reminded that easy mainstream end-to-end secure communication has only just recently arrived. There are enough of us who rely on it now that we're not going to give it up easily.
Either before or after reading this article by @matthew_d_green, go read this one by @tedted. They pair really well and should probably link to each other.
@matthew_d_green are you aware of Edgeless system's confidential compute product utilizing nvidia H100 hardware features? https://www.edgeless.systems/products/continuum sounds useful in this context
@matthew_d_green my futur will be to only allow IA agents that run on my trusted devices in my own mini home datacenter AKA homelab. I'm already there with my Home Assistant server linked to a local IA server with no cloud parts. Sad part will be the usual digital divide that will left out the majority's privacy as they will have to rely on big clouds offerings and privacy laws...
@matthew_d_green "Large Language Models (LLMs) which can generate and understand complex human text"
Can/should it be said, that an LLM understands? I avoid such wording.
@matthew_d_green The need for resources you control but don't want to carry around sounds like another use-case for selfhosting or community-hosting. Users should get the (practical) freedom to choose, which system they trust to do the inference for them. #BringYourOwnCloud