Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
ioc.exchange is one of the many independent Mastodon servers you can use to participate in the fediverse.
INDICATORS OF COMPROMISE (IOC) InfoSec Community within the Fediverse. Newbies, experts, gurus - Everyone is Welcome! Instance is supposed to be fast and secure.

Administered by:

Server stats:

1.3K
active users

ioc.exchange: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.7

Troed Sångberg

@cstromblad Not yet - there's been no GPTQ 4-bit version. Seems they might be appearing now though so will find some time to test it out.

Could CPU offload bigger models but need the chatbot to be fast enough to not be too boring for the kids' attention span ;)

Apr 01, 2023, 05:36 PM·Quiet public·Web
0boosts·0favorites
ExploreLive feeds
About