Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
ioc.exchange is one of the many independent Mastodon servers you can use to participate in the fediverse.
INDICATORS OF COMPROMISE (IOC) InfoSec Community within the Fediverse. Newbies, experts, gurus - Everyone is Welcome! Instance is supposed to be fast and secure.

Administered by:

Server stats:

1.3K
active users

ioc.exchange: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.7

Quiet public
Christoffer S.

@troed
Really cool. Have you by any chance had a look at Alpaca yet?

Quiet public
Troed Sångberg

@cstromblad Not yet - there's been no GPTQ 4-bit version. Seems they might be appearing now though so will find some time to test it out.

Could CPU offload bigger models but need the chatbot to be fast enough to not be too boring for the kids' attention span ;)

Quiet public
Troed Sångberg

@cstromblad Testing with elinas/alpaca-13b-lora-int4 now, it's at least not worse from what I can tell.

ExploreLive feeds
About