D. Moonfire<p>So, hacky trick with SeaweedFS when you have a danger of pinning and have a relatively small cluster (mine is only 40 TB with one extra copy or 010, so effectively 20 TB). Keep 10% free as a default.</p><pre><code>services.seaweedfs.clusters.default.volumes.c0.minFreeSpacePercent = 10;
</code></pre><p>When you run out of space, the cluster volumes flip the read-only flag which means if you go and delete a terabyte or so off the system, they don't pick it up (because the individual volumes are read-only).</p><p>So what I do is change the free space to 5%, do the deletes, and then change it back to 10% once the threshold goes under. There were a few times when I had to do the same thing with Ceph. I suspect many distributed file systems really don't like to be more than 90% full in general.</p><p>I actually go one step further by having a <code>cluster.nix</code> file that includes things like the free percentage so I can change one file, do a deploy to the entire homelab, then do some maintenance, and change it back.</p><p>I really should set up helm or something to tell me about these things before they happen but I haven't really figured out how on Nix. It was just too overwhelming and I couldn't figure out any useful monitoring that would ping me when there was an issue.</p><p>I've been also ignoring a problem with my one little Raspberry Pi in the cluster. It only had 1 TB drive on it, but that was preventing me from rebalancing everything. I've used some of my tax refund to get a new node to replace it, but it will take a while as they race the tsunami of tariffs that are following the order.</p><p><a href="https://polymaths.social/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SeaweedFS</span></a> <a href="https://polymaths.social/tags/nixos" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>nixos</span></a></p>
Recent searches
No recent searches
Search options
Only available when logged in.
ioc.exchange is one of the many independent Mastodon servers you can use to participate in the fediverse.
INDICATORS OF COMPROMISE (IOC)
InfoSec Community within the Fediverse. Newbies, experts, gurus - Everyone is Welcome! Instance is supposed to be fast and secure.
Administered by:
Server stats:
1.6Kactive users
ioc.exchange: About · Status · Profiles directory · Privacy policy
Mastodon: About · Get the app · Keyboard shortcuts · View source code · v4.3.4
#seaweedfs
3 posts · 3 participants · 0 posts today
ItzTrain<p>Aight.. So.. After fucking with this thing for the better part of the week in the <a href="https://hachyderm.io/tags/homelab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>homelab</span></a>. I have thoughts. </p><p><a href="https://hachyderm.io/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>seaweedfs</span></a>! Feels like an open-source project. It's aight so far, it's not as simple as you would think with it being one go binary, it's simple with one go binary. Feels like that nerdy ass teenager you knew about in high school. Fucked with the cool kids and was super smart.. Just never really felt like they were part of the crew! Yea this feels like that! </p><p><a href="https://hachyderm.io/tags/moosefs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>moosefs</span></a> Feels like a product! It's robust, I never really had to fuck with it after setup, solid way of getting shit done, been around for ever.. You gotta pay for the exra shit tho!... It feels like that plastic lining your grandma had on her couches! Fucking old, but that shit was always clean! This felt like grandma's house! </p><p><a href="https://hachyderm.io/tags/selfhosted" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosted</span></a> <a href="https://hachyderm.io/tags/selfhosting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosting</span></a></p>
ItzTrain<p>I got <a href="https://hachyderm.io/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>seaweedfs</span></a> working in the <a href="https://hachyderm.io/tags/homelab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>homelab</span></a> now the way I want it ( possibly). I also came up on some 3.8 TB Micron 5120 or something enterprise ssd's that are 2 years old but still have 100% and 97% of it's life left according to smartclt. I'm still using <a href="https://hachyderm.io/tags/moosefs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>moosefs</span></a> and I don't know how I got here :) </p><p><a href="https://hachyderm.io/tags/selfhosted" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosted</span></a> <a href="https://hachyderm.io/tags/selfhosting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosting</span></a></p>
ItzTrain<p>The one thing I gotta mention about this <a href="https://hachyderm.io/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>seaweedfs</span></a> thing is this volume size limit thing. Do you make it bigger, do you make it smaller. I fucked up and now I can't get the volumes the right size. It's sort of unforgiving. So far my linux ISO's are working pretty good on a object store type system. rclone does require some tuning to make it work and the cache not eat up everything. </p><p><a href="https://hachyderm.io/tags/homelab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>homelab</span></a> <a href="https://hachyderm.io/tags/selfhosted" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosted</span></a> <a href="https://hachyderm.io/tags/selfhosting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosting</span></a></p>
ItzTrain<p>Ok So it took me a while and I still feel like I'm not fully sure of <a href="https://hachyderm.io/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>seaweedfs</span></a> . I got 3 master servers ( which I don't think I need). I have 1 filer and one s3 gateway and one volume server ( right now). I'm uploading to it right now and using rclone ( which is pretty dope) to mount them to my services. Right now it's just Linux ISO's. </p><p><a href="https://hachyderm.io/tags/homelab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>homelab</span></a> <a href="https://hachyderm.io/tags/selfhosted" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosted</span></a> <a href="https://hachyderm.io/tags/selfhosting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosting</span></a></p>
ItzTrain<p>Started my distributed file system journey with <a href="https://hachyderm.io/tags/moosefs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>moosefs</span></a> . Been rock solid. Then I found <a href="https://hachyderm.io/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>seaweedfs</span></a> and it comes with a build in s3 gateway, It's built in go.. Seems simple enough to give it a try in the <a href="https://hachyderm.io/tags/homelab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>homelab</span></a> . Have we lost the ability to write documentation..just code! . 2 hours later. I have 7 terminal tabs open all running a 4 specific process to get this thing working.. and its still not working! 😂. Documentation says. Just run ./this_fucking_command. Then run ./this_fucking_command and the thing is up.. simple. </p><p><a href="https://hachyderm.io/tags/selfhosted" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosted</span></a> <a href="https://hachyderm.io/tags/selfhosting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosting</span></a></p>
Dan ⁂<p>so many tutorials and guides use <a href="https://beoriginal.social/tags/minio" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>minio</span></a> for a <a href="https://beoriginal.social/tags/selfhosted" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>selfhosted</span></a> <a href="https://beoriginal.social/tags/S3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>S3</span></a> interface, but looking into their license that seems highly unpractical?!</p><p>anyone using or running <a href="https://beoriginal.social/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>seaweedfs</span></a>? seems like a great alternative.</p><p><a href="https://github.com/seaweedfs/seaweedfs" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">github.com/seaweedfs/seaweedfs</span><span class="invisible"></span></a></p>
D. Moonfire<p><span class="h-card"><a href="https://polymaths.social/@jlw_the_jobber" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>jlw_the_jobber</span></a></span> A lot of it depends on your skill. I've had a lot of ups and down when it comes to storage; I wrote up a post about it.<br><br><a href="https://d.moonfire.us/blog/2024/11/08/why-seaweedfs/" rel="nofollow noopener noreferrer" target="_blank">https://d.moonfire.us/blog/2024/11/08/why-seaweedfs/</a><br><br>Like more complex situations, SeaweedFS takes a bit more care and attention. Usually not more than a few hours a month on average, but it isn't a fire-and-forget.<br><br>I have a 41 TB system and it's about 70% full at this point. It is also spread out across the five servers, because it is "relatively" easy to expand it where my old situations didn't work.<br><br>It does run on Windows and Linux though, and you can use it to upload to a S3 bucket for cold storage... at the expense of more time and attention needed to make it behave.<br><br><a href="https://polymaths.social/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SeaweedFS</span></a></p>
JesseBot<p>So my passion project for the past couple of years has been building out a massive repo of ArgoCD apps for others to use. I will start trying to highlight some of the <code>ApplicationSets</code> I've built and for why.</p><p><strong>Today's app is Mastodon ✨</strong></p><p>What makes this special is:</p><ul><li>there's no plain text secrets anywhere</li><li>it's all FOSS (including valkey instead of redis)</li><li>includes a local s3 instance via SeaweedFS where postgresql backs up to locally and where all Mastodon media is stored directly</li><li>All persistent volumes (including local s3 PVC) are backed up via k8up to a remote s3 instance</li><li>it has perfect sync waves so everything comes up how/when it should</li></ul><p><a href="https://github.com/small-hack/argocd-apps/tree/main/mastodon/small-hack" rel="nofollow noopener noreferrer" target="_blank">https://github.com/small-hack/argocd-apps/tree/main/mastodon/small-hack</a></p><p><a href="https://social.smallhack.org/tags/argocd" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ArgoCD</span></a> <a href="https://social.smallhack.org/tags/argo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>argo</span></a> <a href="https://social.smallhack.org/tags/kubernetes" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>kubernetes</span></a> <a href="https://social.smallhack.org/tags/cicd" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>cicd</span></a> <a href="https://social.smallhack.org/tags/cd" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>cd</span></a> <a href="https://social.smallhack.org/tags/k8s" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>k8s</span></a> <a href="https://social.smallhack.org/tags/helm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>helm</span></a> <a href="https://social.smallhack.org/tags/seaweedfs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>seaweedfs</span></a> <a href="https://social.smallhack.org/tags/valkey" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>valkey</span></a> <a href="https://social.smallhack.org/tags/s3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>s3</span></a> <a href="https://social.smallhack.org/tags/postgresql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>postgresql</span></a> <a href="https://social.smallhack.org/tags/devops" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>devops</span></a> <a href="https://social.smallhack.org/tags/mastodon" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>mastodon</span></a> <a href="https://social.smallhack.org/tags/foss" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>foss</span></a></p>
ExploreLive feeds
Mastodon is the best way to keep up with what's happening.
Follow anyone across the fediverse and see it all in chronological order. No algorithms, ads, or clickbait in sight.
Create accountLoginDrag & drop to upload