Almost forgot before going to bed but I feel bi-weekly is a good rhythm for this.
Let us know what you set up lately, what kind of problems you currently think about or are running into, what new device you added to your homelab or what interesting service or article you found.
You must log in or register to comment.
Immich. Wanted to exclusively use the external libraries features in read only.
Set it up once in its own Proxmox LXC under Docker. Set it up all properly started scanning my entire library. And when I woke up again it had crashed and I couldn’t recover it.
Started over the following morning and only gave it access to 2024 instead of everything. And it filled up to 30gb/40gb I gave it with thumbnails and files and such. Guess it crashed the other day because it took up too much room.
Guess I’ll start over again, and ensure all the config files and thumbnails are stored on my NAS so they can take up the space they need to without overloading the main (small SSD) on my server.
I just got cactus comments working on my writefreely blog. Cactus comments needs matrix, so I got matrix with element set up. It was an incredibly frustrating journey of learning, but it turns out the final bit wasn’t too complicated. I’m running on TruNas, which I hear you shouldn’t do, but it’s too late haha.
I also got the whatsapp bridge set up, but it doesn’t look like matrix supports disappearing messages, so I left some rooms it created b/c one of the larger groups easily took up a gig of storage before disappearing messages was turned on.
Anyway, writefreely has federated cactus comments that you can currently only sign in with a matrix account lol. I can try and change that later. I host the photos with picsur.
I think that I need to collect my notes and memories and put it into a blog post, but I don’t really want to turn my blog (if I even keep up with it) into a blog about how to self host a blog.
In hindsight, I don’t think the comments were worth it, but whatever.
I’m a new selfhoster and reached the limit on what my DS923+ can handle after setting up an Immich instance (on top of qbitorrent, radarr/sonarr, plex). So I picked up a mini PC this week and migrated the Immich stack over (pointing to an NFS mount for the NAS!) and now it’s running super smooth 🙌 Now I’m hype to move over more services and eventually start separating out media services from mission-critical stuff like photos when I have another machine handy.
I wanted to set up local domain resolution for my devices in order to stop having to visit sites with the local 192.168.1.x IP, so I started following some guides to run dnsmasq on the mini PC (Ubuntu Server) and add entries to /etc/hosts. It was pretty easy to get working OK, but for whatever reason the DNS doesn’t seem to be working on a fresh boot. My local workstation can’t ping the custom DNS entries for my devices until I
sudo systemctl restart dnsmasqon the mini PC, after which everything works fine, which leads me to believe it’s some weird boot order problem? I’m trying not to screw with it too much before bed, but hopefully I can figure out what’s going on this week.If you want to have domains assigned to local IP addresses, you can also use Pihole as a local DNS! It’s a very nice tool for adblocking on network level anyways, can only recommend it.
Awesome thank you, this is what I ended up setting up today. It’s a bit of an awkward solution for now, I would very much like to use it for its ad blocking functionality but I’m unsure if I want to make it my only DNS provider while I’m still migrating services over to the mini PC and messing with the server config. I had set up Pihole years ago and my wife ran into problems using some apps on her phone so I think I’d need to be more proactive about making sure that’s working this time around too.
I get that, I plan to add another pihole ad some point so I can enter 2 nameservers at my router. There are solutions to sync all config between the piholes.
Highly suggest putting Caddy on a machine, forwarding port 443 and 80 to caddy, and then letting it do your reverse-proxy stuff. Register a domain name, give it your IP address, and then tell caddy that ‘immich.yourdomain.bleh’ goes to port 78789 and plex goes to ‘media.yourdomain.bleh’ port 89898 – Caddy handles all of the TLS stuff, handshaking, you name it - so you can have secure sites with proper certs.
Then make sure those things are isolated from your home network through vlans if your router supports it.
You can get fancier with it using a tailscale and getting some datacenter IP to forward into your network
I set up DNS challenge with Let’s Encrypt with Caddy, and now I don’t need to forward anything to it if I don’t want to.
DNS challenge so you can get a wildcard cert? Or is it still per domain? I haven’t looked recently but it seemed difficult but I’d like to avoid transparency log installs where I can.
You can do both (not sure how wildcard works through Caddy though), I did it per domain. I prefer doing TLS trunking per device, hence no wildcard.
Thanks for the advice, I didn’t know a reverse proxy was what I was setting up though I’ve seen that term all over. I think Caddy is likely in my future but I already have basic access to my home network through a Wireguard tunnel for now so I was hoping dnsmasq could solve for my case without getting too fancy or exposing any ports. I think I should probably try to learn about reverse proxies more generally to figure out the next steps forward.
Just set up Lemmy! I wonder if this gets through
I’m reading it so I’d say it works!
Hell yeah, you just sent the first notification to my instance :)
That’s actually so cool and the more I think about it the more it’s making me really want to host my own Lemmy instance. Can I ask what sort of hardware resources you’re running it on?
Sure! It’s a Lenovo m910q tiny. Mine has an i7-6700 and 32GB RAM but Lemmy runs in a VM with 4 cores and 8 GB RAM which should be plenty, it’s not even using half that RAM. Disk Space seems to be the limiting factor after a while since it keeps copies of all remote threads and comments but that can be cleaned up too.
Found some threads online on resource usage beforehand like this: https://lemmy.ml/post/440678
I’m going through hell, trying to update from truenas scale 24.04 to 24.10
I’ve been working on some bash scripts to help manage my media files. I’ve been slowly working on learning more bash and I’m pretty pleased with my progress. After I finish this bash book I’m reading (can’t remember the title atm), I think I’m gonna jump into awk.
Bash is a really great shell, but consider trying out a functional shell scripting language like Elvish (which is also a shell). Syntatically it’s pretty similar and not hard to pickup, but it’s stupid powerful. A cool example is updating different servers via ssh in parallel using a
servers.jsonfile;[ {"name": "server.com", "user": "root", "identity": "~/.ssh/private_key0", "cmd": "apt update; apt upgrade -y"}, {"name": "serverb.com", "user": "root", "identity": "~/.ssh/private_key1", "cmd": "pacman -Syu"}, {"name": "serverc.com", "user": "root", "identity": "~/.ssh/private_key2", "cmd": "apk update; apk upgrade"} ]and a little elvish magic;
var hosts = (from-json < servers.json) peach {|h| ssh $h[user]@$h[name] -i $h[identity] $h[cmd] > ssh-$h[name].log } $hostsJust run the script and boom, done. You can even swap out
peachwhich isparallel eachforeachif you want to do each command procedurally–but I really love using peach, especially with file operations over many different files. Linux is fast, but peach is fuckin’ crazy fast. Especially for deleting files (fd -e conf -t file | peach {|x| rm $x }, or one thing that I do is extract internal subs (so they play on my chromecast) in my Jellyfin server, using elvish makes it really fast;fd -e mkv | peach {|x| ffmpeg -i $x -map 0:s:0 $x.srt }Find all
*.mkvfiles, pass the filenames through ffmpeg (using peach) and extract the first subtitle asfilename.mkv.srt. Takes only about a few seconds to do thousands and thousands of video files. I highly recommend it for home-labbers.
Pretty dumb example, but
peachis like 6x faster;❯ time { range 0 1000 | each {|x| touch $x.txt }} 5.2591751s ❯ time { range 0 1000 | peach {|x| touch $x.txt }} 776.2411ms
Replaced the fan with a bad bearing on one of my proxmox hosts today. For a short while I figured I was going crazy because it seemed to stop making noise when I actually got close to the server, but it finally fully gave today and I was able to identify and swap it.
Finally moved all my lxc onto a lower-power Xeon D host, consumes 1/3 the electricity of my previous Dell R430, same essential performance.
Just swapped VPS hosts from ssdnodes to MassiveGRID. Got a pretty sweet deal, so I’m pretty excited.
Got my services transferred over this week and it’s been fun as hell. It’s interesting because I was discussing Portainer with my buddy and he has Portainer on his local PC to connect to his remote instances and with hindsight it sounds obvious of course, but it’s such a nice little setup. Just finished setting up my Jellyfin reverse proxy so I’m gonna watch a movie and chill.
I used Portainer for a while and still like it for checking out networking stuff, but try out Dockge! It’s more open sourcey and basic, but makes updating easier.
Dockge
Dockage was nice, and it was much simpler, however, I had to leverage more docker commands via my VPS with it, because there weren’t a lot of options, specifically network settings.
Since it’s winter and I mostly don’t want to leave my house, I busted out an unused Raspberry Pi 4b a couple weeks ago. Started with CasaOS and AdGuard. Have now added a few other services including Navidrome to serve up a lot of local-area music for myself and friends. Got a Cloudflare tunnel set up, then some authentication through CF as well. And finally secured a static IP from my ISP. This is the farthest along I’ve ever gotten with any of this and it’s been going great. Nearly every hurdle I’ve encountered I’ve been able to work through.
Two things causing me grief today though:
-
I also have Nextcloud hosted on a VPS and I cannot get to the point of running occ commands. First it wasn’t found, then no php cli, then just errors. I gave up.
-
I’m using Homer because it’s just so simple, but the theming and CSS is driving me nuts. Sure, I can change colors, but will this little bar in the neon theme change from 4em to 100% for me? NOPE. Override fonts? Nosir. All good though.
Try the OCCWeb app in nextcloud apps.
Thanks! It just threw an error at me when I launched it, but I’ll see what I can do. Based of the warnings in the admin panel, there isn’t anything critical for me to address, I just hate that orange.
-
I finally got link warden up and running, but I’m chasing down some failures on a few websites.
Also realized that me biting the bullet for unlimited bandwidth (screw you Comcast!) means I can run archive team warrior, so that’s been going.
IMO linkwarden was a real PITA. I’ve been trying linkding and it’s been really great so far. I’ve had no issues like I had with linkwarden.
Pihole 6 broke my DNS (dnsmasq), and since I had a fw rule in opnsense to only use pihole’s DNS, and deny public DNS access, it was an early rise for me :)
Damn… DNS issue early in the morning… What a nightmare 😂! Hope you got enough caffeine.
And that’s why you have either a backup for your DNS or know whats auto-updated ;)
As you mention opnsense:
What do you mean with fw rules to only use pihole dns?
This sounds partly like a DHCP config and partly like a deny (hardcoded) DNS requests and to please use what DHCP supplied (looking at you google/amazon)I did have backups, it was an easy fix. I had a
pihole -upon a crontab for years, probably not the best idea :)FW rule accept :53 from pihole only, deny :53 from all. I had some devices with hardcored DNS settings (8.8.8.8).
Unbound broke on both of mine day one of v6 and I’ve still not gone and fixed it. Sigh.
I’m in the process of doing an initial restic sync of my primary storage to B2 as offsite backup and while I’m at it finally got around having a look at resticprofiles to simplify my restic backups on all my systems. Highly recommend it as it reduced my mental overhead of doing regular backups quite a bit!
I’ve had two failed harddrives in the last month. Not sure if bad batch or what. Thankfully the order these were on only were the two drives so may not see more. They are under warranty but it’s still a pain!
Otherwise I’m enjoying Mealie lately for my recipes. Kinda nice having them all in one place but accessible by anyone in the house.
I found Mealie to be a bit bloated and not fitting my needs too well. I moved to KitchenOwl. Small project but I love it.
I love mealie as well. My wife and I keep all our recipes in mealie.
I finally moved from reddit to Lemmy. maybe a 3-4 hour set up time to get it all working lol.
Cool! Which installation method did you use?
I did manual docker. I host some other things as well, so running it through nginx proxy manager that I already had set up.
I also planned to do the same (bare nginx instead of NPM but otherwise the same). Did you just remove the nginx container from docker compose and use the same arguments in NPM or do you double-reverseproxy or something else?
Short answer, yes I removed the nginx container from the lemmy compose file. I followed this guide if it helps: https://www.reddit.com/r/nginxproxymanager/comments/1485y0d/getting_lemmy_running_with_a_separate_nginx_proxy/
Cool, thanks!
