PsychoWards

You absolutely need to create your own topic. From your posts in the forum it sounds like you have a some things which I will shamelessly copy from your setup =D

We need to distinguish between the boot drive dying and some other HW dying. If something else dies, you just switch HW and you are good to go. If the boot drive dies or you reinstall hexos from scratch it's a bit different but those 2 scenario are functionally the same thing. Since Hexos currently doesn't support pool import during installation and is insisting on creating new pools, this currently not that easy to do with hexos. With Truenas (and hopefully Hexos as well once pool import is supported) it's as easy as it gets. You just need to backup your truenas config (no need to backup the boot drive), then you just reinstall truenas, you import your config and the system is up and running as if nothing ever happened. This is working because all the information about the pools and apps are stored on the pool drive itself and the boot drive only contains your config.

If you have an use case for additional VMs just go for it. However be aware that you have an additional layer which needs to be properly setup and configured and that some things might not be as straightforward as with a bare metal installation. 🙂

Pretty much exactly what @Sonic says. Hexos in a VM only makes sense if you want to run multiple OS on the same machine and if the VMs are the important part for you. If you primarily want a NAS and running other OS in a VM is not important and the built-in apps are enough for you, go bare metal there is no point in going down the VM part. If, however, VMs are important to you and Hexos is only a piece of your setup and not the most import part, proxmox or similar is the way to go.

If we look at the specs for the Seagate Ironwolf Pro, they are rated for up to 550TB/year, which is a ludicrous amount of data and which you will never write in the lifetime of the disk. I wouldn't worry about writing surveillance data to the drives, that's what the are ment for (writing and reading data 24/7) and it's likely not going to impact the life at all, or at least not in a significant way. Usually the other alternative for home surveillance would be micro sd cards and those die very fast compared to the lifetime off your surveillance setup and you need to swap them out every other year to be safe.

In Truenas under Data Protection there is an area for replication tasks, which is the preferred way to backup from zfs to zfs.

Lucky you, I had 3 HDDs and 3 SSDs dying on me, 1 HDD was DOA and have 3-4 HDDs with SMART errors indicating they will soon kick the bucket. 1 of the dead HDD and the DOA were WD Red (CMR) and Red Pro, all the other were consumer grade and I got plenty of lifetime out of them. Thankfully I never lost any important data or data which I cared about.

Hexos will write your USB Flash Drive to death very fast, that's why they are not recommended because of the constant writes which Truenas is doing to the drive (Logs, Graphs and the system dataset for the both drive). Also the performance might not be the best. It is definitely possible but you should definitely backup your system config regularly and don't wait multiple years before replacing the drive. 🙂

Hey, I just did 24h Mem Test, to be sure that the Memory is stable, but I didn't do any HDD burn in. My data is coming from a working NAS and I still have multiple copies of the imported files and I'm running a RaidZ2, so I'm taking my chances and hope that I'm not gonna lose 3 drives at the same time 🙂 Technically, I would need to loose at least 9 drives in various different NAS all at the same time before I start loosing my most important data. So yes, a dead drive is really more a nuisance at this point then a real issue with my current setup.

Used NAS are probably more expensive then used PCs. Also with an used NAS you might not have any upgrade possibilities. Additionally a Synology NAS will not work, because you are limited to there own OS. Also you nees to make sure to get a NAS with enough memory (RAM) and x86 CPU. So your best bet, in my opinion is to go for a PC, because there you have less restrictions and less things to worry about, only that it meets the minimum recommendation (especially the 8GB memory bit) and that it's not using a Realtek NIC (network chip, because most of them are not supported by truenas). Last but not least, don't forget that you need a dedicated boot drive, the boot drive cannot be used as a data drive, it only contains the OS and you cannot store anything on it. Ideally you would use a small SSD. A HDD would also work but not an USB stick.

Good point, I believe the same build with the 14600K and without dedicated GPU would be a good alternative for less demanding users and/or users on a tighter budget. Yes, I completely understand you there also some things just don't run on an iGPU, looking at you Immich...

Hey, yes this is not that difficult to do, I have done this in the past with various different NAS constellations. With Hexos you have 2 options: If you want to backup to another Hexos or Truenas you should use ZFS replication. (this is not your usecase) If you want to backup to a NAS which is not using ZFS you should do the backups using rsync. For rsync you need to configure both your Synology NAS as a server and your Hexos as a client (this needs to be setup in Truenas, Hexos doesn't offer this yet).

Mounting using fstab would have been my next advice, but I couldn't edit my post anymore so I was waiting for your feedback first. Keep us posted if it helps 😃

Hey, The problem with the high memory requirements is not directly Hexos or Truenas for that matter but ZFS itself. For example as a rule of thumb you need 1GB or memory for ever TB of storage, in your case that's already 7GB of memory. Then you also need 1/2-1GB for the write cache and additional memory for parity data calculation. So with your config you easily need 8-10GB of memory just for ZFS, add 1GB for Hexos and you see why the minimum required memory is so high and why you are facing issues with only 2GB of memory. Supporting low memory systems would require a lot of changes to ZFS which might result in suboptimal or bad performance. You can check this link for memory information: https://web.archive.org/web/20140818042550/http://hardforum.com/showpost.php?s=8d31305e57c1dd2853eb817124ff18d9&p=1036865233&postcount=3

Not yet, but the MMU3 support will come 🙂

Check out the new Prusa Core One with the MMU3. Checks all our boxes and it offers unparalleled upgradeablity. Prusa does offer an upgrade Path to the latest printer each time and this way to can easily upgrade and don't need to buy a new printer each time a new model is released.

Do you have the possibility to set the smb version? Can you force to use V3?

What distro are you using and can you share your fstab entry for the smb mount? (or however you are mounting your samba share)

Hey, you can use this raidz calculator, set number of disk groups to 1 and fill in all other numbers. If yoh have 3 or more disks hexos will create a raidz1, so you set this as raidz type and you get your usable storage in TB. (Don't forget to convert this to TiB) https://www.raidz-calculator.com/

In that case, use any gpu which you have at home for the initial setup or try do borrow one from a friend and check if the motherboard starts headless (without gpu) after the installation and if Hexos is accessible. If it is working fine without gpu after the setup you don't need to buy an extra gpu just for the server.

Hey @NaZzAtAzEr, What do you plan to do with your Hexos? Do you need the GPU only for video output or do you want to do some video transcoding with Plex/JellyFin? If you only need it for video out for the installation you can use any GPU and if you don't have one maybe you can borrow you from a friend. If you plan to do more with it, we need to know before we can give a proper recommendation.

I'm using a RaidZ2 without any issues, but I'm also not using any of the apps, since I'm running an Ubuntu VM with docker for all my apps. I didn't follow all the discussions but it seems that destroying the first pool created results in apps become unusable until some paths/settings are fixed in TrueNas, but don't quote me on that, maybe someone else has more information about this. To add to @Mobius explanations about the Vdevs: Once you loose all the drives from 1 vdev you loose everything. Meaning with 3x2 drive vdevs you can only loose 1 drive per vdev (but 3 drives in total if they are all from different vdevs) and with 2x3 drive vdevs you can loose 2 drives per vdev without loosing any data. @L-Pif you have 10 gbit/s networking, you might want to look into adding an nvme cache drive as an L2ARC. ARC is a read only cache, which is keeping the files which you might need next in a cache in memory for quick access. You can extend this with an L2ARC cache which, stores additional files on a dedicated drive. If this drive is an SSD it's gonna ready and serve those files significantly faster then if Hexos needed to read them from the slow HDDs. This might make sense in your case if you have 10gbit/s networking, everything below and the speed benefits are likely to be marginal at best. And no there is no write cache in Hexos only a read cache. 🙂

Exactly and depending on your usecase it might be hit or miss, if the ARC is caching the wrong files. For most user's it's not really useful except if you absolutely need the faster read speed of an m.2 SSD or your are doing a lot of video/image editing. If you just use your NAS as a backup, media storage solution, the L2ARC is very likely not needed. It's possible that you were transfering a lot of small files earlier, which could explain the 30MB/s you saw earlier. The connection is always taking the shortest path, if your PC and Server are connected to the same switch, they will not pass through the router.

That does look like a proper setup =D Is everything connected to your UPS? Concerning your copying speed, can you try copying from and to another device, to see which system might be the issue? If you're not finding a conclusive answer, you can create another topic in the support forum to get some more help on this matter. There is no write cache in Truenas/Hexos there is only L2ARC. This is an extension of the ARC which is running in memory. The ARC is buffering files which truenas thinks you might use next, to have them ready in memory and not needing to ready it from the drives. The L2ARC is an extension and it's keeping more files on the cache drive. It is a read only cache.

There are SFP modules with an RJ45 connector with up to 10Gbit/s, you don't need to go to fibre yet. If you can't or don't want to use the SFP card, it might be worth to consider getting a 2.5 Gbit/s card instead of a 1Gb card, they are not that much more expensive and it avoids you the need to upgrade the NIC afterwards, especially since 2.5Gbit/s switches are no longer expensive.