Re-doing Network with XCP-NG

Tom,

I watch your youtube content constantly because of freenas and xcp-ng. Great Stuff! I have a couple of questions that I think your advice is very wanted and appreciated about.

I used to work for MSPs and now im adventuring off into my own Internal SysAdmin role for a client and I want to re-do their systems and use XCP-NG instead of hyper-v and Freenas as the backup solution for on-site and off-site. These VMs will host windows shares and programs.

One of my questions is:
What is the best way to setup XCP-NG VMS and their storage?

#1 - Use XCP-NG to host the VMs and their storage, and use XO to backup the VMs to freenas and (robocopy or syncthing) to sync windows shares for file level backups to freenas, then snapshot the VMs and Windows shares

#2 - Use XCP-NG to host the VMs, then Freenas to create the Windows Shares (or ISCSI drive), then use XO to backup the VMs (Initial and Deltas) to freenas and create the snapshots of both in freenas

#3 - Use Freenas the create ISCSI drives for XCP-NG for all the VMs and their storage as well as windows shares, and use freenas to create snapshots of them?

Freenas will be the on-prem backup and Im going to connect encrypted cloud backup service to Wasabi for off-site encrypted backups.

I just wanted to know your opinion or anyones opinions as well on the best setup. Im going to use NVMe SSDs for the storage drives as they have the smallest footprint and 5-year warranty. They will of course be setup with RAID-Z file systems so the writes are minimized as data is spread across the drives.

I just dont want to invest in one solutions when something else easier could be acheived for what I want.

I will be also be moving the AD to a linux based controller like Zentyal, and using RSAT to manage GPOs and things to avoid needing CALs and I will only need to use a windows 10 computer to host quickbooks.

1 Like

Option #2. Host the OS VM’s in XCP-NG and use FreeNAS for the shares. This way when you are backing up or resotring the whole VM it will be much faster as you are only dealing with the OS.

FreeNAS for file storage makes sense because you can use the ZFS snapshots to making keeping file revisions quick and efficient.

3 Likes

Thanks!

Would it be best to use SMB for the shares or ISCSI? Or ISCSI for program data and SMB for user shares?

If you don’t mind setting up FreeNAS with Active Directory, you can use it for the file shares. If you are using Windows and want all the features that Windows has to offer, present the storage as iSCSI to Windows.

@LTS_Tom

Just curious – where are you backing up your ZFS snapshots?

I replicate them to another FreeNAS box

I actually plan on adding freenas to AD regardless for better usability. But im curious as to the features you talk about with ISCSI and windows compared to windows shares?

I have similar scenario where I need both VMs and file server, but on a single server.

I’m currently running this setup on a CentOS server using Samba + KVM but I’d like to move to a XCP-ng or FreeNAS solution.

Currently, PC and Mac files on the network are sync’d to the Samba shares and the shares are backed up offsite using Borg Backup running on a VM. Macs are also backed up via TimeMachine to Samba shares.

If I run XCP-ng on the server and create the Samba shares on a VM I may have problems with a very large VM.

On the other hand if I run FreeNAS I may have have problems running VMs since their VM management is less developed than Xen and KVM.

Suggestions?

1 Like

@beagle

FreeNas use bhyve. I have quite a few VMs running under bhyve and even a few with iohyve. I guess it would depend what you want to do with your VMs. I could imagine passthrough ports and some graphics likely to be limited. For running basic servers however that are not graphic intensive, FreeNAS VMs work great.