Unfortunately the normal top recommendation for most parts of this, Unifi, has become hard to recommend due to recent decisions/changes and lack of communication. Even if the changes don’t affect exactly the network you would build, they have slowly eroded the trust of the active community members.
That being said, they are the only choice for certain types of APs that are useful in some home setups, and their integration of different devices hasn’t been matched by any competitors. Their main technical limitation is the general lack of features in their router offerings.
If you decided to go all-in on Unifi, and made sure that the router functions available cover your needs, the UDM (Router + Switch + AP + controller) or UDMP (Router + Switch + Surveillance NVR + controller) are good foundational items.
Otherwise, either PFSense or Untangle are good router options. Both are available on pre-configured appliances, or for you to run on hardware you provide.
PFSense has all the features you might want but takes some setup, and the more security minded features like PFBlocker (DNS filtering for security and ads), and Snort/Suricata IDS/IPS require manual attention because the freely available lists they use are, well, free. So sometimes an update comes through on a list (many lists are integrated together, each comes from a different person/group who focuses on different priorities) and it has ill effects on something you’re using.
Untangle has most features available for free but requires a subscription for some - mainly the things that actually cost them money to maintain. There are two home use plans, at either $50/year or $150/year. The things which required attention when set up on PFSense should require less when set up on Untangle, because you’re paying for employees to review and vet the changes that come from their sources before pushing the updates out, and they are also paying for some lists that aren’t free because they are maintained by professionals (some security research companies provide two lists, a free one and a paid one. Each company operates differently, but commonly the paid list gets updates as frequently as each hour whereas the free list may be daily). The main reason to use Untangle, even with just the free feature set, is the simplicity in setting things up, and the great reporting on what’s happening on your network.
As for switches and APs, again Unifi has really compelling options. For switches try to get the ones with “USW” in their model, they are Gen 2 versus just “US” means Gen 1. For APs, only look at models with “HD” anywhere in their name which means AC Wave 2, or “U6” which means WiFi 6. The U6 models are preferred because apples-to-apples they are cheaper than the “HD” models as well as being the latest tech, but some specific form factors like shelf/table top, wireless-uplink-only extender, and outdoor aren’t available in U6 versions yet.
There are many alternatives for switches and APs, however none at present are good enough to specifically recommend without lots of caveats and notes.
I am using Untangle with Ruckus Unleashed APs and switches. Ruckus Unleashed is a controller-less, license-free option, where your AP(s) elect a Master and a Standby to run your network. It has limited ability to work with their ICX7150 switches - right now it can just show you the port status and let you upgrade the firmware. More is expected to be coming. The downside for Ruckus Unleashed compared to Unifi (the reason I didn’t mention it as recommended before) is that even though you don’t have to pay anything beyond the hardware costs, Ruckus hardware is really incredibly capable and you still have to pay for that. The APs new costs 2-3 times what a seemingly equivalent Unifi one does, and the switches would be similar except that Unifi doesn’t make switches that you can even compare to Ruckus’. But if you look on eBay you can get Ruckus hardware used at comparable costs to Unifi hardware new. Yes the new Unifi hardware would have a warranty, but that’s just part of the decision to make.