it will still occur even after the psu is switched off and unplugged
Also 'discharged'? Especially high-wattage PSUs can have massive amounts of capacitance.
Besides that....
Prolly need more to go on, but this sounds like a job for the FCC.
They apparently take reports decently seriously: Years-ago a bunch of HAMs got (the FCC to get) Linksys to stop making WRT54s and related routers+switches. The consumer cost-engineered design was radiating a massive amount of RFI, even the units w/o WiFi; the ethernet ports alone were 'noisy AF'.
It sounds like there's *something* nearby ya that, on a regular interval is likely breaking a ton of regulations for radiated emissions. Which, could be inducted by the coils/inductors/transformers in your PSU, vibrating them.
If you can get an audio recording of it, someone can load it into Audacity(etc.) and get some idea of what frequency it might be. From there, you can get a rough idea of potential causes, and where they might be emanating from. Considering that this is happening "in the middle of the night" I'd suspect a pirate transmitter or someone that's got something very high voltage (DIY plasma device, DIY arcfurnace, etc.) running @ home w/o shielding their workspace (Ex: Styropyro on youtube is smart enough to have had his 'shed' decently well shielded for his HV and Plasma fun.)
Any industry or laundromats nearby? I suppose extreme current use of multi-phase power (alone) might explain it.
I remember walking through some wooded area and
feeling a literal buzz, which was also extremely noticeable on video/audio recordings.
Turned out there was a glass manufacturing plant JUST on the other side of the wooded area, and when their inductive furnaces were in use, it was LOUD on audio recordings*.
*If a microphone is picking up something louder than what's audible w/ one's ears, it's usually EMI.