Part of what i read and recall on this, was that at a GPU level you have clock generators for the displays.
This is from fuzzy memory so i'm sure i'll get terminology wrong, at least.
VGA, DVI and HDMI below 1.2 had a different clock rate depending on the data being sent - DP had a fixed rate, not a varying one.
Something about DP being packet based vs the others being more like VGA with everything being about timings for scan rates for horizontal, vertical etc.
A lot of video cards shared the clock gens, so you could use 3x native DP + HDMI + DVI, but if you used passive DP to anything else, you'd find yourself limited to just 3 total displays
Something i've forgotten here except the final part is that using all the bandwidth of DP (natively or via adaptors) used more hardware of the card instead of those ready-made clock gens, used more of the card (specifically VRAM) and required the clocks to be higher at idle to avoid issues
Comments like this from Toasty (author of CRU) ties into the probably important bits i've forgotten: 'VRAM has to update faster than the monitor does, you'll get flickering or blackouts on the screen'
This guy found the limits of how many older displays a 5700xt can support: (two, and he tried 3)
DP to DVI adapter not working on Radeon RX 5700 XT - AMD Community
The things i'm not sure of is:
Is this fix based on assumptions for the older display types, or is it neccesary on DP too?
Does DP and modern HDMI's fixed data-rate (instead of variable) just assume it needs the max possible bandwidth and clock the VRAM up just in case?
I know nvidia ditched VGA support ASAP, is it cards with support for older standards that have to do this?
Is this something that changed VRAM tech solves? Is it simply that GDDR6x cards can handle X bandwidth while GDDR6 or GDDR5 cant? (testing a 1070ti vs a 1080 would cover this, as the key difference there is their VRAM)
This could be a drawback of maintaining legacy support for older monitor tech, or it could be a software thing to avoid issues with certain combinations of displays and adaptors being triggered when it's not needed