Amazon price trackers seem to suggest $2300 is the cheapest you'll find one in stock in the US, and it's been that way since last summer at least.
Over here they're out of stock entirely. Refurbs for nearly £2000 ($2400) and no new stock since the last of the £2200 offerings dried up, and £2000-2200 has been the going rate for several months now.
From what I can see on CamelCamel, it was not at that $2,000 since last summer:
https://camelcamelcamel.com/product/B0C7JYX6LN?context=search&cpf=amazon
This particular model dipped in price during the summer. If you look at eBay sold listings, the card sells for $1,600 - $2,300 today.
I'm not saying these sources are the end all be all of pricing, it's in general hard to find longer term pricing trends due to a lack of data (I really wish there was a service that kept data longer term, I'd be willing to pay for that even). It just appears that the amount people are paying doesn't jive with the retail price of these cards, which makes sense given that Nvidia was ramping down production.
I'm of the opinion that the reduction in supply servers as a market experiment for Nvidia to test the maximum amount people are willing to pay for the card. It's no coincidence that both the 5090 and 5080 are priced exactly at what these cards are fetching aftermarket on eBay plus a smidge on top to round the number off. It's a common monopoly tactic, you gouge your customer but you still want them to buy so you price at the absolute most they are willing to pay.