Nope.Well it's a question of power-consumption vs computation on a platform level. Datacenters have very big costs getting rid of heat and also with the price of electricity. So if this purported compute APU delivers the FLOPS for less energy it will be attractive.
In a typical modern datacenter, which mixes CPUs and GPUs (or coprocessors like Xeon Phi), the two types of processors complement each other. CPUs are better at some types of calculations, GPUs are better at others.
If you need more GPU potential, you just add a GPU. There's really no point in adding an APU, which is inherently slower than a PCI-card variant on the same architecture.
Moreover, from a practical standpoint, it's fairly important to have identical GPUs in the system.
And BTW: CPUs also cover the "maintenance" tasks - like moving data around (disks <-> RAM <-> GPU), so replacing them with APUs could actually bottleneck the whole system, not make it faster.