There's basically nothing in the way except high memory prices, and I hope the intense demand ignites new memory factories.
It's just another evolution of PC technology. First it was all about the CPU and cache, then later memory and disk and other I/O (network), and now it will be all about parallel token processing.