

Yes, so R&D and finalizing the model weight is done on NVIDIA GPUs (I guess you need an excessive amount of VRAM).
Inference is probably gonna be offloaded to consumers in the end where the NPU is taking care of the inference cost (See Apple, Qualcomm etc)
Der8auer’s video is worth a watch, he got one of the Redditor’s card:
https://youtu.be/Ndmoi1s0ZaY