But Motorola 68k in say... the Amiga (I don't know Apollo) would have additional chips for sprites and blitting, right? And the ESP - despite being extremely fast, doesn't have that extra support. So you need CPU... + tricks, DMA, triple buffering etc
Microsoft has difficulties drawing (rounded) rectangles at 2 - 4 GHz but that's another issue.