At the moment, CPU draws are pixel-by-pixel to the framebuffer (in PSRAM) through a fat cache inside the VexRiscv. This uses a lot of resources and is relatively slow.
A better solution would be to accelerate font/line blitting in hardware, which should allow us to use a much smaller CPU and leave more resources for fun video/DSP things.