Why do VGATextController limitations exist? Can I extend beyond them?

[BitFracture]

Background:
I am building a dedicated serial terminal on a VGA32 ESP32 development board. It doesn't need any fancy menus, and the display I have works best at 1024x768. Secondly I would really like to change the black color to something slightly lighter than black, because the auto-adjust on most monitors can't sync the image boundaries right. In my terminal design, I plan to obscure the monitor's menu, so manual adjustment won't be available.

My understanding is VGATextController is limited to 16 colors and is capable of generating 64. It doesn't appear that I can control what those colors are, and the resolution is limited to 640x480.

The reason I'm looking into the VGATextController is that I am running into trouble doing what I need with the bitmap controllers. I run out of memory at higher resolutions, and my colors are limited. When attempting to make a custom font for 1024x768, my rows were cut short to 22. I will be needing the standard 25.

Questions:
1: Why are the colors limited to 16 if 64 are supported?
2: Why doesn't this controller offer a palette feature? Is there a technical reason for it, or has it perhaps not been needed before?
3: Why is the resolution limited to 640x480? Is this to simplify the font character byte-per-row count to 1 (since char width is fixed at 80)? If so, are there any known limitations of the ESP32 that would prevent one from creating a higher resolution version of this controller, say 1024x768 with a 12x30 font?