Minimize casts to pointers #1875

Job	Run time
Check	1m 7s
Format	26s
Check docs	34s
Build	1m 39s
Clippy	41s
Test	1m 46s
Run Hermit for Rust (x86_64 + kvm)	4m 7s
Run (x86_64, rusty_demo, none, dev)	4m 57s
Run (x86_64, rusty_demo, none, release)	3m 11s
Run (x86_64, httpd, virtio-net-pci, dev)	3m 32s
Run (x86_64, httpd, virtio-net-pci, release)	3m 34s
Run (x86_64, httpd, rtl8139, dev)	3m 22s
Run (x86_64, httpd, rtl8139, release)	4m 15s
Run (x86_64, testudp, virtio-net-pci, dev)	3m 3s
Run (x86_64, testudp, virtio-net-pci, release)	2m 57s
Run (x86_64, testudp, rtl8139, dev)	3m 9s
Run (x86_64, testudp, rtl8139, release)	3m 10s
Run (x86_64, hello_world, none, dev)	2m 38s
Run (x86_64, hello_world, none, release)	3m 28s
Run (aarch64, rusty_demo, none, dev)	5m 0s
Run (aarch64, rusty_demo, none, release)	3m 7s
Run (aarch64, httpd, virtio-net-pci, dev)	2m 55s
Run (aarch64, httpd, virtio-net-pci, release)	3m 25s
Run (aarch64, testudp, virtio-net-pci, dev)	2m 55s
Run (aarch64, testudp, virtio-net-pci, release)	3m 43s
	1h 12m 41s

Provide feedback