Minimize casts to pointers #1874

Job	Run time
Format	26s
Check	1m 18s
Build	1m 19s
Check docs	34s
Clippy	37s
Run (x86_64, rusty_demo, none, dev)	4m 11s
Run Hermit for Rust (x86_64 + kvm)	3m 46s
Run (x86_64, rusty_demo, none, release)	2m 55s
Test	1m 38s
Run (x86_64, httpd, virtio-net-pci, dev)	3m 44s
Run (x86_64, httpd, virtio-net-pci, release)	2m 58s
Run (x86_64, httpd, rtl8139, dev)	2m 34s
Run (x86_64, httpd, rtl8139, release)	3m 51s
Run (x86_64, testudp, virtio-net-pci, dev)	2m 49s
Run (x86_64, testudp, virtio-net-pci, release)	2m 48s
Run (x86_64, testudp, rtl8139, dev)	2m 52s
Run (x86_64, testudp, rtl8139, release)	3m 35s
Run (x86_64, hello_world, none, dev)	2m 26s
Run (x86_64, hello_world, none, release)	3m 24s
Run (aarch64, rusty_demo, none, dev)	3m 45s
Run (aarch64, rusty_demo, none, release)	3m 1s
Run (aarch64, httpd, virtio-net-pci, dev)	3m 25s
Run (aarch64, httpd, virtio-net-pci, release)	3m 8s
Run (aarch64, testudp, virtio-net-pci, dev)	3m 20s
Run (aarch64, testudp, virtio-net-pci, release)	3m 50s
	1h 8m 14s

Provide feedback