Minimize casts to pointers #1889

Job	Run time
Check	1m 2s
Check docs	36s
Clippy	1m 11s
Format	27s
Build	1m 19s
Run Hermit for Rust (x86_64 + kvm)	3m 48s
Run (x86_64, rusty_demo, none, dev)	4m 7s
Test	1m 18s
Run (x86_64, rusty_demo, none, release)	3m 22s
Run (x86_64, httpd, virtio-net-pci, dev)	2m 48s
Run (x86_64, httpd, virtio-net-pci, release)	3m 23s
Run (x86_64, httpd, rtl8139, dev)	2m 38s
Run (x86_64, httpd, rtl8139, release)	4m 13s
Run (x86_64, testudp, virtio-net-pci, dev)	3m 14s
Run (x86_64, testudp, virtio-net-pci, release)	3m 56s
Run (x86_64, testudp, rtl8139, dev)	3m 16s
Run (x86_64, testudp, rtl8139, release)	3m 22s
Run (x86_64, hello_world, none, dev)	2m 39s
Run (x86_64, hello_world, none, release)	2m 52s
Run (aarch64, rusty_demo, none, dev)	3m 33s
Run (aarch64, rusty_demo, none, release)	2m 49s
Run (aarch64, httpd, virtio-net-pci, dev)	2m 57s
Run (aarch64, httpd, virtio-net-pci, release)	2m 56s
Run (aarch64, testudp, virtio-net-pci, dev)	3m 9s
Run (aarch64, testudp, virtio-net-pci, release)	2m 53s
	1h 7m 48s

Provide feedback