Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resize NVMe sector size on existing P4510 disks in karm #1119

Closed
Firefishy opened this issue Jul 18, 2024 · 2 comments
Closed

Resize NVMe sector size on existing P4510 disks in karm #1119

Firefishy opened this issue Jul 18, 2024 · 2 comments
Labels
location:amsterdam Equinix AM6 data centre

Comments

@Firefishy
Copy link
Member

Firefishy commented Jul 18, 2024

The P4510 NVMe disks in /dev/md1 array in karm use 512 byte sectors instead of 4096 byte sectors. The disks should be removed from the array, sector size changed (format) and disks re-added to the array

disk    INTEL SSDPE2KX020T8__1                     /dev/nvme8n1
disk    INTEL SSDPE2KX020T8__1                     /dev/nvme9n1

The LBA format reports 4096 bytes is the best performance:

LBA Format  0 : Metadata Size: 0   bytes - Data Size: 512 bytes - Relative Performance: 0x2 Good (in use)
LBA Format  1 : Metadata Size: 0   bytes - Data Size: 4096 bytes - Relative Performance: 0 Best

This can be done as part of the upgrade in #1116 to reduce any data corruption risks (ensure full parity):

Likely steps:

# Insert new NVMe disks from #1116 
sudo mdadm /dev/md1 --add /dev/nvme10n1 --replace /dev/nvme8n1 --with /dev/nvme10n1
sudo mdadm /dev/md1 --add /dev/nvme11n1 --replace /dev/nvme9n1 --with /dev/nvme11n1
sudo mdadm /dev/md1 --remove /dev/nvme8n1
sudo mdadm /dev/md1 --remove /dev/nvme9n1
cat /proc/mdstat (ensure nvme8n1 and nvme9n1 are removed)
sudo nvme format --lbaf=1 /dev/nvme8n1
sudo nvme format --lbaf=1 /dev/nvme9n1
sudo mdadm /dev/md1 --add /dev/nvme8n1 /dev/nvme9n1
sudo mdadm --grow /dev/md1 --raid-devices=12
sudo resize2fs /dev/md1
@Firefishy
Copy link
Member Author

Final grow step now running...

@Firefishy
Copy link
Member Author

All done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
location:amsterdam Equinix AM6 data centre
Projects
None yet
Development

No branches or pull requests

1 participant