Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Check default block size #8

Open
michaelshmitty opened this issue Jun 15, 2020 · 3 comments
Open

Check default block size #8

michaelshmitty opened this issue Jun 15, 2020 · 3 comments
Assignees
@michaelshmitty

Comments

@michaelshmitty
Copy link
Owner

See MiSTer-devel/SD-Installer-Win64_MiSTer#10
@michaelshmitty michaelshmitty self-assigned this Jun 15, 2020
@MAME-GETTER
Copy link
Contributor

I ended up forking your you repo.

My commits can be seen here in my fork:
https://github.com/MAME-GETTER/SD-Installer-macos_MiSTer/commit/4b2483e56d92929964084aba6d9936180b6349c7

I submit a PR if you want.

I ran test with fresh installs with the MiSTer-sd-installer-linux.sh with both your script and my forked script with block size set to 32K here are the results:

I also ran the update_all.sh script https://github.com/theypsilon/Update_All_MiSTer to bring the the card up to date and download all of the MAME roms and to organize the _Arcade directory.

The -arcade-organizer script creates many symlinks to organize the _Arcade directory. these links 30 to 50 bytes in size. However because of the block size for the file system they end up taking more space. this is show in the examples below.

No BS set for 32GB SDCard with MiSTer-sd-installer-linux.sh

/media/fat/_Arcade# du -sh * | grep -v mra
130M    _Organized
25M    _alternatives
235M    cores

/media/fat/_Arcade/_Organized/_1 A-E# du -sh * 
32K	1941  Counter Attack -Japan-.mra
32K	1941  Counter Attack -USA 900227-.mra
32K	1941  Counter Attack -World 900227-.mra
32K	1941  Counter Attack -World-.mra
32K	1942.mra
32K	1943 Kai Midway Kaisen.mra
32K	1943 Midway Kaisen.mra
32K	1943 The Battle of Midway Mark II.mra
32K	1943 The Battle of Midway.mra
32K	Abortman - HBMame.mra
32K	Adventure Quiz Capcom World 2 -Japan 920611, B-Board 90629B-3, no battery-.mra
32K	Adventure Quiz Capcom World 2 -Japan 920611, B-Board 91634B-2-.mra
32K	Adventure Quiz Capcom World 2 -Japan 920611-.mra
32K	Aerolitos (Spanish bootleg of Asteroids).mra
32K	Alibaba 40 Thieves.mra
32K	Alien Arena.mra
32K	Amidar.mra
32K	Andromeda - HBMame.mra
32K	Anteater.mra
32K	Apocaljpse Now (bootleg of Rescue).mra
32K	Area 88 -Japan Resale Ver.-.mra
32K	Area 88 -Japan-.mra
32K	Arkanoid (Game Corporation bootleg, set 1).mra
32K	Arkanoid (Game Corporation bootleg, set 2).mra
32K	Arkanoid (Tayto bootleg, harder).mra
32K	Arkanoid (Unlimited Lives).mra
32K	Arkanoid (unl.lives, slower).mra
32K	Arkanoid.mra
32K	Armored Car (set 2).mra
32K	Armored Car.mra
32K	Asterock (Sidam bootleg of Asteroids).mra
32K	Asterock (Videotron bootleg of Asteroids).mra
32K	Asteroids (Six-Bullet Hack) - HBMame.mra
32K	Asteroids (rev 1).mra
32K	Asteroids (rev 2).mra
32K	Asteroids Deluxe (Unknown Revision) [h] - HBMame.mra
32K	Asteroids Deluxe (rev 1).mra
32K	Asteroids Deluxe (rev 2).mra
32K	Asteroids Deluxe.mra
32K	Asteroids.mra
32K	Astrians (clone of Swarm).mra
32K	Astropede - HBMame.mra
32K	Astropede II - HBMame.mra
32K	Ataque Sideral (Spanish bootleg of UniWar S).mra
32K	Ave Fenix (Electrogame, Spanish bootleg of Phoenix).mra
32K	Ave Fenix (Laguna, Spanish bootleg of Phoenix).mra
32K	Ave Fenix (Recreativos Franco, Spanish bootleg of Phoenix).mra
32K	Azurian Attack.mra
32K	Baby Pacman 2 (Alt) - HBMame.mra
32K	Baby Pacman 3 (Alt) - HBMame.mra
32K	Bagman (Stern Electronics, set 1).mra
32K	Bagman (Stern Electronics, set 2).mra
32K	Bagman (Taito).mra
32K	Bagman Turbo (Stern set 1) [c] - HBMame.mra
32K	Bagman.mra
32K	Battle Road.mra
32K	Battle of Atlantis.mra
32K	Battles (set 2).mra
32K	Beastie Feastie.mra
32K	Berzerk (French Speech, revision RC31).mra
32K	Berzerk (German Speech, revision RC32).mra
32K	Berzerk (Spanish Speech, revision RC32).mra
32K	Berzerk (revision RC28).mra
32K	Berzerk (revision RC31).mra
32K	Berzerk.mra
32K	Biaofeng Zhanjing -Chinese bootleg of The Punisher-.mra
32K	Big Kong.mra
32K	Bionic Commando.mra
32K	Birdiy.mra
32K	Black Hole.mra
32K	Black Tiger.mra
32K	Black Widow.mra
32K	Block (Game Corporation bootleg, set 1).mra
32K	Block (Game Corporation bootleg, set 2).mra
32K	Bomb Jack (Bootleg) - HBMame.mra
32K	Bomb Jack (Greek) - HBMame.mra
32K	Bomb Jack (Red) - HBMame.mra
32K	Bomb Jack (Translation Chinese) - HBMame.mra
32K	Bomb Jack (set 2).mra
32K	Bomb Jack.mra
32K	Botanic (French).mra
32K	Botanic.mra
32K	Brakman - HBMame.mra
32K	Bubbles (Solid Red label).mra
32K	Bubbles (prototype version).mra
32K	Bubbles.mra
32K	Bump 'n' Jump (Midway).mra
32K	Bump 'n' Jump Reverse Mod - HBMame.mra
32K	Bump 'n' Jump.mra
32K	Burger Time (Data East set 2).mra
32K	Burger Time.mra
32K	BurningRubber.mra
32K	Calipso.mra
32K	Candory (Ponpoko bootleg with Mario).mra
32K	Canyon Bomber.mra
32K	Capitol.mra
32K	Captain Commando -Japan 910928-.mra
32K	Captain Commando -Japan 911202-.mra
32K	Captain Commando -USA 910928-.mra
32K	Captain Commando -World 911014-.mra
32K	Captain Commando -World 911202-.mra
32K	Car Action (set 1).mra
32K	Car Action (set 2).mra
32K	Carrier Air Wing -USA 901012-.mra
32K	Carrier Air Wing -USA 901130-.mra
32K	Carrier Air Wing -World 901009-.mra
32K	Carrier Air Wing -World 901012-.mra
32K	Catacomb.mra
32K	Caterpillar - HBMame.mra
32K	Cemescary - HBMame.mra
32K	Centipede (revision 1).mra
32K	Centipede (revision 2).mra
32K	Centipede (revision 3).mra
32K	Centipede Dux (hack).mra
32K	Centipede.mra
32K	Chiki Chiki Boys -Japan 900619-.mra
32K	Coccinelle (bootleg of Lady Bug, set 2).mra
32K	Colony 7 (set 2).mra
32K	Colony 7.mra
32K	Commando.mra
32K	Computer Space.mra
32K	Cosmic Avenger.mra
32K	Crackhead - HBMame.mra
32K	Crater Raider.mra
32K	Crazy Climber (US set 2).mra
32K	Crazy Climber.mra
32K	Crazy Kong (Orca bootleg).mra
32K	Crazy Kong Part II (Graphic Fix) - HBMame.mra
32K	Crazy Kong Part II (Japan).mra
32K	Crazy Kong Part II (Jeutel bootleg).mra
32K	Crazy Kong Part II (bootleg).mra
32K	Crazy Kong Part II (set 2).mra
32K	Crazy Kong Part II -1 - HBMame.mra
32K	Crazy Kong Part II -2 - HBMame.mra
32K	Crazy Kong Part II.mra
32K	Crazy Pac - HBMame.mra
32K	Crush Roller.mra
32K	Daimakaimura -Japan Resale Ver.-.mra
32K	Daimakaimura -Japan-.mra
32K	Dark Planet (no bkg).mra
32K	Dark Planet.mra
32K	Defender.mra
32K	Demolition Derby.mra
32K	Devil Fish.mra
32K	Dig Dug (Atari, rev 1).mra
32K	Dig Dug (Atari, rev 2).mra
32K	Dig Dug (manufactured by Sidam).mra
32K	Dig Dug (rev 1).mra
32K	Dig Dug II (Old Ver.).mra
32K	Dig Dug.mra
32K	DigDug2.mra
32K	Dinosaur Hunter -Chinese bootleg of Cadillacs and Dinosaurs-.mra
32K	Discs of Tron (Upright alternate).mra
32K	Discs of Tron.mra
32K	Dizzy Ghost - A Reversal of Roles - HBMame.mra
32K	Domino Man.mra
32K	Dominos.mra
32K	Donkey Kong (2 marios) - HBMame.mra
32K	Donkey Kong (2600 graphics) - HBMame.mra
32K	Donkey Kong (Japan set 1).mra
32K	Donkey Kong (Japan set 2).mra
32K	Donkey Kong (Japan set 3).mra
32K	Donkey Kong (Pacman graphics) - HBMame.mra
32K	Donkey Kong (US set 1 with barrel control coloring) - HBMame.mra
32K	Donkey Kong (US set 2).mra
32K	Donkey Kong (hard kit).mra
32K	Donkey Kong (patched) - HBMame.mra
32K	Donkey Kong Foundry (hack).mra
32K	Donkey Kong Foundry - HBMame.mra
32K	Donkey Kong Freerun Edition - HBMame.mra
32K	Donkey Kong Pace - HBMame.mra
32K	Donkey Kong Pauline Edition Rev 5 (2013-04-22).mra
32K	Donkey Kong Remix demo 1.8 - HBMame.mra
32K	Donkey Kong Reverse - HBMame.mra
32K	Donkey Kong Trainer 1.01 - HBMame.mra
32K	Donkey Kong.mra
32K	Dorodon (set 2).mra
32K	Dorodon.mra
32K	Double Dragon (US set 1).mra
32K	Double Dragon (US set 2).mra
32K	Double Dragon (US set 3).mra
32K	Double Dragon (World set 1).mra
32K	Double Dragon (World set 2).mra
32K	Double Dragon (bootleg).mra
32K	Double Dragon II - The Revenge (Japan).mra
32K	Double Dragon II - The Revenge (US).mra
32K	Double Dragon II - The Revenge.mra
32K	Double Dragon.mra
32K	Dream Shopper.mra
32K	Druaga.mra
32K	Dynasty Wars -USA, B-Board 88622B-3-.mra
32K	Dynasty Wars -USA, B-Board 89624B- -.mra
32K	Eeekk!.mra
32K	Eggor.mra
32K	Elton Pac - HBMame.mra
32K	Euro Pac - HBMame.mra
32K	Extra Bases.mra
32K	Eyes (Italy).mra
32K	Eyes (US set 2).mra
32K	Eyes.mra

BS=32K for 32GB SDcard with MiSTer-sd-installer-linux.sh

/media/fat/_Arcade# du -sh * | grep -v mra 
66M    _Organized
14M    _alternatives
234M    cores

/media/fat/_Arcade/_Organized/_1 A-E# du -sh *
16K	1941  Counter Attack -Japan-.mra
16K	1941  Counter Attack -USA 900227-.mra
16K	1941  Counter Attack -World 900227-.mra
16K	1941  Counter Attack -World-.mra
16K	1942.mra
16K	1943 Kai Midway Kaisen.mra
16K	1943 Midway Kaisen.mra
16K	1943 The Battle of Midway Mark II.mra
16K	1943 The Battle of Midway.mra
16K	Abortman - HBMame.mra
16K	Adventure Quiz Capcom World 2 -Japan 920611, B-Board 90629B-3, no battery-.mra
16K	Adventure Quiz Capcom World 2 -Japan 920611, B-Board 91634B-2-.mra
16K	Adventure Quiz Capcom World 2 -Japan 920611-.mra
16K	Aerolitos (Spanish bootleg of Asteroids).mra
16K	Alibaba 40 Thieves.mra
16K	Alien Arena.mra
16K	Amidar.mra
16K	Andromeda - HBMame.mra
16K	Anteater.mra
16K	Apocaljpse Now (bootleg of Rescue).mra
16K	Area 88 -Japan Resale Ver.-.mra
16K	Area 88 -Japan-.mra
16K	Arkanoid (Game Corporation bootleg, set 1).mra
16K	Arkanoid (Game Corporation bootleg, set 2).mra
16K	Arkanoid (Tayto bootleg, harder).mra
16K	Arkanoid (Unlimited Lives).mra
16K	Arkanoid (unl.lives, slower).mra
16K	Arkanoid.mra
16K	Armored Car (set 2).mra
16K	Armored Car.mra
16K	Asterock (Sidam bootleg of Asteroids).mra
16K	Asterock (Videotron bootleg of Asteroids).mra
16K	Asteroids (Six-Bullet Hack) - HBMame.mra
16K	Asteroids (rev 1).mra
16K	Asteroids (rev 2).mra
16K	Asteroids Deluxe (Unknown Revision) [h] - HBMame.mra
16K	Asteroids Deluxe (rev 1).mra
16K	Asteroids Deluxe (rev 2).mra
16K	Asteroids Deluxe.mra
16K	Asteroids.mra
16K	Astrians (clone of Swarm).mra
16K	Astropede - HBMame.mra
16K	Astropede II - HBMame.mra
16K	Ataque Sideral (Spanish bootleg of UniWar S).mra
16K	Ave Fenix (Electrogame, Spanish bootleg of Phoenix).mra
16K	Ave Fenix (Laguna, Spanish bootleg of Phoenix).mra
16K	Ave Fenix (Recreativos Franco, Spanish bootleg of Phoenix).mra
16K	Azurian Attack.mra
16K	Baby Pacman 2 (Alt) - HBMame.mra
16K	Baby Pacman 3 (Alt) - HBMame.mra
16K	Bagman (Stern Electronics, set 1).mra
16K	Bagman (Stern Electronics, set 2).mra
16K	Bagman (Taito).mra
16K	Bagman Turbo (Stern set 1) [c] - HBMame.mra
16K	Bagman.mra
16K	Battle Road.mra
16K	Battle of Atlantis.mra
16K	Battles (set 2).mra
16K	Beastie Feastie.mra
16K	Berzerk (French Speech, revision RC31).mra
16K	Berzerk (German Speech, revision RC32).mra
16K	Berzerk (Spanish Speech, revision RC32).mra
16K	Berzerk (revision RC28).mra
16K	Berzerk (revision RC31).mra
16K	Berzerk.mra
16K	Biaofeng Zhanjing -Chinese bootleg of The Punisher-.mra
16K	Big Kong.mra
16K	Bionic Commando.mra
16K	Birdiy.mra
16K	Black Hole.mra
16K	Black Tiger.mra
16K	Black Widow.mra
16K	Block (Game Corporation bootleg, set 1).mra
16K	Block (Game Corporation bootleg, set 2).mra
16K	Bomb Jack (Bootleg) - HBMame.mra
16K	Bomb Jack (Greek) - HBMame.mra
16K	Bomb Jack (Red) - HBMame.mra
16K	Bomb Jack (Translation Chinese) - HBMame.mra
16K	Bomb Jack (set 2).mra
16K	Bomb Jack.mra
16K	Botanic (French).mra
16K	Botanic.mra
16K	Brakman - HBMame.mra
16K	Bubbles (Solid Red label).mra
16K	Bubbles (prototype version).mra
16K	Bubbles.mra
16K	Bump 'n' Jump (Midway).mra
16K	Bump 'n' Jump Reverse Mod - HBMame.mra
16K	Bump 'n' Jump.mra
16K	Burger Time (Data East set 2).mra
16K	Burger Time.mra
16K	BurningRubber.mra
16K	Calipso.mra
16K	Candory (Ponpoko bootleg with Mario).mra
16K	Canyon Bomber.mra
16K	Capitol.mra
16K	Captain Commando -Japan 910928-.mra
16K	Captain Commando -Japan 911202-.mra
16K	Captain Commando -USA 910928-.mra
16K	Captain Commando -World 911014-.mra
16K	Captain Commando -World 911202-.mra
16K	Car Action (set 1).mra
16K	Car Action (set 2).mra
16K	Carrier Air Wing -USA 901012-.mra
16K	Carrier Air Wing -USA 901130-.mra
16K	Carrier Air Wing -World 901009-.mra
16K	Carrier Air Wing -World 901012-.mra
16K	Catacomb.mra
16K	Caterpillar - HBMame.mra
16K	Cemescary - HBMame.mra
16K	Centipede (revision 1).mra
16K	Centipede (revision 2).mra
16K	Centipede (revision 3).mra
16K	Centipede Dux (hack).mra
16K	Centipede.mra
16K	Chiki Chiki Boys -Japan 900619-.mra
16K	Coccinelle (bootleg of Lady Bug, set 2).mra
16K	Colony 7 (set 2).mra
16K	Colony 7.mra
16K	Commando.mra
16K	Computer Space.mra
16K	Cosmic Avenger.mra
16K	Crackhead - HBMame.mra
16K	Crater Raider.mra
16K	Crazy Climber (US set 2).mra
16K	Crazy Climber.mra
16K	Crazy Kong (Orca bootleg).mra
16K	Crazy Kong Part II (Graphic Fix) - HBMame.mra
16K	Crazy Kong Part II (Japan).mra
16K	Crazy Kong Part II (Jeutel bootleg).mra
16K	Crazy Kong Part II (bootleg).mra
16K	Crazy Kong Part II (set 2).mra
16K	Crazy Kong Part II -1 - HBMame.mra
16K	Crazy Kong Part II -2 - HBMame.mra
16K	Crazy Kong Part II.mra
16K	Crazy Pac - HBMame.mra
16K	Crush Roller.mra
16K	Daimakaimura -Japan Resale Ver.-.mra
16K	Daimakaimura -Japan-.mra
16K	Dark Planet (no bkg).mra
16K	Dark Planet.mra
16K	Defender.mra
16K	Demolition Derby.mra
16K	Devil Fish.mra
16K	Dig Dug (Atari, rev 1).mra
16K	Dig Dug (Atari, rev 2).mra
16K	Dig Dug (manufactured by Sidam).mra
16K	Dig Dug (rev 1).mra
16K	Dig Dug II (Old Ver.).mra
16K	Dig Dug.mra
16K	DigDug2.mra
16K	Dinosaur Hunter -Chinese bootleg of Cadillacs and Dinosaurs-.mra
16K	Discs of Tron (Upright alternate).mra
16K	Discs of Tron.mra
16K	Dizzy Ghost - A Reversal of Roles - HBMame.mra
16K	Domino Man.mra
16K	Dominos.mra
16K	Donkey Kong (2 marios) - HBMame.mra
16K	Donkey Kong (2600 graphics) - HBMame.mra
16K	Donkey Kong (Japan set 1).mra
16K	Donkey Kong (Japan set 2).mra
16K	Donkey Kong (Japan set 3).mra
16K	Donkey Kong (Pacman graphics) - HBMame.mra
16K	Donkey Kong (US set 1 with barrel control coloring) - HBMame.mra
16K	Donkey Kong (US set 2).mra
16K	Donkey Kong (hard kit).mra
16K	Donkey Kong (patched) - HBMame.mra
16K	Donkey Kong Foundry (hack).mra
16K	Donkey Kong Foundry - HBMame.mra
16K	Donkey Kong Freerun Edition - HBMame.mra
16K	Donkey Kong Pace - HBMame.mra
16K	Donkey Kong Pauline Edition Rev 5 (2013-04-22).mra
16K	Donkey Kong Remix demo 1.8 - HBMame.mra
16K	Donkey Kong Reverse - HBMame.mra
16K	Donkey Kong Trainer 1.01 - HBMame.mra
16K	Donkey Kong.mra
16K	Dorodon (set 2).mra
16K	Dorodon.mra
16K	Double Dragon (US set 1).mra
16K	Double Dragon (US set 2).mra
16K	Double Dragon (US set 3).mra
16K	Double Dragon (World set 1).mra
16K	Double Dragon (World set 2).mra
16K	Double Dragon (bootleg).mra
16K	Double Dragon II - The Revenge (Japan).mra
16K	Double Dragon II - The Revenge (US).mra
16K	Double Dragon II - The Revenge.mra
16K	Double Dragon.mra
16K	Dream Shopper.mra
16K	Druaga.mra
16K	Dynasty Wars -USA, B-Board 88622B-3-.mra
16K	Dynasty Wars -USA, B-Board 89624B- -.mra
16K	Eeekk!.mra
16K	Eggor.mra
16K	Elton Pac - HBMame.mra
16K	Euro Pac - HBMame.mra
16K	Extra Bases.mra
16K	Eyes (Italy).mra
16K	Eyes (US set 2).mra
16K	Eyes.mra

There is more than %50 difference in size when block size is set to 32K in the Linux installer script.

@michaelshmitty
Copy link
Owner Author

Great work, looks much more efficiënt. I'll gladly merge a PR if you submit one.

I'll have to look into how to specify the block size in the macOS version.

@MAME-GETTER
Copy link
Contributor

MAME-GETTER commented Jun 16, 2020 •
edited
Loading

So we need to understand more about block size. exFAT on linux has a defaults:

Number of physical sectors per cluster (cluster is an allocation unit in exFAT). Must be a power of 2, i.e. 1, 2, 4, 8, etc. Cluster size can not exceed 32 MB. Default cluster sizes are: 4 KB if volume size is less than 256 MB, 32 KB if volume size is from 256 MB to 32 GB, 128 KB if volume size is 32 GB or larger.

What are the trade off in setting BS at 32K?
exFAT is the 64 bit file system BS at 32K is 4.5 billion blocks on 1TB, is that enough for most MiSTer users? I don't know?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@michaelshmitty michaelshmitty

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@michaelshmitty @MAME-GETTER