Enhancements for on-the-fly YARN Queue Configuration

[gonzaloetjo]

Challenges are present to dynamically reconfigure YARN queues, especially with a high number of queues. The capacity_scheduler variable, embedded within yarn.xml, complicates updates, as a reconfig involves restarting the ResourceManager, leading to operational inefficiencies.