Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[jobSender] Migrate to array jobs #16

Open
duartej opened this issue Dec 20, 2016 · 2 comments
Open

[jobSender] Migrate to array jobs #16

duartej opened this issue Dec 20, 2016 · 2 comments
Assignees

Comments

@duartej
Copy link
Owner

duartej commented Dec 20, 2016

The array jobs allow to send an huge amount of subjobs without dealing with the max. quotas of the queues.

@duartej duartej self-assigned this Dec 20, 2016
@duartej
Copy link
Owner Author

duartej commented Dec 20, 2016

The potential changes to perform:

  • the maxEvents, skipEvents and output filename should contain a reference to the ${PBS_ARRAYID} variable. In the case of the maxEvents, skipEvents option, a file with the same number of lines as array jobs defined should do the trick, mapping the line with the arrayID

@duartej
Copy link
Owner Author

duartej commented Dec 22, 2016

See branch jobArrays: incorporate the changes to use those jobs. So far 88a62e23,

  • PBS cluster (tau)
  • BlindJobs and Transformation jobs

are available. CERN cluster and athena joOption jobs should be incorporated

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant