Skip to content

Commit

Permalink
Added comment to explain unused model constraints entry
Browse files Browse the repository at this point in the history
  • Loading branch information
cryptal-mc committed Dec 12, 2024
1 parent efde34b commit 571e497
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions constants/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -173,6 +173,13 @@
epsilon_func=LinearDecay(0.005, 0.0002, 36000),
max_bytes=29 * 1024 * 1024 * 1024,
),
# This constraint is not actually used, it is added as a copy
# of the 14B-model competition constraint entry.
# This is just to keep the size of the constraint dict equal
# to the number of competitions so `update_models_limit` is
# set correctly below.
# This hack will be removed once native support for multi datasets
# is implemented in a future release.
CompetitionId.B14_MODEL_MULTI_DATASET: ModelConstraints(
max_model_parameter_size=13_900_000_000,
min_model_parameter_size=13_700_000_000,
Expand Down

0 comments on commit 571e497

Please sign in to comment.