Probable error on line 306 in create_pretraining_data.py for albert

[wjdghks950]

albert/create_pretraining_data.py

Line 306 in 932b41f

a_end = rng.randint(1, len(current_chunk) - 1)

In line 306, there is appears to be a probable issue.

For random.randint(start, end), the method is end-inclusive.

So, when len(current_chunk) == 2, line 309 would stop at a single iteration.

While this may allow the model to incorporate the single leftover chunk (if it were to be enter the first elif statement in line 339), it will leave the single chunk out of training instances.

Please address this issue.