Code

Fix prepare + apply#7

Code

Merged

keyboardAnt merged 29 commits intousdkeyboardAnt/transformers:usdfrom fix_preparekeyboardAnt/transformers:fix_prepareCopy head branch name to clipboardDec 17, 2024

+100-69

Commits

Commits on Dec 8, 2024

• fix prepare + apply

  jmamou

  committed
  6097a8d

• move to cpu

  jmamou

  committed
  71562fc

Commits on Dec 9, 2024

• simplity suppress_tokens

  jmamou

  committed
  3b4e9da

• fix bugs and refacatoring

  jmamou

  committed
  1dcdae4

• device move

  jmamou

  committed
  10d1e56

Commits on Dec 10, 2024

• handle self.config.vocab_size > len(target_tokenizer.get_vocab())

  jmamou

  committed
  f9a260f

• no need to normalize in candidate_generator

  jmamou

  committed
  0d3310d

Commits on Dec 11, 2024

• address Nadav's comments + minor

  jmamou

  committed
  98cd50b

• optimize device move + SuppressTokensLogitsProcessor

  jmamou

  committed
  8260624

Commits on Dec 12, 2024

• AssistantToTargetTranslator, SuppressTokensLogitsProcessor and tokenizers mapping improvements

  jmamou

  committed
  ff7977e

• padding size

  jmamou

  committed
  38d81b1

• padding improvement

  jmamou

  committed
  6a7d3b3

• fix and simplify get_target_logits

  jmamou

  committed
  e4e53b9

• renaming in get_target_logits

  jmamou

  committed
  a19a9de

Commits on Dec 15, 2024

• minor

  jmamou

  committed
  c4e4186

• add filter_value and suppress_tokens_id

  jmamou

  committed
  0ec0788

• style + rename

  jmamou

  committed
  200f7a0

Commits on Dec 16, 2024

• remove TODO

  jmamou

  committed
  95bfa2c

• restore original SelectTokensLogitsProcessor with modification

  jmamou

  committed
  1cbc871

• fix style

  jmamou

  committed
  4a94849

• fix _update_past_and_masks and optimize code

  jmamou

  committed
  f1b6b08

• remove assistant_vocab_size arg

  jmamou

  committed
  df68533

• fix attention_mask

  jmamou

  committed
  35e354a

• call _prepare_attention_mask also if not has_past_key_values

  jmamou

  committed
  a558bd0

Commits on Dec 17, 2024

• handling attention mask for first generation

  jmamou

  committed
  5c3ad58

• comment

  jmamou

  committed
  811a4e5

• restore test

  jmamou

  committed
  2dcc9ed

• remove SelectTokensLogitsProcessor

  jmamou

  committed
  f2be0da

• _update_past_and_masks implementation for USD

  jmamou

  committed
  83b8250