Skip to content

Releases: luozhouyang/transformers-keras

Release v0.4.1

02 Aug 15:19
Compare
Choose a tag to compare

Updates:

  • Rename arguemt of from_pretrained from model_params to override_params
  • Add BertForSentenceEmbedding model for embedding extraction
  • Add BertForTokenClassificationAlbertForTokenClassification models for token classify tasks
  • Add Conditioanl Random Field based models BertCRFForTokenClassification and AlbertCRFForTokenClassification for token classify tasks

Release v0.4.0

25 Jul 09:58
Compare
Choose a tag to compare

Updates:

  • Simplify pretrained models loadding
  • Add down-stream models, like BertForQuestionAnswering, BertForSequenceClassification

Release v0.3.1

13 Jul 09:19
Compare
Choose a tag to compare

Updates:

  • Convert arguments of Bert.call to List

Release v0.3.0

29 Jun 02:03
Compare
Choose a tag to compare

Changes:

  • Refactoring modeling to simplify pretrained weights adapting
  • Add new signature to export model in SavedModel format

Release v0.2.6

02 Jun 11:30
Compare
Choose a tag to compare

Updates:

  • Pass arguments as tuple in call when subclassing keras.Model, which makes it simplier to export model in saved model format

Release v0.2.5

18 May 12:11
Compare
Choose a tag to compare

Updates:

  • Convert hidden_states and attention_weights of each encoder layer from List to Tensor
  • Update adapters to allow arbitrary model name when loading pretrained checkpoints

Release v0.2.4

11 May 07:47
Compare
Choose a tag to compare

Updates:

  • Expand arguments of call method instead of as a tuple

Release v0.2.3

03 Mar 12:39
Compare
Choose a tag to compare

Updates:

  • Add support for skip loading weights from ckpt
  • Add tokenizers

Release v0.2.2

24 Jan 13:37
Compare
Choose a tag to compare

Updates

  • Optionally return encoder states and attention weights, both False in default.

Release v0.2.1

23 Dec 07:50
Compare
Choose a tag to compare

Updates:

  • Refactored the adapter for more flexible use