Bump transformers from 4.31.0 to 4.33.2

[dependabot]

Bumps transformers from 4.31.0 to 4.33.2.

Release notes

Sourced from transformers's releases.

Patch release: v4.33.2

A patch release was done for these two commits:

• Fix pad to multiple of (#25732)
• fix _resize_token_embeddings will set lm head size to 0 when enabled deepspeed zero3 (#26024)

Falcon, Code Llama, ViTDet, DINO v2, VITS

Falcon

Falcon is a class of causal decoder-only models built by TII. The largest Falcon checkpoints have been trained on >=1T tokens of text, with a particular emphasis on the RefinedWeb corpus. They are made available under the Apache 2.0 license.

Falcon’s architecture is modern and optimized for inference, with multi-query attention and support for efficient attention variants like FlashAttention. Both ‘base’ models trained only as causal language models as well as ‘instruct’ models that have received further fine-tuning are available.

• Falcon port #24523 by @​Rocketknight1
• Falcon: Add RoPE scaling by @​gante in #25878
• Add proper Falcon docs and conversion script by @​Rocketknight1 in #25954
• Put Falcon back by @​LysandreJik in #25960
• [Falcon] Remove SDPA for falcon to support earlier versions of PyTorch (< 2.0) by @​younesbelkada in #25947

Code Llama

Code Llama, is a family of large language models for code based on Llama 2, providing state-of-the-art performance among open models, infilling capabilities, support for large input contexts, and zero-shot instruction following ability for programming tasks.

• [CodeLlama] Add support for CodeLlama by @​ArthurZucker in #25740
• [CodeLlama] Fix CI by @​ArthurZucker in #25890

ViTDet

ViTDet reuses the ViT model architecture, adapted to object detection.

• Add ViTDet by @​NielsRogge in #25524

DINO v2

DINO v2 is the next iteration of the DINO model. It is added as a backbone class, allowing it to be re-used in downstream models.

• [DINOv2] Add backbone class by @​NielsRogge in #25520

VITS

VITS (Variational Inference with adversarial learning for end-to-end Text-to-Speech) is an end-to-end speech synthesis model that predicts a speech waveform conditional on an input text sequence. It is a conditional variational autoencoder (VAE) comprised of a posterior encoder, decoder, and conditional prior.

• add VITS model by @​hollance in #24085

Breaking changes:

• 🚨🚨🚨 [Refactor] Move third-party related utility files into integrations/ folder 🚨🚨🚨 by @​younesbelkada in #25599

Moves all third party libs (outside HF ecosystem) related utility files inside integrations/ instead of having them in transformers directly.

In order to get the previous usage you should be changing your call to the following:

... (truncated)

Commits

• 6da93f5 Release: v4.33.2
• b033d1a Fix pad to multiple of (#25732)
• 2ba46c1 fix _resize_token_embeddings will set lm head size to 0 when enabled deepspee...
• 8160e42 Release: v4.33.1
• 118c676 Falcon: fix revision propagation (#26006)
• 5a4f340 Conda build
• 5a6fa3e Conda build
• 19a323e Release: v4.33.0
• 49b69fe [Falcon] Remove SDPA for falcon to support earlier versions of PyTorch (< 2...
• 22a69f1 Put Falcon back (#25960)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #81.