Add Llama 3.2 Visual example on both GKE and Vertex AI (#106)

* Add `examples/gke/tgi-llama-vision-deployment` (WIP)

* Update `examples/gke/tgi-llama-vision-deployment`

* Update `examples/gke/tgi-llama-vision-deployment/README.md`

* Update `ingress.yaml` to use `annotations`

* Add missing `bash` syntax highlighting

* Add `examples/vertex-ai/notebooks/deploy-llama-vision-on-vertex-ai`

* Add missing reference on `ingress.yaml`

* Update example listings

README.md

@@ -58,10 +58,12 @@ The [`examples`](./examples) directory contains examples for using the container
 | Vertex AI | [examples/vertex-ai/notebooks/deploy-flux-on-vertex-ai](./examples/vertex-ai/notebooks/deploy-flux-on-vertex-ai)                     | Deploy FLUX with PyTorch Inference DLC on Vertex AI           |
 | Vertex AI | [examples/vertex-ai/notebooks/deploy-gemma-from-gcs-on-vertex-ai](./examples/vertex-ai/notebooks/deploy-gemma-from-gcs-on-vertex-ai) | Deploy Gemma 7B with TGI DLC from GCS on Vertex AI            |
 | Vertex AI | [examples/vertex-ai/notebooks/deploy-gemma-on-vertex-ai](./examples/vertex-ai/notebooks/deploy-gemma-on-vertex-ai)                   | Deploy Gemma 7B with TGI DLC on Vertex AI                     |
+| Vertex AI | [examples/vertex-ai/notebooks/deploy-llama-vision-on-vertex-ai](./examples/vertex-ai/notebooks/deploy-llama-vision-on-vertex-ai)     | Deploy Llama 3.2 11B Vision with TGI DLC on Vertex AI         |
 | Vertex AI | [examples/vertex-ai/notebooks/deploy-llama-3-1-405b-on-vertex-ai](./examples/vertex-ai/notebooks/deploy-llama-3-1-405b-on-vertex-ai) | Deploy Meta Llama 3.1 405B with TGI DLC on Vertex AI          |
 | GKE       | [examples/gke/tei-from-gcs-deployment](./examples/gke/tei-from-gcs-deployment)                                                       | Deploy BGE Base v1.5 with TEI DLC from GCS on GKE             |
 | GKE       | [examples/gke/tgi-multi-lora-deployment](./examples/gke/tgi-multi-lora-deployment)                                                   | Deploy Gemma2 with multiple LoRA adapters with TGI DLC on GKE |
 | GKE       | [examples/gke/tgi-llama-405b-deployment](./examples/gke/tgi-llama-405b-deployment)                                                   | Deploy Llama 3.1 405B with TGI DLC on GKE                     |
+| GKE       | [examples/gke/tgi-llama-vision-deployment](./examples/gke/tgi-llama-vision-deployment)                                               | Deploy Llama 3.2 11B Vision with TGI DLC on GKE               |
 | GKE       | [examples/gke/tgi-deployment](./examples/gke/tgi-deployment)                                                                         | Deploy Meta Llama 3 8B with TGI DLC on GKE                    |
 | GKE       | [examples/gke/tgi-from-gcs-deployment](./examples/gke/tgi-from-gcs-deployment)                                                       | Deploy Qwen2 7B with TGI DLC from GCS on GKE                  |
 | GKE       | [examples/gke/tei-deployment](./examples/gke/tei-deployment)                                                                         | Deploy Snowflake's Arctic Embed with TEI DLC on GKE           |

docs/source/resources.mdx

@@ -33,6 +33,7 @@ Learn how to use Hugging Face in Google Cloud by reading our blog posts, present
   - [Deploy FLUX with PyTorch Inference DLC on Vertex AI](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/vertex-ai/notebooks/deploy-flux-on-vertex-ai)
   - [Deploy Gemma 7B with TGI DLC from GCS on Vertex AI](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/vertex-ai/notebooks/deploy-gemma-from-gcs-on-vertex-ai)
   - [Deploy Gemma 7B with TGI DLC on Vertex AI](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/vertex-ai/notebooks/deploy-gemma-on-vertex-ai)
+  - [Deploy Llama 3.2 11B Vision with TGI DLC on Vertex AI](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/vertex-ai/notebooks/deploy-llama-vision-on-vertex-ai)
   - [Deploy Meta Llama 3.1 405B with TGI DLC on Vertex AI](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/vertex-ai/notebooks/deploy-llama-3-1-405b-on-vertex-ai)
 
 - Training
@@ -51,6 +52,7 @@ Learn how to use Hugging Face in Google Cloud by reading our blog posts, present
   - [Deploy BGE Base v1.5 with TEI DLC from GCS on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tei-from-gcs-deployment)
   - [Deploy Gemma2 with multiple LoRA adapters with TGI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-multi-lora-deployment)
   - [Deploy Llama 3.1 405B with TGI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-llama-405b-deployment)
+  - [Deploy Llama 3.2 11B Vision with TGI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-llama-vision-deployment)
   - [Deploy Meta Llama 3 8B with TGI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-deployment)
   - [Deploy Qwen2 7B with TGI DLC from GCS on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-from-gcs-deployment)
   - [Deploy Snowflake's Arctic Embed with TEI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tei-deployment)

examples/gke/README.md

@@ -11,11 +11,12 @@ This directory contains usage examples of the Hugging Face Deep Learning Contain
 
 ## Inference Examples
 
-| Example                                                  | Title                                                         |
-| -------------------------------------------------------- | ------------------------------------------------------------- |
-| [tei-deployment](./tei-deployment)                       | Deploy Snowflake's Arctic Embed with TEI DLC on GKE           |
-| [tei-from-gcs-deployment](./tei-from-gcs-deployment)     | Deploy BGE Base v1.5 with TEI DLC from GCS on GKE             |
-| [tgi-deployment](./tgi-deployment)                       | Deploy Meta Llama 3 8B with TGI DLC on GKE                    |
-| [tgi-from-gcs-deployment](./tgi-from-gcs-deployment)     | Deploy Qwen2 7B with TGI DLC from GCS on GKE                  |
-| [tgi-llama-405b-deployment](./tgi-llama-405b-deployment) | Deploy Llama 3.1 405B with TGI DLC on GKE                     |
-| [tgi-multi-lora-deployment](./tgi-multi-lora-deployment) | Deploy Gemma2 with multiple LoRA adapters with TGI DLC on GKE |
+| Example                                                      | Title                                                         |
+| ------------------------------------------------------------ | ------------------------------------------------------------- |
+| [tei-deployment](./tei-deployment)                           | Deploy Snowflake's Arctic Embed with TEI DLC on GKE           |
+| [tei-from-gcs-deployment](./tei-from-gcs-deployment)         | Deploy BGE Base v1.5 with TEI DLC from GCS on GKE             |
+| [tgi-deployment](./tgi-deployment)                           | Deploy Meta Llama 3 8B with TGI DLC on GKE                    |
+| [tgi-from-gcs-deployment](./tgi-from-gcs-deployment)         | Deploy Qwen2 7B with TGI DLC from GCS on GKE                  |
+| [tgi-llama-405b-deployment](./tgi-llama-405b-deployment)     | Deploy Llama 3.1 405B with TGI DLC on GKE                     |
+| [tgi-llama-vision-deployment](./tgi-llama-vision-deployment) | Deploy Llama 3.2 11B Vision with TGI DLC on GKE               |
+| [tgi-multi-lora-deployment](./tgi-multi-lora-deployment)     | Deploy Gemma2 with multiple LoRA adapters with TGI DLC on GKE |