From ef0b51ba0ee2fa2d4920b2c7ff296b7e16ea9551 Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 11:56:19 +0100 Subject: [PATCH 01/14] add zerogpu to advanced compute options --- docs/hub/advanced-compute-options.md | 53 +++++++++++++++++----------- 1 file changed, 33 insertions(+), 20 deletions(-) diff --git a/docs/hub/advanced-compute-options.md b/docs/hub/advanced-compute-options.md index c1d2e1ab0..161a132b2 100644 --- a/docs/hub/advanced-compute-options.md +++ b/docs/hub/advanced-compute-options.md @@ -6,6 +6,19 @@ Enterprise Hub organizations gain access to advanced compute options to accelera This feature is part of the Enterprise Hub. +## Host ZeroGPU Spaces in your organization + +ZeroGPU is a dynamic GPU allocation system that optimizes AI deployment on Hugging Face Spaces. By automatically allocating and releasing NVIDIA A100 GPUs (40GB VRAM) as needed, organizations can efficiently serve their AI applications without dedicated GPU instances. + +### Key benefits for organizations: + +- **Free GPU Access**: Access powerful NVIDIA A100 GPUs at no additional cost through dynamic allocation +- **Enhanced Resource Management**: Host up to 50 ZeroGPU Spaces for efficient team-wide AI deployment +- **Simplified Deployment**: Easy integration with PyTorch-based models and Hugging Face libraries +- **Enterprise-Grade Infrastructure**: Access to high-performance NVIDIA A100 GPUs with 40GB VRAM per workload + +[Learn more about ZeroGPU →](https://huggingface.co/docs/hub/spaces-zerogpu) + ## Train on NVIDIA DGX Cloud Train on NVIDIA DGX Cloud offers a simple no-code training job creation experience powered by Hugging Face AutoTrain and Hugging Face Spaces. Instantly access NVIDIA GPUs and avoid the time-consuming work of writing, testing, and debugging training scripts for AI models. @@ -18,30 +31,30 @@ Read the [blogpost for Train on NVIDIA DGX Cloud](https://huggingface.co/blog/tr #### Transformers -| Architecture | -|---------------------------| -| Llama | -| Falcon | -| Mistral | -| Mixtral | -| T5 | -| gemma | +| Architecture | +| ------------ | +| Llama | +| Falcon | +| Mistral | +| Mixtral | +| T5 | +| gemma | #### Diffusers -| Architecture | -|---------------------------| -| Stable Diffusion | -| Stable Diffusion XL | +| Architecture | +| ------------------- | +| Stable Diffusion | +| Stable Diffusion XL | ### Pricing Usage of Train on NVIDIA DGX Cloud is billed by the minute of the GPU instances used during your training jobs. Usage fees accrue to your Enterprise Hub Organizations’ current monthly billing cycle, once a job is completed. You can check your current and past usage at any time within the billing settings of your Enterprise Hub Organization. -| NVIDIA GPU | GPU Memory | On-Demand Price/hr | -|---------------------------|---------------------------|---------------------------| -| NVIDIA L40S | 48GB |$2.75 | -| NVIDIA H100 | 80GB |$8.25 | +| NVIDIA GPU | GPU Memory | On-Demand Price/hr | +| ----------- | ---------- | ------------------ | +| NVIDIA L40S | 48GB | $2.75 | +| NVIDIA H100 | 80GB | $8.25 | ## NVIDIA NIM API (serverless) @@ -59,8 +72,8 @@ You can find all supported models in [this NVIDIA Collection](https://huggingfac Usage of NVIDIA NIM API (serverless) is billed based on the compute time spent per request. Usage fees accrue to your Enterprise Hub Organizations’ current monthly billing cycle, once a job is completed. You can check your current and past usage at any time within the billing settings of your Enterprise Hub Organization. -| NVIDIA GPU | GPU Memory | On-Demand Price/hr | -|---------------------------|---------------------------|---------------------------| -| NVIDIA H100 | 80GB |$8.25 | +| NVIDIA GPU | GPU Memory | On-Demand Price/hr | +| ----------- | ---------- | ------------------ | +| NVIDIA H100 | 80GB | $8.25 | -The total cost for a request will depend on the model size, the number of GPUs required, and the time taken to process the request. For each model, you can find which hardware configuration is used in the notes of [this NVIDIA Collection](https://huggingface.co/collections/nvidia/nim-66a3c6fcdcb5bbc6e975b508). \ No newline at end of file +The total cost for a request will depend on the model size, the number of GPUs required, and the time taken to process the request. For each model, you can find which hardware configuration is used in the notes of [this NVIDIA Collection](https://huggingface.co/collections/nvidia/nim-66a3c6fcdcb5bbc6e975b508). From 0a1a2e1bf92522a825b4afcd3fac1a37ce9798f7 Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 12:52:08 +0100 Subject: [PATCH 02/14] add advanced security --- docs/hub/_toctree.yml | 4 ++- docs/hub/enterprise-hub-advanced-security.md | 31 ++++++++++++++++++++ 2 files changed, 34 insertions(+), 1 deletion(-) create mode 100644 docs/hub/enterprise-hub-advanced-security.md diff --git a/docs/hub/_toctree.yml b/docs/hub/_toctree.yml index fbe31d443..d5b2f0405 100644 --- a/docs/hub/_toctree.yml +++ b/docs/hub/_toctree.yml @@ -333,9 +333,11 @@ - local: enterprise-hub-datasets title: Dataset viewer for Private datasets - local: enterprise-hub-resource-groups - title: Resource Groups (Advanced Access Control) + title: Resource Groups (Access Control) - local: advanced-compute-options title: Advanced Compute Options + - local: enterprise-hub-advanced-security + title: Advanced Security - local: enterprise-hub-tokens-management title: Tokens Management - local: enterprise-hub-analytics diff --git a/docs/hub/enterprise-hub-advanced-security.md b/docs/hub/enterprise-hub-advanced-security.md new file mode 100644 index 000000000..aab541c5e --- /dev/null +++ b/docs/hub/enterprise-hub-advanced-security.md @@ -0,0 +1,31 @@ +# Advanced Security + + +This feature is part of the Enterprise Hub. + + +Enterprise Hub organizations can improve their security posture with advanced security controls for both members and repositories. + +
+ screenshot of the Dataset Viewer on a private dataset owned by an Enterprise Hub organization. + +
+ +## Members Security + +Configure additional security settings to protect your organization: + +- **Two-Factor Authentication (2FA)**: Require all organization members to enable 2FA for enhanced account security. +- **User Approval**: For organizations with a verified domain name, require admin approval for new users with matching email addresses. This adds a verified badge to your organization page. + +## Repository Visibility Controls + +Manage the default visibility of repositories in your organization: + +- **Public by default**: New repositories are created with public visibility +- **Private by default**: New repositories are created with private visibility. Note that changing this setting will not affect existing repositories. +- **Private only**: Enforce private visibility for all new repositories, with only organization admins able to change visibility settings + +These settings help organizations maintain control over their intellectual property while enabling collaboration when needed. + +[Learn more about Enterprise security features →](/docs/hub/enterprise-hub-advanced-security) From e0ed60ed16355977bb4f80cabd2a54ed78854433 Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 12:56:54 +0100 Subject: [PATCH 03/14] Private dataset viewer --- docs/hub/_toctree.yml | 2 +- docs/hub/enterprise-hub.md | 3 ++- docs/hub/organizations.md | 8 ++++++-- 3 files changed, 9 insertions(+), 4 deletions(-) diff --git a/docs/hub/_toctree.yml b/docs/hub/_toctree.yml index d5b2f0405..67e43ccda 100644 --- a/docs/hub/_toctree.yml +++ b/docs/hub/_toctree.yml @@ -331,7 +331,7 @@ - local: storage-regions title: Storage Regions - local: enterprise-hub-datasets - title: Dataset viewer for Private datasets + title: Private datasets viewer - local: enterprise-hub-resource-groups title: Resource Groups (Access Control) - local: advanced-compute-options diff --git a/docs/hub/enterprise-hub.md b/docs/hub/enterprise-hub.md index f38535e3d..d146c9656 100644 --- a/docs/hub/enterprise-hub.md +++ b/docs/hub/enterprise-hub.md @@ -9,8 +9,9 @@ In this section we will document the following Enterprise Hub features: - [SSO](./enterprise-sso) - [Audit Logs](./audit-logs) - [Storage Regions](./storage-regions) -- [Dataset viewer for Private datasets](./enterprise-hub-datasets) +- [Private datasets viewer](./enterprise-hub-datasets) - [Resource Groups](./security-resource-groups) - [Advanced Compute Options](./advanced-compute-options) +- [Advanced Security](./enterprise-hub-advanced-security) - [Tokens Management](./enterprise-hub-tokens-management) - [Analytics](./enterprise-hub-analytics) diff --git a/docs/hub/organizations.md b/docs/hub/organizations.md index 22d0a32c4..dc5e746a8 100644 --- a/docs/hub/organizations.md +++ b/docs/hub/organizations.md @@ -10,8 +10,12 @@ If an organization needs to track user access to a dataset due to licensing or p - [Organization Cards](./organizations-cards) - [Access Control in Organizations](./organizations-security) - [Enterprise Hub features](./enterprise-hub) - - [SSO in Organizations](./enterprise-sso) + - [SSO](./enterprise-sso) - [Audit Logs](./audit-logs) - [Storage Regions](./storage-regions) - - [Dataset viewer for Private datasets](./enterprise-hub-datasets) + - [Private datasets viewer](./enterprise-hub-datasets) - [Resource Groups](./security-resource-groups) + - [Advanced Compute Options](./advanced-compute-options) + - [Advanced Security](./enterprise-hub-advanced-security) + - [Tokens Management](./enterprise-hub-tokens-management) + - [Analytics](./enterprise-hub-analytics) From f89cff4be973f53af449202c6319e15fe2763c26 Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 13:00:16 +0100 Subject: [PATCH 04/14] rm --- docs/hub/enterprise-hub-advanced-security.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/docs/hub/enterprise-hub-advanced-security.md b/docs/hub/enterprise-hub-advanced-security.md index aab541c5e..a637f263a 100644 --- a/docs/hub/enterprise-hub-advanced-security.md +++ b/docs/hub/enterprise-hub-advanced-security.md @@ -27,5 +27,3 @@ Manage the default visibility of repositories in your organization: - **Private only**: Enforce private visibility for all new repositories, with only organization admins able to change visibility settings These settings help organizations maintain control over their intellectual property while enabling collaboration when needed. - -[Learn more about Enterprise security features →](/docs/hub/enterprise-hub-advanced-security) From 55a00a0da58dad997fce0b60bb84b665b8bc5ce8 Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 13:01:33 +0100 Subject: [PATCH 05/14] wording --- docs/hub/enterprise-hub-advanced-security.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/hub/enterprise-hub-advanced-security.md b/docs/hub/enterprise-hub-advanced-security.md index a637f263a..be002d4d6 100644 --- a/docs/hub/enterprise-hub-advanced-security.md +++ b/docs/hub/enterprise-hub-advanced-security.md @@ -4,7 +4,7 @@ This feature is part of the Enterprise Hub. -Enterprise Hub organizations can improve their security posture with advanced security controls for both members and repositories. +Enterprise Hub organizations can improve their security with advanced security controls for both members and repositories.
screenshot of the Dataset Viewer on a private dataset owned by an Enterprise Hub organization. From 9ccdf9a328daa0e9ce4982550532338ab99eda46 Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 13:03:53 +0100 Subject: [PATCH 06/14] wording --- docs/hub/enterprise-hub-advanced-security.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/hub/enterprise-hub-advanced-security.md b/docs/hub/enterprise-hub-advanced-security.md index be002d4d6..8dcdc3b87 100644 --- a/docs/hub/enterprise-hub-advanced-security.md +++ b/docs/hub/enterprise-hub-advanced-security.md @@ -26,4 +26,4 @@ Manage the default visibility of repositories in your organization: - **Private by default**: New repositories are created with private visibility. Note that changing this setting will not affect existing repositories. - **Private only**: Enforce private visibility for all new repositories, with only organization admins able to change visibility settings -These settings help organizations maintain control over their intellectual property while enabling collaboration when needed. +These settings help organizations maintain control of their ownership while enabling collaboration when needed. From a3fa764f4251dfb4aa8c438e3f724ef14bf5ec1d Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 13:17:37 +0100 Subject: [PATCH 07/14] update outdated image --- docs/hub/enterprise-hub.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/hub/enterprise-hub.md b/docs/hub/enterprise-hub.md index d146c9656..faf75a7bf 100644 --- a/docs/hub/enterprise-hub.md +++ b/docs/hub/enterprise-hub.md @@ -2,7 +2,7 @@ Enterprise Hub adds advanced capabilities to organizations, enabling safe, compliant and managed collaboration for companies and teams on Hugging Face. -![](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/storage-regions/enterprise-hub.png) +![](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/enterprise/enterprise-hub.png) In this section we will document the following Enterprise Hub features: From bbabd86c39786d3be5e895689fd65629fabdb7f8 Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 13:36:27 +0100 Subject: [PATCH 08/14] audit logs list events --- docs/hub/audit-logs.md | 74 ++++++++++++++++++++++++++++++++++++++++-- 1 file changed, 72 insertions(+), 2 deletions(-) diff --git a/docs/hub/audit-logs.md b/docs/hub/audit-logs.md index 110e02d5f..310da9b85 100644 --- a/docs/hub/audit-logs.md +++ b/docs/hub/audit-logs.md @@ -6,6 +6,76 @@ This feature is part of the Enterprise Hub. -This has two main benefits: +This offers two key benefits: - Regulatory and legal compliance -- Performance (improved download and upload speeds and latency) +- Performance (faster download/upload speeds and lower latency) -Currently we support the following regions: +Currently available regions: - US 🇺🇸 - EU 🇪🇺 -- coming soon: Asia-Pacific 🌏 +- Coming soon: Asia-Pacific 🌏 ## How to set up -If your organization is subscribed to Enterprise Hub, you will be able to see the Regions settings page: +Organizations subscribed to Enterprise Hub can access the Regions settings page: ![](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/storage-regions/feature-annotated.png) -On that page you can see: +This page displays: -- an audit of where your organization repos are currently located -- dropdowns to select where your repos will be created +- An audit of your organization's repository locations +- Options to select where new repositories will be stored ## Repository Tag -Any repo (model or dataset) stored in a non-default location will display its Region directly as a tag. That way your organization's members can see at a glance where repos are located. +Any repository (model or dataset) stored in a non-default location displays its Region as a tag, allowing organization members to quickly identify repository locations.
@@ -38,16 +38,16 @@ Any repo (model or dataset) stored in a non-default location will display its Re ## Regulatory and legal compliance -In regulated industries, companies may be required to store data in a specific region. +Regulated industries often require data storage in specific regions. -For companies in the EU, that means you can use the Hub to build ML in a GDPR compliant way: with datasets, models and inference endpoints all stored within EU data centers. +For EU companies, this means you can use the Hub for ML development in a GDPR-compliant manner, with datasets, models and inference endpoints stored in EU data centers. ## Performance -Storing your models or your datasets closer to your team and infrastructure also means significantly improved performance, for both uploads and downloads. +Storing models and datasets closer to your team and infrastructure significantly improves performance for both uploads and downloads. -This makes a big difference considering model weights and dataset files are usually very large. +This impact is substantial given the typically large size of model weights and dataset files. ![](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/storage-regions/upload-speed.png) -As an example, if you are located in Europe and store your repositories in the EU region, you can expect to see ~4-5x faster upload and download speeds vs. if they were stored in the US. +For example, European users storing repositories in the EU region can expect approximately 4-5x faster upload and download speeds compared to US storage. From 22cd0c3e829f702c37f3462d308392d0decdfddd Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Mon, 28 Oct 2024 13:58:53 +0100 Subject: [PATCH 10/14] more wording --- docs/hub/advanced-compute-options.md | 2 +- docs/hub/audit-logs.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/hub/advanced-compute-options.md b/docs/hub/advanced-compute-options.md index 161a132b2..bc3a82c4b 100644 --- a/docs/hub/advanced-compute-options.md +++ b/docs/hub/advanced-compute-options.md @@ -10,7 +10,7 @@ This feature is part of the