Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large eddy simulations of atmospheric boundary layer (TurbuABL) #118

Open
Sshamekh opened this issue May 14, 2024 · 9 comments
Open

Large eddy simulations of atmospheric boundary layer (TurbuABL) #118

Sshamekh opened this issue May 14, 2024 · 9 comments

Comments

@Sshamekh
Copy link

Dataset Name

ABL-LES

Dataset URL

No response

Description

The ABL-LES dataset simulates the atmospheric boundary layer across a wide range of turbulent regimes, from channel flow to strong convective cases, with various boundary conditions (e.g., surface heating, geostrophic wind, free tropospheric lapse rate). The data also includes several implemented scalars (e.g., chemicals with various sources). This dataset is ideal for studying turbulence and transport under a wide range of conditions, making it great for data-driven approaches, specifically for developing parameterizations of the atmospheric boundary layer that can be implemented in climate or weather models.

Size

10-15 TB

License

Unknown

Data Format

NetCDF

Data Format (other)

No response

Access protocol

Globus

Source File Organization

Data are organized by the simulations (set of boundary conditions), and further diveded to snapshots, and statistics.

Example URLs

No response

Authorization

Globus login

Transformation / Processing

Data does not require cleaning but it requires to be better organized

Target Format

Zarr

Comments

No response

@jbusecke
Copy link
Contributor

Hey @Sshamekh, thanks for submitting this. Where is the data accessible?

@Sshamekh
Copy link
Author

Hi Julius,
They are on NCAR HPC

@jbusecke
Copy link
Contributor

Ah ok that makes things (possibly) harder. Can you ask if there is a way for them to make them accessible via http or ftp in some way?

@Sshamekh
Copy link
Author

Thanks Julius.
I will reach out to the NCAR helpdesk to inquire about HTTP or FTP access. However, I wanted to check if using Globus would also be an option beforehand.

@jbusecke
Copy link
Contributor

Possibly. Could you check if they subscribe to the Globus S3 Connector? If that is the case we might be able to move the data to an OSN bucket.

@jbusecke
Copy link
Contributor

Please feel free to cc me in emails if you think that would be helpful.

@jbusecke jbusecke added the hpc label Jun 4, 2024
@jbusecke jbusecke changed the title Large eddy simulations of atmospheric boundary layer Large eddy simulations of atmospheric boundary layer (TurbuABL) Sep 20, 2024
@jbusecke
Copy link
Contributor

Actually did you ever get an answer to this? If they have their own setup, that might make things easier.

@Sshamekh
Copy link
Author

Here is their Globus : https://ncar-hpc-docs.readthedocs.io/en/latest/storage-systems/data-transfer/globus/
But they didn't mention S3 connector. I will check with them

@jbusecke
Copy link
Contributor

jbusecke commented Oct 9, 2024

Hi @Sshamekh, just wanted to check in on the status of the transfer? Do you have some time to let it run some time soon?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants