-
Notifications
You must be signed in to change notification settings - Fork 619
Logging into Amazon Cloud
#i-iii. Logging into the Amazon cloud
-
This will ONLY occur once we are in the classroom as it costs to have these servers running. Instructions will be provided in class.
-
We have set up ~30 instances on the Amazon cloud - one for each student. In order to log in to your instance, you will need a security certificate.
-
You will be provided with a key file called: "CSHLRNA.pem".
-
We have set up DNS shortcuts to the Amazon nodes so that we don't have to remember long hostnames like
ec2-50-19-168-121.compute-1.amazonaws.com
. Instead, we'll use the following hostnames:cshl##.dyndns.org
where ## is your assigned student number (01 - 30). -
It is very important that you use only your own student number when logging in! If two people log into the same Amazon machine they may have collisions as they try to write files to the same places and this will cause errors and confusion.
-
On the cloud, we're going to use the default username: "ubuntu"
##Logging in with ssh (Mac/Linux)
- Make sure the permissions on your certificate are secure. Use chmod on your downloaded certificate:
chmod 600 CSHLRNA.pem
- To log in to the node, use the -i command line argument to specify your certificate:
ssh -i CSHLRNA.pem ubuntu@cshl##.dyndns.org
##
is your assigned student number. Your student number is the number on the participant list. If your number is less than 10, please add 0 in front of it. -i
selects a file from which the public key authentication is read. ubuntu
is the name of a user on the system you are logging into (a default user of the Ubuntu operating system). cshl##.dyndns.org
is the address of the linux system on Amazon that you are logging into.
##Copying files to your computer
- To copy files from a node, use scp in a similar fashion (in this case to copy a file called nice_alignments.bam):
scp -i CSHLRNA.pem ubuntu@cshl##.dyndns.org:workspace/nice_alignments.bam .
- Everything created in your workspace on the cloud is also available by a web server on your cloud instance. Simply go to the following in your browser:
##File system layout
When you log in, you'll notice that you have two directories: "bin" and "workspace".
- The "bin" directory contains the tools that you'll need to complete your lab assignments. Actually you are going to learn to install your own copies of all these tools but these are in place as a backup.
- The "workspace" directory is where we will keep our temporary files and analysis results.
| Previous Section | This Section | Next Section | |:---------------------------:|:--------------------------------------------------------:|:-----------------------------------------------------:| | Syntax | Logging into Amazon Cloud | Environment |
NOTICE: This resource has been moved to rnabio.org. The version here will be maintained for legacy use only. All future development and maintenance will occur only at rnabio.org. Please proceed to rnabio.org for the current version of this course.
Table of Contents
Module 0: Authors | Citation | Syntax | Intro to AWS | Log into AWS | Unix | Environment | Resources
Module 1: Installation | Reference Genomes | Annotations | Indexing | Data | Data QC
Module 2: Adapter Trim | Alignment | IGV | Alignment Visualization | Alignment QC
Module 3: Expression | Differential Expression | DE Visualization
Module 4: Alignment Free - Kallisto
Module 5: Ref Guided | De novo | Merging | Differential Splicing | Splicing Visualization
Module 6: Trinity
Module 7: Trinotate
Appendix: Saving Results | Abbreviations | Lectures | Practical Exercise Solutions | Integrated Assignment | Proposed Improvements | AWS Setup