forked from stanford-rc/globus.stanford.edu
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathscenarios.html
1372 lines (1085 loc) · 54.8 KB
/
scenarios.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
---
layout: wide
title: How Do I … ?
description: Describes different data transfer scenarios, and how Globus can help.
---
<p>Everyone who wants to use Globus has to start somewhere, and that place is
here. You might have been told "Oh, you need to do X", or you might not be
sure what you need to do. This page is for you!</p>
<p>This page contains common Globus scenarios and questions. Each answer
either contains a direct answer to your question
or a link to a different part of the site.</p>
<p>The entries are grouped into four sections: <a href="#accounts">Accounts
(and Globus ID)</a>, the <a href="#web">Globus Web Site</a>, the <a
href="#client">Globus Client</a> (better known as <em>Globus Connect
Personal</em>, and which includes <em>Globus Plus</em>), and the <a
href="#server">Globus Server</a> (<em>Globus Connect Server</em>). Start in
the section that best describes what you want, and read on.</p>
<p>After reading here, you should also take a look at the section of the site
specific to your needs: <a href="{{ "accounts.html" | relative_url }}"
name="Globus @ Stanford, Accounts">Accounts</a>, <a href="{{ "client.html" |
relative_url }}" name="Globus @ Stanford, Client">Client</a>, or <a href="{{
"server.html" | relative_url }}" name="Globus @ Stanford, Server">Server</a>.
Finally, if you still have questions, you should reach out to <a href="{{
"support.html" | relative_url }}" name="Globus @ Stanford,
Support">Support</a>.</p>
<p><b>Good luck!</b></p>
<div class="panel-group" id="scenario" role="tablist" aria-multiselectable="true">
{% capture z1 %}
<p>You are probably here because you've heard about Globus and you want to use
it for something!</p>
<p>Globus is used to transfer data between two points. Those two points could
be a collection of data on a server (such as SCG Lab space), or a personal
endpoint running on a laptop, or a space in the Cloud.</p>
<p>To get started, you should <a href="{{ "accounts/create.html" | relative_url }}"
title="Create a Globus Account">create a Globus account</a> by signing in to
Globus for the first time. If you have accounts at multiple institutions, you
should also <a href="{{ "accounts.html" | relative_url }}" title="About Globus
Accounts">learn about how Globus accounts work</a>, and how to
<a href="{{ "accounts/link.html" | relative_url }}" title="Link Identities">link
identies together</a>.</p>
<p>(Here is a side challenge: If you have already registered for <a
href="https://library.stanford.edu/myorcid" title ="Stanford Libraries: My
ORCID">your ORCID iD</a>, try linking it to your Stanford Globus identity!)</p>
<p>Now that you have your Globus account, you need to access either the
collection or the endpoint which has the data you want.
Every endpoint and collection can be identified either by name, or by unique
ID. You can search for both on the <a href="https://app.globus.org/endpoints"
title="Endpoints">Endpoints search page</a>. Be careful when searching by
name, because names are not guaranteed to be unique.
<p>If the source or destination is a server, ask the server administrator for a
link to the appropriate collection. (For example, see <a
href="https://login.scg.stanford.edu/tutorials/data_movement/#globus"
title="Moving Data to/from SCG: Globus">SCG</a> and <a
href="https://www.sherlock.stanford.edu/docs/storage/data-transfer/#globus"
title="Storage on Sherlock: Data Transfer: Globus">Sherlock</a>.)
If you are the server administrator, you can install <a
href="https://docs.globus.org/globus-connect-server/" title="Globus Connect
Server">Globus Connect Server</a> to make your data available.</p>
<p>If the Cloud is one end (or both ends) of the transfer, Stanford supports
using Globus with a number of cloud providers! <a
href="{{ "cloud.html" | relative_url }}" title="Globus and the Cloud">See the
list of supported cloud services</a>.</p>
<p>If you want to transfer to or from an endpoint (a laptop or desktop), you
can install <a href="{{ "client.html" | relative_url }}" title="Globus Connect
Personal">Globus Connect Personal</a>, giving you access to your endpoint's
storage via Globus. Globus Connect Personal is smart enough to pause transfers
when you laptop goes to sleep, and is able to cope with unstable network
connections.</p>
<p>Once you have identified both ends of your transfer, you can move data! The
<a href="https://docs.globus.org/how-to/get-started/#the_file_manager"
title="How To Log In and Transfer Files with Globus">Globus instructions</a>
are very helpful here.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="z1"
scenario="How do I get started?"
content=z1
%}
<!-- Next item is z2 -->
<p> </p>
<h2><a name="accounts">Accounts and Globus ID</a></h3>
{% capture a1 %}
<p>Creating a Globus account is easy! If you have never used Globus before,
just go to <a href="{{ "accounts/create.html" | relative_url }}" title="Create
a Globus Account">Create a Globus Account</a> and follow the instructions
there.</p><p>If you have used Globus before (for example, at another
institution), then you should first log in to Globus using that institution's
credentials, and <a href="{{ "accounts/link.html" | relative_url }}"
title="Link Identities">link your Stanford identity</a>.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="a1"
scenario="How do I get access to Globus?"
content=a1
%}
{% capture a2 %}
<p>Although Globus recognizes that a person can have logins at multiple
institutions, Globus only allows one email address per person per instutition.
If you have an email address at another institution, you can <a href="{{
"accounts/link.html" | relative_url }}" title="Link Identities">Link
Identities</a>. As for your Stanford identity, whichever email address is your
primary email address is what Globus will see.</p>
<p>See also <em>How do I change my email address in Globus?</em>.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="a2"
scenario="How do I add a new email address to Globus?"
content=a2
%}
{% capture a3 %}
<p>If you change your Stanford email address (in <a
href="https://accounts.stanford.edu" title="Stanford Accounts">Accounts</a>
or <a href="https://stanfordyou.stanford.edu">StanfordYou</a>),
Globus will get the new email address a few days after the change, once you log
back in to the Globus web site.</p>
<p><em>NOTE:</em> Within Globus, people can be discovered by their identity
(which, for Stanford, is always <em>[email protected]</em>) or by their
email address. So, even if you change your email address to something else,
you will still be discoverable in Globus by your SUNetID.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="a3"
scenario="How do I change my email address in Globus?"
content=a3
%}
{% capture a4 %}
<p><em>Globus ID</em> is a form of identity—similar to your Stanford identity,
but for entities (like labs and departments) and for users who can not get an
identity through other means. At Stanford, a Globus ID is only needed when you
want to run a Globus Connect Server, because Globus Connect Server instances
can only be owned by entities (like your group), not by people. Globus IDs are
also used at Stanford by developers, so that their Globus-using applications
are not tied to individuals.</p>
<p>Getting a Globus ID for Globus Connect Server use is covered in the <a
href="{{ "accounts.html" | relative_url }}" title="Globus Accounts">Globus
Accounts</a> section, on the <a href="{{ "accounts/globusid.html" |
relative_url }}" title="Globus ID">Globus ID</a> page.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="a4"
scenario="How do I get a Globus ID? Do I even need one?"
content=a4
%}
<!-- Next item is a5 -->
<p> </p>
<h2><a name="web">The Globus Web Site</a></h2>
{% capture w1 %}
<p>There are several ways to refer to an endpoint: By short name, by full name,
or by UUID. You can look up an endpoint on the Globus web site using each of
these identifiers.</p>
<ul> <li>You may have been given an <em>endpoint UUID</em>. For example,
<code>db57ddde-6d04-11e5-ba46-22000b92c6ec</code> is the UUID (unique ID) of
the ESnet test endpoint in Sunnyvale. With this unique ID, you can construct
bookmarkable URLs. For example, if you take the following template…<br />
<pre>https://www.globus.org/app/transfer?destination_id=UUID</pre>
… and replace <code>UUID</code> with the unique ID of the endpoint, you will
have a URL that takes you directly to the transfer screen, with that endpoint
filled in.</li>
<li>Your contact may have given you a <em>short name</em> (like
<code>srcc#oak</code>), or a full name (like <em>Stanford SRCC Oak</em>). In
both cases, you can go to the
<a href="https://www.globus.org/app/endpoints?scope=all" title="Globus
Endpoints Search">endpoints search page</a>. Paste in the name you were given,
and the endpoint should appear in the results.</li>
<li>If the endpoint is a shared endpoint, your contact may have given you
explicit access to the endpoint. In that case, the endpoint will appear in the
<a href="https://www.globus.org/app/endpoints?scope=shared-with-me"
title="Globus Endpoints shared with me">endpoints shared with me</a> list.</li>
</ul>
<p>Once you have located an endpoint, and you click on its name, if you check
the URL of the page you are on, it will look like this…<br />
<pre>https://www.globus.org/app/endpoints/db57ddde-6d04-11e5-ba46-22000b92c6ec/overview</pre>
In the above URL, <code>db57ddde-6d04-11e5-ba46-22000b92c6ec</code> is the
endpoint's unique ID. You should make a note of it, as that unique ID will
not change (unless the endpoint is deleted).</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="w1"
scenario="Someone gave me access to a Globus endpoint. How do I access it?"
content=w1
%}
{% capture w2 %}
<p>If you are getting a <em>permission denied</em> error when trying to login
to the endpoint, then you should check which credentials you are using. For
example, endpoints normally only accept logins through their institution. So,
if you have accounts at Stanford and UC Santa Cruz, your UC
credentials will not let you in to a Stanford endpoint.</p>
<p>(If you have multiple logins to Globus, you might be logged in with the
wrong one. You should <a href="{{
"accounts/link.html" | relative_url }}" title="Link Identities">Link
Identities</a> to keep that from happening again.)
<p>If your credentials are being accepted; but you are getting <em>permission
denied</em> when you try to do a directory listing, or when you are trying to
transfer data <em>from</em> the endpoint, then the endpoint's configuration is
not allowing access to that directory. For Globus Connect Server and shared
endpoints, you need to reach out to the endpoint administrator. For Globus
Connect Personal endpoints, you need to make sure you have configured access to
the directory. See the Globus Connect Personal <a href="{{
"client/install.html" | relative_url }}" title="Globus Connect Personal
Installation">installation instructions</a> (specifically, the <em>Add Allowed
Paths</em> section).</p>
<p>If you get <em>permission denied</em> errors when transferring data
<em>to</em> an endpoint, then you probably only have read-only access to the
directory. You either need to talk to the endpoint administrator (for Shared
endpoints and Globus Connect Server endpoints), or check your endpoint
configuration (for Globus Connect Personal endpoints).</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="w2"
scenario="I am getting <em>Permission Denied</em> errors when I try accessing an endpoint. How do I get access?"
content=w2
%}
{% capture w5 %}
<p>Shared endpoints do not exist on their own. They require a <em>host
endpoint</em>, which is either a Globus Connect Personal endpoint or a Globus
Connect Server endpoint.</p>
<p>If the host endpoint is a Globus Connect Personal endpoint, then you (the
owner of that endpoint) must have access to Globus Plus, which is an optional
Globus feature that is included in Stanford's campus subscription. <a
href="{{ "client/plus.html" | relative_url }}" title="Globus Connect
Personal: Globus Plus">Read more about Globus Plus</a>.</p>
<p>If your host endpoint is a Globus Connect Server endpoint,
the endpoint administrator may have disabled sharing. Or, the endpoint might
not be a <em>managed endpoint</em> (which requires access to the Stanford
campus Globus subscription). In the latter case, the endpoint administrator
should read our guides for Globus Connect Server, specifically the pages on
<a href="{{ "server/pre-install.html" | relative_url }}">Pre-Installation Planning</a> and <a href="{{ "server/finish.html" | relative_url
}}">Finishing Installation</a>.</p>
<p>The other possible reason is, sharing might not be allowed for the directory
you are trying to share. For Globus Connect Personal-hosted endpoints, you must
explicitly give Globus Connect Personal access to the directory you wish to
share (or to a parent directory), <em>and sharing must be explicitly
enabled</em>. For Globus Connect Server-hosted endpoints, the default
configuration is to allow sharing for any directory users can access, but this
can be changed by the Globus Connect Server administrator.</p>
<p>So, if the host endpoint is running Globus Connect Personal, you need to
make sure that you have Globus Plus, and that sharing is explicitly enabled.
And if your host endpoint is running Globus Connect Server, you need to talk
to the administrator of your host endpoint.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="w5"
scenario="I am getting <em>Permission Denied</em> errors when I try making a shared endpoint. How do I fix this?"
content=w5
%}
{% capture w3 %}
<p>Transfers between endpoints can be paused by endpoint administrators. If
you got an email saying your transfer has been paused—and you didn't pause the
transfer yourself—then an endpoint administrator (at one or both ends) has
either paused your specific transfer, or has paused all transfers to/from their
endpoint.</p>
<p>Transfers are often paused when endpoint maintenance is taking place. This
is an alternative to simply letting connections fail (for example, during an
endpoint restart).</p>
<p>Once the pause is lifted, your transfer will resume. If that does not
happen, you should reach out to the administrator of the endpoint who paused
your transfer.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="w3"
scenario="I got an email saying my transfer has been paused. How do I restart it?"
content=w3
%}
{% capture w4 %}
<p>In order to transfer files, Globus needs your credentials at both ends of
the transfer. Giving Globus these credentials is called <em>activating an
endpoint</em>.</p>
<p>For Globus Connect Personal endpoints, and for shared endpoints, activation
is permanent; as long as you have access to the endpoint, no additional
credentials are required. Globus Connect Server activations are
time-limited. If your transfer involves a Globus Connect Server endpoint, and
the activation expires during a transfer, your transfer will be paused and you
will get this email.</p>
<p>To solve this problem, <a
href="https://www.globus.org/app/endpoints?scope=in-use" title="Globus In-Use
Endpoints">view your in-use endpoints</a>, and look for any with expired
credentials. For each endpoint with expired credentials, click on the endpoint
to reactivate it. Once reactivated, your transfer will automatically
resume.</p>
<p>Transfers already started will continue to attempt to run for up to a day
before being terminated.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="w4"
scenario="I got an email saying my credentials have expired. How do I fix it?"
content=w4
%}
<!-- Next item is w6 -->
<p> </p>
<h2><a name="client">The Globus Client (better known as Globus Connect
Personal), and Globus Plus</a></h2>
{% capture c1 %}
<p><em>Globus Connect Personal</em> (the proper name for the Globus client
software) is how you can use Globus to transfer files to/from your
laptop/desktop. The software runs on your system in the background, and gives
you access to transfer files between your system and other Globus
endpoints.</p>
<p>Read more about <a href="{{ "client.html" | relative_url }}"
title="Globus Connect Personal">Globus Connect Personal </a>.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="c1"
scenario="Someone told me that I need the Globus client. What even is it? How do I get it?"
content=c1
%}
{% capture c8 %}
<p>There is no ready-made, pre-approved solution for using Globus with High
Risk data. Stanford does not have a BAA with Globus or the University of
Chicago, and
Stanford's use of Globus has not undergone a
<a href="https://uit.stanford.edu/security/dra"
title="How to Request and Complete a Data Risk Assessment, Information Security,
Stanford University IT">Data Risk Assessment</a>.</p>
<p>Your best route forward may be to get your data into a form that is Low or
Moderate Risk, and onto systems that are also Low or Moderate Risk, and install
Globus Connect Personal (or Globus Connect Server) there. You should reach out
to your IT people to assist, or <a href="mailto:[email protected]"
title="Contact SRCC">engage with us</a>.</p>
<p>If you are set on using Globus with High Risk data, or on a system that is
exposed to High Risk data, you should expect to
bear substantial costs in both money and time. <a
href="mailto:[email protected]" title="Contact SRCC">Reach out</a> if
you are still interested!</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="c8"
scenario="My laptop or desktop handles High Risk (including PCI / PHI) data. Can I use Globus on it?"
content=c8
%}
{% capture c5 %}
<p>No, but if you firewall outbound connection, then some ports will need to be
opened. Globus Connect Personal does not need to accept connections from the
outside, except in some cases when performing a transfer between two Globus
Connect Personal endpoints.</p>
<p>Read more in <a href="{{ "client/install.html" | relative_url }}"
title="Installing Globus Connect Personal">the installation instructions</a>.</p>
<p>If you are unable to get your firewall changed, then your last-resort
option is to use the <a href="https://uit.stanford.edu/service/vpn"
title="Stanford University IT VPN Service">Stanford VPN</a>, but you
must use <em>Full Traffic (non-split-tunnel)</em> mode, which sends all
traffic (even non-Stanford traffic) through the VPN.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="c5"
scenario="Do I need to open ports for Globus Connect Personal to work?"
content=c5
%}
{% capture c2 %}
<p>Globus Connect Personal already works to transfer data as quickly as
possible, without making your Internet connection unusable. That being said,
there are a few things you can do to help make things go faster.</p>
<ul>
<li>Leave your laptop plugged in. Laptops will agressively power-save when it
detects that you aren't using it. Plugging in your laptop typically reduces
the level of power-saving.</li>
<li>Use a wired connection. With a wireless network, your traffic has to
contend with all of the other laptops, phones, and other devices in the local
area, along with other miscellaneous forms of interference (such as
walls and microwaves). Using a wired connections removes these forms of
interference.</li>
<li>Have good upstream bandwidth. For example, let's say your desktop is
connected to a small Belkin Gigabit switch, shared with five other lab
members, with one Ethernet cable to the wall. In that case, you are sharing
a single Gigabit connection. Ideally, your desktop should be plugged directly
into a network port on the wall, which goes back to a building switch, which
then has at least a 10 Gbps link back to the core network. If you are in a
residence that does not have ports on the wall (for example, because you have a
cable modem), you should plug in the router.</li>
</ul>
<p>If you routinely need to perform large (multi-TB) data transfers, you should
consider taking advantage of the <a
href="https://srcc.stanford.edu/stanford-research-network-srn" title="Stanford
Research Network">Stanford Research Network</a>.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="c2"
scenario="I am transferring data to/from my laptop/desktop. How do I make my transfer go faster?"
content=c2
%}
{% capture c4 %}
<p><em>relay.globusonline.org</em> is the link between Globus Connect Personal
and Globus. All transfer operations—except for the actual data being
transferred—goes through this connection.</p>
<p>Globus Connect Personal must be able to make outbound connections to
relay.globusonline.org on TCP port 2223. If that is blocked, then you will not
be able to perform directory listings or start new transfers, and existing
transfers will stop working. To fix this, you will need to reach out to your
IT person. For undergrads, that is your RCC; for grads, go to the <a
href="https://library.stanford.edu/contacts/tech-desk" title="Lathrop Tech
Desk">Lathrop Tech Desk</a>; for everyone else, go to your <a
href="https://web.stanford.edu/group/networking/dist/sunet.reports/LNA.html"
title="Local Network Administrators by Department">LNA</a>.</p>
<p>If you are unable to get your firewall changed, then your last-resort
option is to use the <a href="https://uit.stanford.edu/service/vpn"
title="Stanford University IT VPN Service">Stanford VPN</a>, but
you must use <em>Full Traffic (non-split-tunnel)</em> mode, which sends all
traffic (even non-Stanford traffic) through the VPN.</p>
<p>Transfers already started will continue to attempt to run for up to a day
before being terminated.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="c4"
scenario="I am getting errors connecting to relay.globusonline.org. How do I fix this?"
content=c4
%}
{% capture c3 %}
<p>First, try transferring a file from the <a
href="https://www.globus.org/app/transfer?destination_id=db57ddde-6d04-11e5-ba46-22000b92c6ec&destination_path=%2Fdata1%2F"
title="Globus Transfer from ESNet Sunnyvale">ESNet Sunnyvale test endpoint</a>
to your system. If the transfer is successful, then your system is probably
OK.</p>
<p>If ESnet transfers are also reporting 'connection failed', then the most
likely problem is a network-level block. Globus Connect Personal needs to be
able to make outbound connections to TCP ports 50000 through 51000. If that is
blocked, then you will be able to start transfers, but they will not run. In
that case, you need to check with your IT person. For undergrads, that is your
RCC; for grads, go to the <a
href="https://library.stanford.edu/contacts/tech-desk" title="Lathrop Tech
Desk">Lathrop Tech Desk</a>; for everyone else, go to your <a
href="https://web.stanford.edu/group/networking/dist/sunet.reports/LNA.html"
title="Local Network Administrators by Department">LNA</a>.</p>
<p>If you are unable to get your firewall changed, then your last-resort
option is to use the <a href="https://uit.stanford.edu/service/vpn"
title="Stanford University IT VPN Service">Stanford VPN</a>, but
you must use <em>Full Traffic (non-split-tunnel)</em> mode, which sends all
traffic (even non-Stanford traffic) through the VPN.</p>
<p>Your transfer will continue to attempt to run for up to a day before being
terminated.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="c3"
scenario="All of my transfers are saying 'connection failed'. How do I fix this?"
content=c3
%}
{% capture c6 %}
<p>When you transfer files between a Globus Connect Personal endpoint and a
Globus Connect Server endpoint, regardless of the direction of the transfer,
the Globus Connect Personal endpoint is always the one that opens the
connection (so that all connections are outbound from your endpoint). This is
done because Globus Connect Server administrators make sure that inbound
connections are allowed.</p>
<p>When both ends of a transfer are running Globus Connect Personal, one end
has to allow an incoming connection, and that is not always possible. For
example, if one laptop is on a home network (behind a router), and another
laptop is on a different home network (behind a different router), the two
routers will block inbound connections.</p>
<p>In a case like this, both ends of the connection should be brought onto a
common network, in order for the data transfer to succeed. One way of doing
this is by putting both endpoints onto the
<a href="https://uit.stanford.edu/service/vpn"
title="Stanford University IT VPN Service">Stanford VPN</a>. If that still
does not work, try using the <em>Full Traffic (non-split-tunnel) mode</em>,
which routes all network traffic through the VPN.
{% endcapture %}
{% include panel.html
parent="scenario"
id="c6"
scenario="I am having problems transferring files between two Globus Connect Personal endpoints. How do I fix this?"
content=c6
%}
{% capture c7 %}
<p>If you have a full-service (or full-sponsored) SUNetID (in other words, if
you have Stanford email service), you can have the <em>Globus Plus</em> feature
enabled on your account. If you already have a Globus Connect Personal
endpoint, Globus Plus allows you to share part of it with others.</p>
<p><a href="{{ "client/plus.html" | relative_url }}"
title="Globus Plus">Read about Globus Plus</a>.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="c7"
scenario="How do I allow sharing?"
content=c7
%}
<!-- Next item is c9 -->
<p> </p>
<h2><a name="server">The Globus Server (better known as Globus Connect
Server)</a></h2>
{% capture s1 %}
<p>You will need to <a href="{{ "server.html" | relative_url }}" title="Globus Connect
Server">install Globus Connect Server</a> onto a system that has access to the
data your users wish to share. As you follow the process, make sure to watch
out for sections that talk about enabling sharing. In the end, you will have
an endpoint name, or a UUID.</p>
<p>Once your users have the endpoint information, they should go to the <a
href="https://www.globus.org/app/transfer" title="Globus Transfer Files">Globus
Transfer Files</a> page, where they can search for your endpoint, activate it
(by authenticating), and transfer files.</p>
<p>See also the question <em>Someone gave me access to a Globus endpoint.
How do I access it?</em>.</p>
<p>If your users want to transfer files to/from another environment (like, for
example, another lab's storage), then that other environment will also need
Globus Connect Server; you should direct the lab's IT person to this question.
Once a Globus Connect Server is up and running there, your users will need that
server's information (a name, a UUID, etc., just like with your endpoint).</p>
<p>If your users want to transfer files to/from their own systems (a laptop or a
desktop), they will need Globus Connect Personal. You should point your users
to this page, and the question <em>Someone told me that I need the Globus
client. What even is it? How do I get it?</em>.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s1"
scenario="I want my users to be able to transfer files using Globus. How do I do this?"
content=s1
%}
{% capture s21 %}
<p>This can be done, but it has to be done in two steps:</p>
<ol>
<li>First, <a href="{{ "server.html" | relative_url }}" title="Globus Connect
Server">install Globus Connect Server</a> onto a system that has access to the
data your users wish to share. As you follow the process, make sure to watch
out for sections that talk about enabling sharing. In the end, you will have
an endpoint URL. It will look something like this:<br />
<pre>https://www.globus.org/app/endpoints/96a13ae8-1fb5-11e7-bc36-22000b9a448b/overview</pre>
Give that URL to your users.</li>
<li>Next, each user who wishes to share must access the endpoint using the URL
provided (or, see the question <em>Someone gave me access to a Globus endpoint.
How do I access it?</em> for alternative ways of discovering your endpoint).
The endpoint's web page will have a <em>My Shares</em> tab; where users can
authenticate, create a share, and give others access (read-only or read-write)
to the share.</li>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s21"
scenario="I want my users to be able to share files with others (who do not have local accounts). How do I do this?"
content=s21
%}
{% capture s8 %}
<p>Globus Connect Server works fine with storage that is accessed via NFS.
With NFSv3, no changes are needed. With NFSv4, you will need to use
<code>sec=sys</code>. The Kerberos security model does not work
with Globus, because Globus has no way of getting Kerberos credentials for
users.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s8"
scenario="How can I use Globus Connect Server with NFS?"
content=s8
%}
{% capture s11 %}
<p>To meet the requirements for Moderate Risk data, simply follow the normal
installation instructions on the <a href="{{ "server.html" | relative_url }}">
Globus Connect Server</a> pages, but <em>be sure to use SUNetID Auth with
CILogon</em>. Other than that, the installation instructions will mention the
settings which need to be in place for Moderate Risk environments.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s11"
scenario="How do I use Globus for Moderate Risk data?"
content=s11
%}
{% capture s12 %}
<p>There is no ready-made, pre-approved solution for using Globus with High
Risk data. Stanford does not have a BAA with Globus or the University of
Chicago, and
Stanford's use of Globus has not undergone a
<a href="https://uit.stanford.edu/security/dra"
title="How to Request and Complete a Data Risk Assessment, Information Security,
Stanford University IT">Data Risk Assessment</a>.</p>
<p>Your best route forward may be to get your data into a form that is Low or
Moderate Risk, and onto systems that are also Low or Moderate Risk, and
do your transfers from there. You should reach out to your IT people to
assist, or <a href="mailto:[email protected]" title="Contact SRCC">
engage with us</a>.</p>
<p>If you are set on using Globus with High Risk data, you should expect to
bear substantial costs in both money and time. <a
href="mailto:[email protected]" title="Contact SRCC">Reach out</a> if
you are still interested!</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s12"
scenario="How do I use Globus for High Risk (including PCI / PHI) data?"
content=s12
%}
{% capture s2 %}
<p>Beyond the documentation on the <a href="{{ "server/pre-install.html" | relative_url }}" title="Globus Connect Server Pre-Installation Planning">Pre-Installation Planning</a> page, there is a simple checklist for determining which authentication method to use:</p>
<ol>
<li>In your environment, are your users using SUNetIDs as usernames? Then use
CILogon.</li>
<li>If your data are Moderate Risk, and your users are <em>not</em> using
SUNetIDs as usernames, then you will need to set up some form of username
mapping—or change everyone's usernames—and then use CILogon.</li>
<li>If your data are Low Risk, and your users are not using SUNetIDs as
usernames, then you can set up MyProxy OAuth authentication.</li>
<li>If you get pushback about opening a web server to the world (which is
required for MyProxy OAuth authentication), and you trust Globus enough to
handle your user's credentials, then use legacy MyProxy.</li>
</ol>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s2"
scenario="How do I know which authentication method to use?"
content=s2
%}
{% capture s3 %}
<p>In general, if you follow <a
href="https://uit.stanford.edu/guide/securitystandards" title="Stanford Minimum
Security Standards">MinSec</a>, using MyProxy OAuth is more secure than using
legacy MyProxy. It all has to do with where your password goes.</p>
<p>With legacy MyProxy, your username and password are sent to Globus, which
passes it on to the MyProxy service running on your endpoint. Although each
connection (from you to Globus, and from Globus to MyProxy) uses TLS, it still
means that your username and password are being held (albeit temporarily) by a
third-party (Globus).</p>
<p>With MyProxy OAuth, your username and password are sent directly to the
OAuth server running on your endpoint. Globus then receives a client cert, the
same as if you were authenticating using CILogon.</p>
<p>Although MyProxy OAuth does require that you have a web server (HTTPS only)
open to the world, as long as you follow proper installation and patching
procedures, you should remain reasonably secure.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s3"
scenario="How is MyProxy OAuth better than legacy MyProxy if they both use MyProxy?"
content=s3
%}
{% capture s4 %}
<p>Right now, it is not possible to handle Moderate Risk data in Globus without
using CILogon. The reason is, <a
href="https://uit.stanford.edu/guide/securitystandards#security-standards-applications"
title="Stanford Minimum Security Standards for Applications">MinSec for
Applications</a> for Moderate Risk applications requires that Duo two-step
authentication be used for all interactive user logins, and many end-user
Globus activities are interactive.</p>
<p>Unfortunately, none of the MyProxy-based authentication methods (legacy
MyProxy or MyProxy OAuth) support any form of multi-factor authentication, due
to the limitations of the MyProxy protocol.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s4"
scenario="How can I handle Moderate Risk data without using CILogon?"
content=s4
%}
{% capture s5 %}
<p>Not easily, no. At least, not without a sizeable amount of effort.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s5"
scenario="Can I use CILogon without using SUNetIDs?"
content=s5
%}
{% capture s6 %}
<p>OK, yes, it <em>is</em> possible, but it will either require constant
maintenance and setup work, or will require software development.</p>
<p>When using CILogon, Globus uses client certs to authenticate to GridFTP as a
person. That client cert includes a <em>Distinguished Name</em> (or
<em>DN</em>) to identify the user, as well as an
<em>eduPersonPrincipalName</em> (or <em>EPPN</em>) attribute that contains the
user's "scoped username" (that is, their username in the context of the
institution), which for Stanford is always <code>[email protected]</code>.
<p>For example, to see your CILogon distinguished name, go to <a
href="https://cilogon.org" title="CILogon">CILogon</a> and log in with your
Stanford University credentials. The "Certificate Subject" is your DN.</p>
<p>The first way to convert a client cert into a username is to use a
<em>gridmap file</em>. This is a mapping from DN to local username, and is
described in <a
href="http://toolkit.globus.org/toolkit/docs/latest-stable/gsic/admin/index.html#_configuring_identity_mappings_using_literal_gridmap_literal_files_files"
title="Grid Security documentation, Section 5.1, Configuring Identity using
Gridmap files">Grid Security documentation Section 5.1</a>. You will need to
have each user go to CILogon, get their DN, and send it to you for inclusion in
the gridmap file.</p>
<p>The second way is to write a <em>callout</em>. This is a shared library
containing code that takes in various parameters (like a client cert) and
returns a local username. The file format and calling convention is documented
in <a
href="http://toolkit.globus.org/toolkit/docs/latest-stable/gsic/admin/index.html#_configuring_alternate_credential_mappings"
title="Grid Security documentation, Section 5.2, Configuring Alternative
Credential Mappings">Grid Security documentation Section 5.2</a> and is also
explained on <a href="http://www.cilogon.org/gsi-c-authz#TOC-Gridmap-Callouts"
title="GSI Gridmap Callouts">CILogon's site</a>. You can see the code for
Globus' EPPN callout <a
href="https://github.com/globus/globus-toolkit/tree/globus_6_branch/gsi/gridmap_eppn_callout">on
GitHub</a>.</p>
<p>Unfortunately, due to the complexity involved in this process, must Stanford-based support groups are unable to provide free support for custom gridmaps. Your first call for support should be the <a href="https://groups.google.com/a/globus.org/forum/#!forum/developer-discuss" title="Globus Developer Discuss forum">Globus "Developer Discuss" forum</a> on Google Groups, which you can join using your Stanford Google account.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s6"
scenario="Can I <em>really</em> not use CILogon without SUNetIDs?"
content=s6
%}
{% capture s7 %}
<p>Happily, in this scenario, nothing else needs to be done! That is because,
with CILogon, the authentication and authorization functions are separate.</p>
<p>With CILogon, authentication is handled by <a
href="https://uit.stanford.edu/service/saml" title="Stanford UIT SAML
(Authentication)">Stanford SAML</a>. Globus passes the results of this
successful authentication on to your endpoint, which extracts the SUNetID and
looks for a matching user. So, no local authentication (password or otherwise)
is needed.</p>
<p>It is important to note, CILogon only handles authentication. The
authorization function (which determines what the user can access) is still
handled by the operating system.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s7"
scenario="My users coincidentally use SUNetIDs already, but not for passwords. How can I use CILogon?"
content=s7
%}
{% capture s9 %}
<p>Globus Connect Server works even when users are not able to log in directly.
The server just needs to be able to identify users, and rely on the OS'
authorization mechanisms to verify permissions.</p>
<p>See also the question <em>How do I allow sharing when my users don't have
home directories?</em></p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s9"
scenario="How can I run Globus Connect Server on a server where users cannot log in?"
content=s9
%}
{% capture s10 %}
<p>Files uploaded to a Globus Connect Server endpoint are owned by the user
who activated the endpoint. Files uploaded to a shared endpoint are owned by
the user who created the shared endpoint. The file's group will be set to the
owning user's primary group.</p>
<p>File permissions are set based on the GridFTP server's umask, and its
default permissions. GridFTP's default permissions are <code>644</code>
(read/write for owner; read-only for everyone else). To change GridFTP's
default permissions, edit <code>/etc/gridftp.conf</code>, adding the following
line:
<pre>
perms 664
</pre>
<p>(Change <code>664</code> to whatever value is appropriate for your
situation.)</p>
<p>GridFTP's umask is set by your system's service-management software
(normally either SysV init, or systemd). It is normally set to
<code>022</code>. This umask means group and world write access will always
be disabled, regardless of the permissions you set.</p>
<p>If you want to change the umask, you will have to modify the
<code>/etc/init.d/globus-gridftp-server</code> script in two ways:</p>
<ol>
<li>First, look for this block of code in the script…<br />
<pre>
lsb=""
if [ -f /lib/lsb/init-functions ]; then
lsb=_lsb
lsb_ok=1
. /lib/lsb/init-functions
if [ -f /etc/redhat-release ] && lsb_release -v | grep -q 'core-[123]'; then
unset lsb_ok
fi
fi
</pre>
In that block, change the string <code>lsb=_lsb</code> to <code>lsb=""</code>.
This is needed to stop LSB-specific startup scripts from running, as they will
override the umask in all cases.</li>
<li>Next, in the <code>start()</code> block, locate this line:<br />
<pre>
$gridftpd -S -c $conf -C $confdir -pidfile "${pidfile}"
</pre>
Immediately before that line, add a new line, where you set the umask to be
what you want.</li>
</ol>
<p>This work is required because GridFTP does not have a built-in way to change
its umask. Once the changes are made, restart GridFTP, and test.</p>
{% endcapture %}
{% include panel.html
parent="scenario"
id="s10"
scenario="How do I control permissions for uploaded files?"
content=s10
%}
{% capture s13 %}
<p>When the 'encrypt transfer' box is checked, at the start of a transfer,