1. Home
  2. Research Computing
  3. Globus (data transfer service)

Globus (data transfer service)

Globus is a web-based data management tool that enables researchers to easily share and receive large data sets with collaborators from other institutions.

Globus has been configured to work with data stored on Netfiles shares, VACC accounts, and Microsoft OneDrive – allowing UVM researchers to easily share and receive enormous data transfers using existing research storage solutions.

Note

Globus is intended to be used for large (multiple terabytes in size) research data transfers to and from services like Netfiles and the VACC. Globus is NOT a replacement for the UVM File Transfer service.

The following Globus collections are available for use – these can be used to transfer data to and from other collections you have access to. The UVM Netfiles collection can also be used to create guest collections, allowing you to share data with external collaborators:

UVM Globus Collections UVM OneDrive UVM Netfiles UVM VACC
Share w/ any collection you are a member of
Guest Collections (share w/ external collaborators)

Getting Started

Login to Globus

  1. Navigate to https://app.globus.org.
  2. Click the Look up your Organization drop down and type in “University of Vermont”. Select the “University of Vermont” option in the drop down menu and then click Continue.
  3. If you’re not already logged in to any UVM services you will be brought to a familiar UVM SSO login page. Enter your NetID and password to sign in.
  4. The first time you log into Globus you will see a prompt like the one below. If you have used Globus previously with another institution, click the Link To An Existing Account button and follow the prompts given. If you have not used Globus previously, click Continue.
  5. After successfully logging into Globus you will be brought to the File Manager tab. If you’d like to learn more about Globus, please read through our detailed overview of the Globus interface, and steps for transferring data between UVM services and external collaborators.

Overview of the Interface

After logging into Globus, you will automatically be brought to the File Manager tab.

  1. File Manager – This tab is used for transferring and uploading files to endpoints. For more information on how to use this function, consult the Sharing and Data Transfers section in this article.
  2. Bookmarks – Globus allows you to bookmark commonly used endpoints. Instructions on how to bookmark an endpoint can be found in this tab.
  3. Activity – Monitor transfers or uploads that are currently in progress. Transfers can also be paused and continued in this menu.
  4. Endpoints – This tab is for managing endpoints (collections) that are owned by you. Edit endpoint attributes, add/edit metadata, or view active endpoints in this tab.
  5. Groups – This tab allows you to create and manage groups for endpoint access.
  6. Console – This is for administrators of endpoints to view endpoint activity.
  7. Flows – Flows allow users to automate a series of transfers. This feature is in beta and is not advised for use by UVM at this time.
  8. Account – This tab is for managing account identities and consents. For more information on adding an existing identity to your account, consult the Managing Globus Identities section of this article.

Sharing & Data Transfers

Transferring Data

These steps assume that you are transferring data between UVM services you have access/permissions to. If you’d like to make data available to other UVM affiliates, or external collaborators, please see the Sharing Data with External Collaborators steps below.

Data is accessed via Globus “collections,” sometimes referred to as endpoints. UVM currently has manged collections for Netfiles, VACC, and OneDrive. This example will focus on transferring data between UVM collections, but the same process applies to external collections you may have access to.

The following UVM collections are searchable from the “File Manager” sidebar menu:

  • UVM Netfiles
  • UVM VACC
  • UVM OneDrive

To transfer data between folders and shares that you have access to, use the following steps. This assumes you have logged into https://app.globus.org and are viewing the File Transfer tab.

  1. Select the collection that you wish to transfer files from. In this example, the file being transferred is located in the UVM Netfiles collection.
  2. Select the collection that you wish to transfer the file to. In this example the destination is the UVM OneDrive collection.
  3. Check the box next to the file(s) you wish to transfer.
  4. Click the Start button under your source. This will initiate a transfer. You can view the status of that transfer in the activity tab.

Sharing Data with Collaborators

Sharing data with collaborators requires granting access rights in the form of a “guest collection”. The creation of guest collections is currently only available on the UVM Netfiles & UVM VACC collections.

Note: VACC Users

You can only access and create guest collections on folders you own on the VACC.  To access folders authorized through group ownership, have the PI create a guest collection on the folder and grant access to Globus through guest collection permissions as detailed in the following section.

Select File Manager from the sidebar menu.

  1. Navigate to your share in the UVM Netfiles or UVM VACC collections.
  1. Check the box next to the folder you want to share.
  2. Click Share. This will open up the dialogue to create a new collection (endpoint) on the Netfiles collection.

  1. Click Add a Guest Collection.
  2. Fill in the information about your share that will make it easier for users to find your collection. When you are done, click Create Collection.
  3. Your collection has been created but only you have access to it. To grant access to other users, click Add Permissions – Share With.
  4. Permissions can be managed on a folder basis within your collection. For example, if you wanted a user to have access to only some of the data stored in your collection, you could put the data in a folder and give that user access only to that folder. The path is relative to the folder you shared, NOT to the UVM Netfiles collection.
    1. Select the path of the folder you want to manage permissions for, or leave it as the default “/” if you want to manage permissions for the whole collection.
    2. Select how you want to grant access (single users, group, all users, public). Groups can be created and managed in the groups tab on the left hand bar.
      Warning

      Allowing access to all Globus users or the general public will allow anyone to view your data and should only be used in circumstances where data has to be made public. DO NOT select the write option if you intend to make your share public.

    3. Enter usernames or select the group that you want to have access to the share. Users will be searchable if they’ve logged into app.globus.org before – if a user you’d like to give permission to is not appearing in search results, ask them to log in to Globus first.
    4. Click Add Permission. The selected users or groups will now have access to your share.

Note

Users will not be able to navigate to your share from the UVM Netfiles endpoint. They will have to search for your guest collection by the display name you assigned it.

Accessing Data as a Collaborator – Globus Transfer

These steps assume that you are transferring data between a UVM Globus guest collection and a Globus collection that your organization already has set up. If your organization does not use Globus, or you’d like to transfer data between a UVM collection and a local location (i.e. your computer), see the below section Accessing Data as a Collaborator – Web Interface / Globus Connect.

As an external collaborator with UVM, you can transfer data between guest collections shared by UVM affiliates and Globus collections of your own using the Globus web interface.

  1. Navigate to https://app.globus.org.
  2. Click the Look up your Organization drop down and type in the name of your organization. Select the option corresponding to your organization in the drop down menu and then click Continue.
  3. Log into Globus using whatever organization-specific login interface is provided.
  4. Select File Manager from the sidebar menu.
  5. Click the Search button and search the name of the guest collection that has been shared with you.
  6. Click on the name of the share to open it.
  7. Select Transfer or Sync to… from the right sidebar menu.
  8. Click the Search button on the newly-opened right panel collection view.
  9. Search for the collection that you’d like to sync data from the guest collection to, and click on the name of it to select it
  10. Check the box next to the file(s) you wish to transfer.
  11. Click the Start button under your source. This will initiate a transfer. You can view the status of that transfer in the activity tab.

    The following image shows a transfer from a guest collection to the same guest collection. In a real situation, this would be between a UVM guest collection and a different collection.


Accessing Data as a Collaborator – Web Interface / Globus Connect

These steps assume that you are transferring data between a UVM collection and a local location (i.e. your computer or a server you manage). If your organization already uses Globus, and you’d like to transfer data between a UVM collection and an existing Globus collection your organization manages, see the above section Accessing Data as a Collaborator – Globus Transfer.

As an external collaborator with UVM, you can transfer data between guest collections shared by UVM affiliates and your computer using either the Globus web interface (for relatively small transfers) or the Globus Connect Personal application (for larger transfers or larger amounts of files).

For either accessing files using the web interface or through Globus Connect Personal, you’ll need to first open the Globus web interface and access the UVM guest collection you’re trying to transfer files to or from.

  1. Navigate to https://app.globus.org.
  2. If you have an account with Globus already, sign into it, and skip to Step 4
  3. If you don’t have an account with Globus, you can create one by linking a Google, Github, or ORCID account, or by creating a new account with Globus ID. Select any of the options below –OR–, then follow the prompts to create a new account.
  4. Select File Manager from the sidebar menu.
  5. Click the Search button and search the name of the guest collection that has been shared with you, and click on the name of it to select it

Web Interface

Note

The web interface does not support downloading of multiple files or folders. As such, if a set of files must be shared from a UVM guest collection to your local device, either have the UVM user compress the files into a zip/archive file, or use Globus Connect Personal as described below. The web interface may also struggle with transferring large amounts of data in either direction, which Globus Connect Personal will be able to do more easily.

  • To download a file from a collection, select the file you’d like to download and click the Download button on the right sidebar.
  • To upload a file or folder to the collection, click the Upload button on the right sidebar and follow the prompts to start the file upload. If doing this for the first time, you will likely be prompted to log into Globus a second time – follow the instructions and you should be put back into the collection file manager view.

Globus Connect Personal

Globus Connect Personal is an application developed by Globus that can be used to make your computer or server’s filesystem (or part of the filesystem), available as a collection in the Globus web application. Transfers between it and other Globus collections (such as from guest collections shared by UVM users) can then be performed from the web app.

To download and configure Globus Connect Personal:

  1. Go to https://www.globus.org/globus-connect-personal and select Install Now for the operating system that you’re installing Globus Connect Personal on.
  2. Follow the directions for downloading and installing Globus Connect Personal
  3. Follow the directions to start Globus Connect Personal

Once Globus Connect Personal is installed and running (and assuming the web interface has been navigated to access the UVM guest collection as shown above):

  1. Select Transfer or Sync to… from the right sidebar menu.
  2. Click the Search button on the newly-opened right panel collection view.
  3. Search for the collection that you created during the setup of Globus Connect Personal, and click on the name of it to select it.
  4. Check the box next to the file(s) you wish to transfer.
  5. Click the Start button under your source. This will initiate a transfer. You can view the status of that transfer in the activity tab.

Managing Globus Identities

Linking identities from other institutions

Globus allows users to link identities from multiple institutions in the event that users have multiple accounts.

Steps to link another identity.

  1. Start in the Account tab (app.globus.org/account/identities). On the right side of the screen, click the button that says Link Another Identity.
  2. Select the institution you want to link and click Continue. If you want to link an identity that is not associated with an institution (email) click the Link an email address (a) link.
  3. Your account is now linked and you will be able access collections from linked institutions with one login.

 

Updated on November 20, 2023

Related Articles

Not the solution you were looking for?
Don’t worry we’re here to help!
Submit a Help Ticket