Data Transfer Services

Appropriate methods of moving data to and from HMS - An Overview

The number of available resources for data transfer has increased and it may be confusing to evaluate all of the advantages and limitations of each when looking for the right solution for your project.

accellion dropbox 

onedrive  o2-logo Sharehost

 

The scenario:

I need to move small amount of data one time, to/from HMS.

I need to move LARGE (Data > 50GB) amount of data, one time, to/from HMS.

I regularly need to move LARGE (Data > 50GB) amount of data, that change frequently, to/from HMS.

A 3rd party wants to send me data (Data < 48GB).

      Using their personal accounts they can send data through

A 3rd party wants to send me LARGE amount of data. (Data > 50GB)

  • O2 (if a third party has a webserver or (s)ftp site, a person could use wget from O2 to PULL the data)
  • Sharehost (RITS can help with the transfer of data)
  • Dropbox File Request Service

      Using their personal accounts they can send data through

Please Contact Research Computing (RC) for more information or any issues with O2.

 

Comparing the features of the Data Transfer Resources:

To evaluate and analyze the benefits and limitations of data transfer resources, see the table below.

Click on the logos below to see a detailed description and requirements for each of the resources.

 

 

https://lh3.googleusercontent.com/8uzZnayU_ZEYbdP5C568O4Z64SGN97JYDz8buTJqricSAkDtQsAG23Jol0nIKBm0LhoKzSveyykd2LcoNM7DXMC0LsZqLqDmvUOeMHW1gGkHD32ST5Yjne7pZ42RH1AUlv65QaM

https://lh3.googleusercontent.com/laR8DtM77V7f-CA_yYEZx_3_S8kvUaVK3An78NEyF4bnBeg6vxeNiUwvHt0EwTPahENPWAB6F6KVhE9ZsXkAQVyPrL1drQMCkxv8WMZJ8-p_E-42NEBqrAuDQsiPhSa8rx6jj4k

https://lh4.googleusercontent.com/AuasbznRh_5buo8PRqJRcNIZ_Urke3Xkm5F4pu3rRN5tUdrpvs3HGuIZLj-Z86IAH-i6YhWbAr3DdU78fw7NDeC_fHUzQAB0Yxam30Ktu4h1huYfxt8zEiRMVgZAqOUyER0BhcA

o2-logo

https://lh4.googleusercontent.com/lRis40RwLGg-3E8SIMrPGgU7Y4lnDa6NvrBOb0oIKYUmsEtwjMYF0pfKi3trLDapYvw6dHTnmfqFa03RdoKHus8LWrsGmwEF_eojHUYgmodmN4QiWNLK9nBBWdcXyJMNRk0NgYQ

Data Size and Format

Hosting of common files (csv, xls, xlsx, doc, docx, pdf) and proprietary file formats (e.g. raw image files)


 

green check


 

green check


 

green check


 

green check


 

green check

 

Unlimited size per file

 

green check

 

red x

(max 10 GB)

 

green check

 

green check

 

green check

 

Maximum Total Data, per transfer

 

UNLIMITED

(Unlimited Storage criteria will be reevaluated in December 2019)

 

1TB

 

100 GB

100 GB Permanent and 10 TB Temporary

(for more Data space, contact RC) 1

1TB

(for more data space, contact RITS)

Minimum Data per Transfer No Minimum No Minimum No Minimum No Minimum

Minimum data requirement

25 GB

Data Access Tools

 

View & Search

 

green check

 

green check

 

green check

 

green check

green check

(For View)

red x

(For Search)

 

Share

 

green check

 

green check

 

green check

 

green check

(allows sharing with other O2 users)

 

green check

 

Download

 

green check

 

green check

 

green check

 

green check

 

green check

 

Edit

 

green check

 

green check

 

green check

 

green check

 

green check

 

Free for HMS

 

green check

 

green check

 

green check

 

green check

red x

(Standard HMS storage rates apply)

 

Harvard Data Security Level2

 

3

 

3

 

4

 

3

 

3

 

 

 

 

1 Click Link for information on Storage for O2.  

For information on the security level details, visit link

 

What can I expect for performance?

 

(Upload and Download time is calculated approximately5)

  • All files used here were first compressed/zipped (.zip) and then Uploaded via the HMS Private network.
  • If tools like IDM (Internet Download Manager) are used, the files can be downloaded quickly.

 

Data

Size

Dropbox Business

OneDrive

Accellion

O2

Sharehost

Upload

Download

Upload

Download

Upload

Download

Upload

Download

Upload

Download

5 GB

31

min

6

min

26

min

8.5

min

8

min

11

min

3.5

min

1.5

min

4

min

4.5

min

10 GB

1

hour

10

min

50 min

13

min

14

min

20

min

5

min

2.5

min

6

min

7

min

50 GB

5

hours

50

min

4 hour

16 min

1 hour

5 min

1 hour

10min

50

min

25 min

12.5

min

30

min

35

min

 

5 - A number of factors affect the Upload and Download times, like-

  • Network connection issues and Downtime
  • Bandwidth consumption
  • Hosts used
  • Traffic
  • Number of files

For Sharehost, RITS will upload the documents for the user.

 

Further questions?
Contact
RITS-HELP@HMS.HARVARD.EDU for a consult.

Last Updated: 2018-11-14