1 of 16

Rolling Deck to Repository (R2R)

Challenges managing large data from the US Academic Research Fleet

*K. Stocks, S. O’Hara, D. Clark, R. Hudak, E. Miller, S. Smith, L. Stolp, R. Uribe, V. Ferrini, S. Carbotte

LDEO, FSU, SIO, WHOI

*presenter

www.rvdata.us

NSDF 2023-04

2 of 16

Collaborators

Funding/in-kind support

www.rvdata.us

NSDF 2023-04

3 of 16

US Academic Research Fleet

​

~18 active ARF vessels

​

4 of 16

Data Circles the Globe

map generated 2022/10/26

5 of 16

Routine Underway Data

www.rvdata.us

6 of 16

Our Mission

www.rvdata.us

7 of 16

Current Data Transmission Methods

​

​

R2R accepts data and metadata using many methods

  • Globus
  • SFTP
  • FTP
  • Cloud downloads
  • USB drives via mail
  • Email
  • Dropbox
  • ...

8 of 16

@LDEO

System Configuration

​

Replication and Backup

​

​

9 of 16

R2R Search Interface

www.rvdata.us

10 of 16

Cruises & Data Volumes at R2R

values generated 2022/10/26 for all funded cruises

​

0 10 20 30

Terabytes of Data

Number of Cruises

10 - 100 GB/cruise

11 of 16

New Instrument:

Wave Radar

12 of 16

EK80 Echosounders

From DOI 10.25923/kykm-sn39

13 of 16

14 of 16

R2R Storage Challenges

  • Not highly scalable - buy new disk as needed

(Amazon pricing was not predictable - we have fixed 5-year budgets - and that egress charge)

  • Works for a predictable data increase, but not unpredictable jumps

15 of 16

Additional Considerations

  • Do we need to move data so much (operators, R2R, NCEI)

​

  • Does “download and go” serve scientists as data gets large?

​

  • How is instrument R&D supported?

​

  • Real-time data coming

​

  • How to get data off the vessels

​

16 of 16

Questions, Comments, Suggestions?

Contact us:

​