Oscar
HomeServicesDocumentation
  • Overview
  • Quickstart
  • Getting Started
  • System Hardware
  • Account Information
  • Short "How to" Videos
  • Quick Reference
    • Common Acronyms and Terms
    • Managing Modules
    • Common Linux Commands
  • Getting Help
    • ❓FAQ
  • Citing CCV
  • CCV Account Information
  • Student Accounts
  • Offboarding
  • Connecting to Oscar
    • SSH (Terminal)
      • SSH Key Login (Passwordless SSH)
        • Mac/Linux/Windows(PowerShell)
        • Windows(PuTTY)
      • SSH Configuration File
      • X-Forwarding
      • SSH Agent Forwarding
        • Mac/Linux
        • Windows (PuTTY)
      • Arbiter2
    • Open OnDemand
      • Using File Explorer on OOD
      • Web-based Terminal App
      • Interactive Apps on OOD
      • Using Python or Conda environments in the Jupyter App
      • Using RStudio
      • Desktop App (VNC)
    • SMB (Local Mount)
    • Remote IDE (VS Code)
      • From Non-compliant Networks (2-FA)
      • Setup virtual environment and debugger
  • Managing files
    • Oscar's Filesystem
    • Transferring Files to and from Oscar
    • Transferring Files between Oscar and Campus File Storage (Replicated and Non-Replicated)
    • Resolving quota issues
      • Understanding Disk Quotas
    • Inspecting Disk Usage (Ncdu)
    • Restoring Deleted Files
    • Best Practices for I/O
    • Version Control
  • Submitting jobs
    • Running Jobs
    • Slurm Partitions
    • Interactive Jobs
    • Batch Jobs
    • Managing Jobs
    • Job Arrays
    • MPI Jobs
    • Condo/Priority Jobs
    • Dependent Jobs
    • Associations & Quality of Service (QOS)
  • GPU Computing
    • GPUs on Oscar
      • Grace Hopper GH200 GPUs
      • H100 NVL Tensor Core GPUs
      • Ampere Architecture GPUs
    • Submitting GPU Jobs
    • Intro to CUDA
    • Compiling CUDA
    • Installing Frameworks (PyTorch, TensorFlow, Jax)
      • Installing JAX
      • Installing TensorFlow
    • Mixing MPI and CUDA
  • Large Memory Computing
    • Large Memory Nodes on Oscar
  • Software
    • Software on Oscar
    • Using Modules
    • Migration of MPI Apps to Slurm 22.05.7
    • Python on Oscar
    • Python in batch jobs
    • Installing Python Packages
    • Installing R Packages
    • Using CCMake
    • Intro to Parallel Programming
    • Anaconda
    • Conda and Mamba
    • DMTCP
    • Screen
    • VASP
    • Gaussian
    • IDL
    • MPI4PY
  • Jupyter Notebooks/Labs
    • Jupyter Notebooks on Oscar
    • Jupyter Labs on Oscar
    • Tunneling into Jupyter with Windows
  • Debugging
    • Arm Forge
      • Configuring Remote Launch
      • Setting Job Submission Settings
  • MATLAB
    • Matlab GUI
    • Matlab Batch Jobs
    • Improving Performance and Memory Management
    • Parallel Matlab
  • Visualization 🕶
    • ParaView Remote Rendering
  • Singularity Containers
    • Intro to Apptainer
    • Building Images
    • Running Images
    • Accessing Oscar Filesystem
      • Example Container (TensorFlow)
    • Singularity Tips and Tricks
  • Installing Software Packages Locally
    • Installing your own version of Quantum Espresso
    • Installing your own version of Qmcpack
  • dbGaP
    • dbGaP Architecture
    • dbGaP Data Transfers
    • dbGaP Job Submission
  • RHEL9 Migration
    • RHEL-9 Migration
    • LMOD - New Module System
    • Module Changes
    • Testing Jupyter Notebooks on RHEL9 mini-cluster
  • Large Language Models
    • Ollama
Powered by GitBook
On this page
  • 1. SMB
  • 2. Command line
  • 3. GUI programs for transferring files using the sftp protocol and transfer.ccv.brown.edu hostname
  • 3.1 WinSCP for Windows
  • 3.2 FileZilla
  • 3.3 Cyberduck
  • 4. Globus online
  • 5. LFTP

Was this helpful?

Export as PDF
  1. Managing files

Transferring Files to and from Oscar

PreviousOscar's FilesystemNextTransferring Files between Oscar and Campus File Storage (Replicated and Non-Replicated)

Last updated 2 years ago

Was this helpful?

There are several ways to move files between your machine and Oscar. Which method you choose will depend on how much data you need to move and your personal preference for each method.

  1. (scp)

  2. (best for large transfers)

1. SMB

You can drag and drop files from your machine to the Oscar filesystem via SMB. This is an easy method for a small number of files. Please refer to this for mounting filesystem via SMB.

2. Command line

Mac and Linux

SCP

You can use scp to transfer files. For example to copy a file from your computer to Oscar:

scp /path/to/source/file <username>@ssh.ccv.brown.edu:/path/to/destination/file

To copy a file from Oscar to your computer:

scp <username>@ssh.ccv.brown.edu:/path/to/source/file /path/to/destination/file

RSYNC

You can use rsync to sync files across your local computer to Oscar:

rsync -azvp --progress path/to/source/directory <username>@ssh.ccv.brown.edu:/path/to/destination/directory

Windows On Windows, if you have PuTTY installed, you can use it's pscp function from the terminal.

3. GUI programs for transferring files using the sftp protocol and transfer.ccv.brown.edu hostname

  • DUO is required if you are not connected to approved networks, e.g., home network

    • There is no interactive terminal message but your Phone will get a prompt automatically

  • DUO is NOT required if you are connected to approved Brown networks

In general, you can specify the following for your GUI programs:

  • Protocol: SFTP

  • Host: transfer.ccv.brown.edu

  • User: your Oscar username

  • Password: your Brown password

3.1.1 Limit Concurrent Transfer and Change Reconnect Options

Click the Optionsand then Preferences menu in WinsCP. In the poped up window, click Transfer and then Background to (Figure 1)

  • change Maximal number of transfers at the same time to 1

  • uncheck Use multiple connections for single transfer

click Endurace to (Figure 2)

  • set Automatically reconnect session to 5 seconds

  • uncheck Automatically reconnect session, if it stalls

  • set Keep reconnection for to 10 seconds

3.1.2 Add a New Site

3.2 FileZilla

3.2.1. Disable Timeout

Click the Edit menu and then select the Settings submenu, and then change the Timeout in seconds to 0 to disable, as shown in Figure 2

3.2.2 Add a New Site

Open the Site Manager as show in Figure 5.

Click the 'New Site' button to add a new site, as shown in Figure 4:

Limit the number of simultaneous connections to 1, as shown in Figure 5.

Click the 'Connect' button to connect to Oscar and transfer files.

3.3 Cyberduck

You may see a popup window on 'Unknown Fingerprint'. You just need to check the 'Always' option and click 'Allow'. This is windows should not pop up again unless the transfer server is changed again.

4. Globus online

BrownU_CCV_Oscar

5. LFTP

module load lftp  # To load the LFTP module from Oscar
lftp -u login,passwd MyAwesomeUrl  # To connect to your (S)FTP server
ls   # To list files on the (S)FTP server
!ls  # To list files in your directory on Oscar
get MyAwesomeFile  # To download a single file
mirror # To download everything as is from the server
mirror --directory=/name_of_directory/ # To download a specific directory

A personal Windows computer must have installed in order to be on approved Brown networks.

3.1 for Windows

is a secure, reliable research data management service. You can move data directly to Oscar from anothe Globus endpoint. Oscar has one Globus endpoint:

If you want to use Globus Online to move data to/from you own machine, you can install Globus Connect Personal. For more instructions on how to use Globus, see the in the Globus documentation.

is a sophisticated file transfer program supporting a number of network protocols (ftp, http, sftp, fish, torrent). It has bookmarks, a built-in mirror command, can transfer several files in parallel and was designed with reliability in mind. You can use the LFTP module from Oscar to transfer data from any (S)FTP server you have access to directly to Oscar. Below are the main LFTP commands to get you started:

CrowdStrike
WinSCP
Globus
Oscar section
LFTP
SMB
page
Command line
GUI application
Globus online
LFTP
Figure 1 WinSCP Maximal Transfers
Figure 2 WinSCP Reconnect
Figure 3 WinSCP Session Creation
Figure 4 Disable Timeout
Figure 5 Open Site Manager
Figure 6 New Site
Figure 7 Limit Simultaneous Connections
Figure 8 Cyberduck Connection
Figure 9 Unknown Fingerprint