Search this site
Embedded Files
Metagenomics
  • Metagenomics
    • Taxonomy
      • Alpha and beta diversity
      • Strain level
      • Pangenome
      • Marker genes
        • MLST
      • 16S
        • Operational taxonomic unit (OTU)
        • 16s vs shotgun
    • Phylogeny
      • Horizontal gene transfer (HGT)
      • Lowest Common Ancestor (LCA)
      • Long branch attraction (LBA)
    • Evolution
    • Ecosystem
      • Environmental gene tags (EGTs)
      • Soil metagenomics
    • Metatranscriptomics
      • RNA-seq versus microarray
    • QC
      • Coverage depth
      • Sampling depth
        • Calculate sampling depth
      • RPKM calculation
      • Phred score (Q score)
      • Giga base pairs
      • GC content
    • Wiki
      • Microbiome
      • Orthologs and paralogs
      • Short read mapping
      • Fecal microbiota transplant
      • DNA sequencing library
      • Multiplex sequencing
      • x
      • x
      • x
      • x
        • x
      • x
      • x
      • x
  • Tools
    • 16S tools
      • DADA2
        • Conda environment
          • Segmentation fault
      • Normalization
        • CSS
      • QIIME
        • Alpha & Beta diversity
        • Install QIIME 1
          • AttributeError:axisbg
          • biom error
          • Greengenes
          • h5py BIOM error
          • PackagesNotFoundError
          • qiime_config
          • R for QIIME
          • usearch61
        • OTU biom table
          • QIIME: split OTU table
          • ValueError column index exceeds matrix dimensions
        • QIIME mapfile
        • QIIME OTU clustering
          • Error running usearch61
          • Fungi 18S
          • IOError Errno 28 No space left on device
          • SILVA
        • QIIME pre-processing
          • Cannot find fastq-join
          • join-error
          • split-error
        • Taxonomy
        • Test statistics
    • Assembly
      • Contigs
      • N50 statistics
      • MEGAHIT
    • BLAST
      • BLAST error: Too many positional arguments
      • BLAST word-size
      • BLASTn output format 6
      • BLASTx
      • E-value & Bit-score
      • FastANI
        • Install FastANI
          • Install autoconf
          • Install GLS
      • Generate_database
        • Public sequences
      • Install BLAST
      • megablast
    • Bowtie2
      • Create bowtie2 index
      • Install bowtie2
        • libtbb.so.2
        • Segmentation fault
    • Genome
      • Prokka
    • Pathogen screening
    • Phylogenetic tree
      • File format
      • Sequence-Alignment
        • Alignment viewer
      • Tree-construction
        • FastTree
        • RAxML
          • Add bipartition
          • Install RAxML
      • Tree-viewer
        • Forester
          • Java error
    • SAMtools
      • BCFtools
      • Consensus sequence
      • Converting BAM to fastq
      • Error
        • Could not parse the header line
        • different line length in sequence
      • Install
        • Error curses.h
      • Number of reads in bam file
      • SAM file format
      • SAMtools: get breadth of coverage
    • Sequence data
      • Convert fastq to fasta
      • Extract sequence subset
      • Get random subset
      • Multi-FASTA format
      • NCBI ftp genome download
        • gff to ffn
    • Shotgun sequencing
      • Alignment
        • Viewer
          • Tablet
      • Data
      • NCBI SRA files
        • Install SRA-tools
        • prefetch
        • Error
          • path not found while resolving tree within virtual file system module
        • wget download
        • old fastq-dump
      • Quality control
        • Trim Galore
      • Remove host sequences
      • Remove too short reads from fastq files
      • Fastq file format
    • Ubuntu Linux
      • awk
      • bzip2
      • Extract columns from file
      • File properties
      • gzip & tar.gz
      • Loop over list of files
        • find
        • if greater than
        • String split
      • Rename multiple files
      • rsync
      • sed
      • Shell stderr redirect
      • Show disk space usage
      • Split large file
      • Data tables
        • Transpose table
        • Sorting
    • HPC SGE cluster
      • Submit job
      • Check cluster nodes
Metagenomics

rsync

Ubuntu - Command Line Tools

rsync - Remote copy and synchronization

rsync is a Ubuntu/Linux tool to copy, upload and backup files from a local computer to a remote server. Local and remote directory get synchronized by updating new or modified files only. Identical files, located already on the the server, are not copied again.

Examples

upload (copy) files from local directory Data/ to remote server directory Backups Data/

Only files that are not already on the server will be copied.

Note, that both location paths end with a forward slash (/)!

rsync -avz Data/ loginName@serverName:Backups/Data/

download (copy) all files from a remote server directory Repository/Data/Run1/ to local directory MyProjects/Data/

If connection interrupts, rsync command can be re-started to copy the missing files only).

rsync -avz loginName@serverName:Repository/Data/Run1/ MyProject/Data/

copy multiple directories Exp1 ..2 ..3 (including directory names) into the remote Backups/ Data/ folder

Note, that the local location paths missing the ending forward slash (/) which mean to "copy inside" the remote location.

rsync -avz Data/Exp1 Data/Exp2 Data/Exp3 loginName@serverName:Backups/Data/

delete old files from server: upload new files and remove all old server files that are deleted in the original local Data/ directory

Files of remote location Backups/Data/ folder will be synchronized (mirrored) with local Data/ folder

rsync -avz --del Data/ loginName@serverName:Backups/Data/

Options: rsync -avz

rsync -a is the archive mode to copy the complete content of a directory (all files and sub-directories), preserve time stamps, keep owner and group information and all file and directory permissions. Option -a is a short cut for using all the individual options -r -l -p -t -g -o -D

rsync -v to show progress information and messages (verbose)

rsync -z to compress files before internet transfer (in case of large files and limited network connection)


Read more

http://manpages.ubuntu.com/manpages/man1/rsync.1.html

https://en.wikipedia.org/wiki/Rsync

www.metagenomics.wiki

Author: Matthias Scholz

Google Sites
Report abuse
Page details
Page updated
Google Sites
Report abuse