Questions tagged [rsync]
For questions about the rsync tool, which is a Unix utility for synchronizing files across computer systems.
126
questions
2
votes
1
answer
79
views
How to pass file expansion patterns across an ssh/rsync connection
I'm new to macOS but I have some experience in Linux. Now I am encountering some problems with different styles of command lines between macOS and Linux and I hope someone can help me.
In Linux, if I ...
- 21
0
votes
0
answers
64
views
On Ventura, running rsync from launchd gives permissions error
This problem is similar to questions at the following:
rsync errors, but only when run in launchd
rsync "Operation not permitted (1)" error only when run in launchd
Permissions errors when ...
- 555
3
votes
0
answers
74
views
Kernel Panic - RSYNC 3.2.7 - While backing up to (SMB) Network Drive/NAS
Kernel Panic / Crash using rsync 3.2.7
I am trying to do this with Launch Control but it also crashes when I run this script from Terminal:
#!/bin/zsh
/opt/homebrew/Cellar/rsync/3.2.7_1/bin/rsync -...
- 31
0
votes
1
answer
86
views
launchd exit status "-9"
I have a couple of launchd jobs starting a rsync wrapper script. They have been running fine for at least 3 years, but now most of them fail with exit status -9. All jobs are configured like this (...
- 111
1
vote
1
answer
61
views
How to only overwrite metadata (specifically date file attributes) between files that have the same contents with the older/more accurate attributes?
I have a situation where a backup has correct Date Modified and other correct metadata. A large volume of these files were copied accidentally without the correct rsync flags (eg, rsync -a does not ...
- 5,212
3
votes
2
answers
602
views
rsync : Show deleted files
I'm in the process of porting scripts which use rsync to MacOS 10.15.7.
Typical commands in these scripts look like
rsync -rau --delete SOURCE DESTINATION
Is there a way to display, which files have ...
- 609
0
votes
1
answer
141
views
Backup using `rsync` fails because of a file that is not even into the source directory to be backed up
I am trying to backup the /User/user01/Library using rsync (via the linux-timemachine wrapper https://github.com/cytopia/linux-timemachine) to an external hard drive Volumes/name_of_backup logged in ...
- 504
0
votes
0
answers
18
views
rSync, Assuming Destination Directory Permissions
Using rSync, is it possible to have all copied files and directories assume the owner, group, and permissions of the destination directory, whatever they might be?
I've played with the following ...
- 865
0
votes
1
answer
672
views
App to mount iPhone as disk accessible from Terminal [closed]
Is there an app which mounts my iPhone as an external drive on my Mac through wifi so that I can access its files from Terminal? It would be great if I could sync files with rsync (or maybe even ...
- 1
0
votes
0
answers
39
views
What is the most efficient way to use rsync to confirm transfer of large folder
I’m using a synology ds214 and I have a 6tb folder I originally was using USB Copy to transfer to an external drive connected directly to the nas. That process failed somewhere along the way and I ...
- 11
1
vote
0
answers
70
views
New line \n is replaced with \#012
I have created a small alias function to sync my scripts.
It worked fine until last week but now in my rsync command it doesn't do the newlines anymore. They are replaced by \#012
rsync: failed to ...
- 304
0
votes
1
answer
182
views
Weird copying error after updating to MacOs 13.0.1 (22A400)
I have been trying to copy some folders between 2 external hard drives and I am getting this weird error.
None of the folders is locked; this never happened before updating to 13.0.1.
Any idea how to ...
- 111
0
votes
0
answers
288
views
rsync freezes in macos ventura
I often ssh to a server or directly rsync some folder there to my local machine without any special config. After upgrading to MacOS Ventura, they no longer work. rsync just freezes after asking my ...
- 183
1
vote
0
answers
1k
views
rsyncing into a OneDrive-synced folder without triggering lots of spurious activity?
I wish to use rsync to copy a lot of data into a OneDrive-synced directory regularly, and leave it up to OneDrive itself to sync that into the cloud. rsync is my tool of choice as I am using it for ...
- 558
0
votes
1
answer
1k
views
rsync 3.x on M1 Mac
Previously, rsync could simply be upgraded on a Mac to 3.x version by homebrew. As command, I used
/usr/local/bin/rsync
instead of just
rsync (which used the preinstalled 2.x version).
On a MacMini M1,...
- 13
1
vote
0
answers
44
views
How to transfer terabyte of data faster?
I have a terabyte of data to copy from old external HDD to new external HDD.
By the way the new hdd is encrypted via DiskUtility.
I'm using macbookpro,two hdd's and two apple's USB-C to USB Adapters ...
1
vote
1
answer
227
views
rsync listing directory with no changes
I have been trying to figure out this rsync behavior, where it still lists directories with different timestamps and the same sizes despite providing a --size-only flag.
# lists some directory without ...
- 113
1
vote
0
answers
134
views
Incremental rsync to encrypted APFS USB drive extremely slow
I use rsync to create incremental backups of my backup dir (containing symlinks to all relevant local dirs) to various machines and/or drives:
rsync -ivrLtzS --delete-during --progress --link-dest=../...
- 111
2
votes
1
answer
273
views
Can I use rsync to fix the timestamps that Migration Assistant trashed?
I have discovered the hard way that Apple's "Migration Assistant" doesn't always preserve file timestamps (i.e., created/modified dates in ~/Documents), and I now have a new machine with ...
- 51
1
vote
0
answers
102
views
When using rsync to sync a sparsebundle are --delete and -X for extended attributes options recommended?
I have scripts that rsync Time Machine sparsebundles to a remote server for offsite backups. I've always assumed that extended attributes are a function of the internal image filesystem and not the ...
- 11
2
votes
1
answer
262
views
Maintain Finder's file lock during rsync?
I'm using rsync to keep two drives in sync. I use the --archive flag which is meant to maintain permissions. However, files which are "locked" in Finder do not show as locked after the rsync ...
- 53
1
vote
1
answer
1k
views
rsync 2.6.9 crashing on macOS Monterey
On Big Sur I had an rsync command running daily to backup files from a network drive to an external harddrive. I've recently upgraded to Monterey and now it's crashing the mac, even if I just try a ...
- 187
1
vote
0
answers
185
views
How to schedule and run a cron/launchctl job that will wake computer if asleep
I have a script that performs a backup of my PhD data using rsync. The rsync is performed between my laptop and a home server I have running. The broad idea here is that I normally use my server to ...
- 121
1
vote
0
answers
81
views
Sparsebundle issues: rsync fails and bash completion shows files that don't exist
The strangest thing is happening right now, so I'm just going to do my best to explain:
I have two hosts: a MacBook Pro ("MBPro"), and an iMac ("iMac"), both running Mojave 10.14.6....
- 175
2
votes
2
answers
1k
views
Which files should be excluded in an rsync backup (with macOS Big Sur / version 11.5.1)?
Context:
I've been backing up my MacBook Pro with rysnc (now version 3.2.3, protocol version 31) to external hard drives formatted with NTFS. I'd like to continue with this procedure if possible.
...
- 21
4
votes
4
answers
1k
views
rsync 3.2.3 keeps crashing on Mac mini M1
Trying to use rsync on a Mac mini M1 to backup from an external hard drive(formatted as APFS) to a NAS (shared as smb/cifs). I've tried a number of rsync commands but this was the most recent
rsync -...
- 187
-1
votes
1
answer
466
views
Updating rsync through Homebrew vs updating through .tar download
What are some of the advantages and disadvantages of updating the version of rsync installed using Homebrew vs downloading a .tar file and installing it this way https://hargitai.co.nz/upgrade-rsync-...
2
votes
1
answer
2k
views
How to disable "ignore ownership" option on an external volume on Mac OS X El Capitan?
I'm using a MacBook Pro 13'' mid-2012 running Mac OS X El Capitan (10.11.6).
My problem is similar to https://serverfault.com/a/402216/616473.
I use rsync to create backups from my internal drive to ...
- 33
0
votes
2
answers
159
views
How to delete a backup of /dev/fd?
For extra safety, I recently decided to make a second backup of my Macbook's HD. Initially I did so with rsync, because I was already using Time Machine for my first backup. But then I realized Time ...
- 213
1
vote
1
answer
186
views
Transfering file and folder permissions to a clean install with rsync?
I'm periodically backing up my Mac user-folder to a remote machine by running rsync with a cron job on my machine. I'm thinking that anything useful will be in the user-folder and I can always ...
- 13
1
vote
1
answer
349
views
Problem with rsync in AppleScript
Im facing a problem with AppleScript/Rsync.
I try to copy various folders from various drives to one HDD.
The following shows a part of the Apple script which is more or less always the same part of ...
- 11
0
votes
1
answer
551
views
rsync on macOS Catalina : filename overflows max-path len by 2
I am trying to use rsync to transfer files to a Macbook Pro, like this :
rsync -avn --delete /Users/name/ [email protected]:/Users/home_name_from_old/
Unfortunately, I get the following errors on some ...
user256573
3
votes
3
answers
3k
views
Copy home directory from one Mac to another both running macOS Catalina
I have a new 16" and an older 15" MacBook Pros both running macOS Catalina. I want to transfer all my the content in my home directory to the new MacBook Pro while retaining the same ...
user256573
1
vote
1
answer
434
views
Permissions errors when using launchd to run rsync between local drive and afp network drive
I am trying to sync a local directory to my NAS that is mounted via the afp protocol as a drive. I am using rsync. When I run the command from the terminal, it works fine. However, when I try to run ...
- 121
1
vote
0
answers
216
views
Migration Assistant, rsync, cp and Catalina: How to copy everything in `/Users`
So I just got a brand new 13" MBP and I started with the migration assistant, but it doesn't copy enough from the ~/Library folder. For example, I'm missing my Apple Notes from that machine and ...
4
votes
1
answer
1k
views
Rsync keeps copying the same file
I have used rsync for many years between linux filesystems without any problem with a very deterministic behavior. Now I try to use it on mac and experience some problem that some files (a small ...
2
votes
0
answers
45
views
How to tell the maximum speed of copying a file using Finder or cp or rsync? [duplicate]
I got a Samsung T7 SSD drive knowing that it can handle 1GB/s read or write, but if I used
rsync -a --progress --stats --human-readable file1.m4v /Volumes/T7/file1.m4v
to tell the speed of copying a ...
- 9,518
3
votes
1
answer
712
views
Rsync is terribly slow (0,5MB/S) on Catalina but the same rsync job is much faster (50MB/S) running from a Debian VM on the same mac?
I'm reaching out to you because I'm at my wits end.
I've been trying to figure out why using rsync over ssh is so slow on my MacBook (15 inch from 2015).
Basically I'm trying to backup my home folder ...
- 31
2
votes
3
answers
4k
views
Using rsync with path names containing spaces
I am trying to use rsync (on macOS Catalina) but have trouble with spaces in file path names. I have used -s or --protect-args but they do not do anything (when I look at the help for rsync, these ...
- 31
2
votes
0
answers
248
views
problems resulting from launchd script running when computer is sleeping
I have a Bash script that copies a specified set of files/directories to a remote server via rsync. It is run by launchd as a Global Daemon every day at 3am. The computer is sleeping most of the time ...
- 325
1
vote
0
answers
113
views
Automator Run Shell Script - Wrong output
I'm using Rsync for backing up a server. I thought I would make use of Automator to create easy backup-executables.
And as the server has large amounts of data I need to split the data across multple ...
- 11
1
vote
1
answer
336
views
Can't authenticate using SSH key when running script via launchd
I have a Bash script that executes an rsync command to sync files with a remote server.
#!/bin/bash
rsync -auvzP --exclude=.bundle --exclude=node_modules --exclude=tmp '/Volumes/Norman Data/me/....
- 325
5
votes
2
answers
1k
views
How can I back-up an external drive while preserving attributes, folder creation date and showing progress?
Final goal
Create a copy of all files one external hard drive to another external hard drive, both formatted as HFS+.
Preserve the folder creation date.
Preserve finder colour label.
During the copy ...
- 5,691
0
votes
1
answer
269
views
Creating Rsync script to copy files for multiple users and the shared directory
I want to copy files to an external drive to use as a backup using RSync. I have installed OpenMediaVault to serve as NAS. I installed RSyncOsX to have a GUI to set parameters for Rsync to execute. ...
- 111
1
vote
2
answers
614
views
Will Carbon Copy Cloner (CCC) file/rsync-based clones to a "target disk mode" T2 MacBook work?
Summary
I want to copy my entire OS/volume/disk (which is FileVault-ed) from on MacBook to another, whose volumes(s) are also FileVaulted. Assuming no OS incompatibilities between hardware, will a ...
- 1,219
0
votes
0
answers
117
views
Does remote copy with scp support the -E flag?
In this documentation page section titled "Copy a file or folder remotely", Apple says scp supports the -E flag, which preserves extended [file] attributes, resource forks, and ACL information.
On ...
- 477
12
votes
1
answer
5k
views
Copy Time Machine backup with rsync
Is it possible to copy a Time Machine backup using rsync to another HFS formatted disk? I am concerned that rsync would not be able to track the hard-linked directories that Time Machine uses.
- 241
1
vote
0
answers
99
views
How to copy Time Machine directory when rsync can see files but ls can't?
I recently used GNU ddrescue to save a 6TB drive that was having troubles. When I would try to mount the drive, fsck_hfs determined it couldn't be fixed (it was trying to rebuild the catalog b-tree, ...
1
vote
1
answer
628
views
rsync errors, but only when run in launchd
I have a script which runs rsync on my ~/Library/Preferences/ folder:
#!/bin/zsh -f
SOURCE="$HOME/Library/Preferences"
TARGET="$HOME/Dropbox/Backups/Preferences/$HOST"
LOG="$HOME/logs/$HOST/${NAME}...
- 20.5k
2
votes
2
answers
910
views
Copy Mac Time Machine Backup Directories from One External Drive to Another
I decided to stick to the safest approach to make copies of my backups. In other words, my Mac backs up everything to one external drive and then I copy that entire backup directory to the second ...
- 133