Take the 2-minute tour ×
Ask Different is a question and answer site for power users of Apple hardware and software. It's 100% free, no registration required.

I'm currently exporting a ZFS partition with dedup=on using ubuntu-zfs and netatalk. However, time-machine insists on creating a sparsebundle on it, and it made me start wondering if this would have any impact on deduplication, since the concept of "files" disappear, and probably the block alignment wouldn't be great either...

P.S. My whole idea of using dedup is that I have a couple of macbooks backing up to the same place, and a lot of their files are equal.


Addendum: It seems the block-level alignment is failing dedup. Here's my experience:

  • Time-machine copies of two different macbooks, with lots of duplicated data among them (total 200Gb)
  • CCC the two macbooks to two sparse images.

Deduplication factor? 1.01x


Any ideas on how to set up ZFS dedup to correctly work with time-machine backups? Should I start looking for other backup (w/ dedup) alternatives?

share|improve this question

migrated from stackoverflow.com Jan 9 '12 at 4:05

This question came from our site for professional and enthusiast programmers.

add comment

1 Answer 1

Deduplication on ZFS is block-level, so it doesn't depend on the concept of files. The only way the deduplication can be defeated is if the offset of a file within the sparsebundle is not always the same modulo the block size. Since ZFS can use variable block sizes that are larger than the block size of the HFS+ file system inside the sparsebundle, correct alignment isn't guaranteed, but neither is it guaranteed that deduplication will fail.

If you're worrying about space, you may also want to enable compression on your ZFS pool. It imposes extra CPU overhead, but can actually increase effective disk throughput.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.