 |
 | Home | Contact Us | FAQ | Search & Site Map | Link to Us |
 | Sign In | Join | Other 45 Sites in Network |
Mac Forum / Applications / Mac Applications / April 2007Compressing .dmg files
Are there any freeware compression apps that I can use to compress a .dmg? It's 26GB, and I understand some apps choke on files that large.  SignaturePhil Stripling | email to the replyto address is presumed The Civilized Explorer | spam and read later. email from this URL http://www.cieux.com/ | http://www.civex.com/ is read daily. > Are there any freeware compression apps that I can use to compress a > .dmg? It's 26GB, and I understand some apps choke on files that large. > > -- > Phil Stripling | email to the replyto address is presumed > The Civilized Explorer | spam and read later. email from this URLhttp://www.cieux.com/ |http://www.civex.com/ is read daily. Have you compressed the .dmg file itself when creating it? I can imagine that there can be problems with such a big file size, my only thought is to split the data into more .dmg files. Marcus > Are there any freeware compression apps that I can use to compress a > .dmg? It's 26GB, and I understand some apps choke on files that large. What app would you be serving a .dmg file too other than the operating system? SignatureThank you and have a nice day. > > Are there any freeware compression apps that I can use to compress a > > .dmg? It's 26GB, and I understand some apps choke on files that large. > > What app would you be serving a .dmg file too other than the operating system? I'm guessing I wasn't clear. I want to compress a 26Gb file (happens to be a .dmg); some compression applications won't accept files that large, so I'm looking for a compression utility that will compress a 26GB file. I want to store that file offsite, and I'm limited in the size of file I can move. SignaturePhil Stripling | email to the replyto address is presumed The Civilized Explorer | spam and read later. email from this URL http://www.cieux.com/ | http://www.civex.com/ is read daily. + Phil Stripling <philip@alumni.rutgers.edu>: | I'm guessing I wasn't clear. I want to compress a 26Gb file (happens to | be a .dmg); some compression applications won't accept files that | large, so I'm looking for a compression utility that will compress a | 26GB file. I am not aware of any such limitations on either gzip or bzip2. These are purely stream based, and shouldn't care about the file size. Run them from the command line. | I want to store that file offsite, and I'm limited in the size of file | I can move. Unless the file is extremely redundant, the compressed version will still be huge. Signature* Harald Hanche-Olsen <URL:http://www.math.ntnu.no/~hanche/> - It is undesirable to believe a proposition when there is no ground whatsoever for supposing it is true. -- Bertrand Russell > I am not aware of any such limitations on either gzip or bzip2. These > are purely stream based, and shouldn't care about the file size. Run > them from the command line. Thanks for that information. I've looked at the directory and decided not to compress it in its entirety because it's so large and unwieldy. > Unless the file is extremely redundant, the compressed version will > still be huge. I compressed a subset the original materials using ditto to archive and zip a smaller directory. It went from 2.4GB to 1.9GB. For those who don't mind working from the command line, ditto is in the man pages. I understand the desire for (and very much appreciate) the GUI interface on the Mac, but there are occasions when it's unnecessary, and compressing files is one of those occasions for me. Mileage variations welcomed. SignaturePhil Stripling | email to the replyto address is presumed The Civilized Explorer | spam and read later. email from this URL http://www.cieux.com/ | http://www.civex.com/ is read daily. > > I am not aware of any such limitations on either gzip or bzip2. These > > are purely stream based, and shouldn't care about the file size. Run [quoted text clipped - 14 lines] > and compressing files is one of those occasions for me. Mileage > variations welcomed. I have yet to find a shell command which will preserve/restore ACLs. SignatureTom Stiller PGP fingerprint = 5108 DDB2 9761 EDE5 E7E3 7BDA 71ED 6496 99C0 C7CF > > I understand the desire for (and very much appreciate) the GUI > > interface on the Mac, but there are occasions when it's unnecessary, > > and compressing files is one of those occasions for me. Mileage > > variations welcomed. > > I have yet to find a shell command which will preserve/restore ACLs. Does the Finder's "Create archive" menu option do that? I don't really know, because I don't mess with ACLs. SignatureTom "Tom" Harrington MondoMouse makes your mouse mightier See http://www.atomicbird.com/mondomouse/ > > > I understand the desire for (and very much appreciate) the GUI > > > interface on the Mac, but there are occasions when it's unnecessary, [quoted text clipped - 5 lines] > Does the Finder's "Create archive" menu option do that? I don't really > know, because I don't mess with ACLs. No. I did compile a utility, star, which purports to handle ACLs, but either I don't understand how to use it or it doesn't handle the Mac OS X flavor of ACLs. SignatureTom Stiller PGP fingerprint = 5108 DDB2 9761 EDE5 E7E3 7BDA 71ED 6496 99C0 C7CF > I have yet to find a shell command which will preserve/restore ACLs. I have no idea. The man page on ditto doesn't mention them. Check here: http://developer.apple.com/macosx/backuponmacosx.html which says, "And for simplicity, this article assumes that you have not turned on ACLs (using Mac OS X Server or fsaclctl) on the filesystem you are wanting to back up. There are some subtleties in how these tools interact with ACLs that are beyond the scope of this article. Please consult the latest documentation for each tool for more details." You might look at the individual compression apps and see if you can find anything on access control lists. I'm happy to say I don't deal with Windows networks, so it's of no interest to me. Ditto is updated for 10.4 if I'm reading that page right, so it may have some coverage not mentioned in the man page. The man page I see is dated 2004. SignaturePhil Stripling | email to the replyto address is presumed The Civilized Explorer | spam and read later. email from this URL http://www.cieux.com/ | http://www.civex.com/ is read daily. > You might look at the individual compression apps and see if you can > find anything on access control lists. I'm happy to say I don't deal > with Windows networks, so it's of no interest to me. Ditto is updated > for 10.4 if I'm reading that page right, so it may have some coverage > not mentioned in the man page. The man page I see is dated 2004. I don't see the connection between ACLs and Windows networks. I use ACLs on shared iPhoto libraries so than any member of my family can read, write, add, and update said libraries. I've tried all the shell commands [that I know of] which archive files and none of them preserve ACLs. Retrospect claims to back them up, but a backup/restore combination strips them from the directories and files. SignatureTom Stiller PGP fingerprint = 5108 DDB2 9761 EDE5 E7E3 7BDA 71ED 6496 99C0 C7CF > I don't see the connection between ACLs and Windows networks. I use > ACLs on shared iPhoto libraries so than any member of my family can [quoted text clipped - 3 lines] > and none of them preserve ACLs. Retrospect claims to back them up, but > a backup/restore combination strips them from the directories and files. There's some interesting stuff here: http://arstechnica.com/reviews/os/macosx-10.4.ars/7 Apparently, ACLs are stored with the extended attributes, as discussed here: http://arstechnica.com/reviews/os/macosx-10.4.ars/8 SignatureW. Oates > Apparently, ACLs are stored with the extended attributes, as discussed > here: > > http://arstechnica.com/reviews/os/macosx-10.4.ars/8 Okay, that explains why ACLs would be useful without regard to Windows networking. SignaturePhil Stripling | email to the replyto address is presumed The Civilized Explorer | spam and read later. email from this URL http://www.cieux.com/ | http://www.civex.com/ is read daily. > I don't see the connection between ACLs and Windows networks. Maybe there's more than one ACL. Or more likely, I don't have a clue what I'm talking about. :-> Here's Apple's page: ----quote----- New in Mac OS X Server v10.4 are access control lists (ACLs), providing flexible file system permissions that are fully compatible with Windows Server 2003 Active Directory environments and Windows XP clients. -----end quote------- http://www.apple.com/server/macosx/features/fileprint.html So I assumed only people networking with Windows computers (or maybe running Windows on their Macs would care about ACL. So, should _I_ care about ACLs, when I'm compressing a directory? And specifically, my ~/Library directory? SignaturePhil Stripling | email to the replyto address is presumed The Civilized Explorer | spam and read later. email from this URL http://www.cieux.com/ | http://www.civex.com/ is read daily. > > I don't see the connection between ACLs and Windows networks. > [quoted text clipped - 14 lines] > So, should _I_ care about ACLs, when I'm compressing a directory? And > specifically, my ~/Library directory? If you haven't explicitly installed an ACL on any file or directory, you can safely ignore the whole topic. I use ACLs extensively and just wanted to point out that most backup/restore systems don't preserve them. SignatureTom Stiller PGP fingerprint = 5108 DDB2 9761 EDE5 E7E3 7BDA 71ED 6496 99C0 C7CF > I have yet to find a shell command which will preserve/restore ACLs. I notice that the CVS version (3.0) of rsync claims to have ACL support. http://samba.anu.edu.au/rsync/ I haven't tried it yet. SignatureW. Oates > I notice that the CVS version (3.0) of rsync claims to have ACL support. > > http://samba.anu.edu.au/rsync/ > > I haven't tried it yet. Well, it compiles nicely, but there's no support for OS X ACL yet. It was a good thought though, no? Once you start messing around with rsync, you never want to use anything else ... SignatureW. Oates > > I notice that the CVS version (3.0) of rsync claims to have ACL support. > > [quoted text clipped - 4 lines] > Well, it compiles nicely, but there's no support for OS X ACL yet. It > was a good thought though, no? Yes, and thanks. > Once you start messing around with rsync, you never want to use anything > else ... True. SignatureTom Stiller PGP fingerprint = 5108 DDB2 9761 EDE5 E7E3 7BDA 71ED 6496 99C0 C7CF > Yes, and thanks. > > > > Once you start messing around with rsync, you never want to use anything > > else ... > > True. But wait, I may be too clever for my own good. I compiled a nice fresh rsync-2.6.9, (and the CVS) and played with that. It won't do ACLs, nor will the -E switch seem to carry extended attributes. However, the rsync-2.6.3 included with the latest Tiger update seems to have been patched by Apple to carry both: NOTE: on the non-server OS X you have to explicitly turn on ACLs on the volumes you want them on thus: sudo /usr/sbin/fsaclctl -p / -e make a file: [~]$ touch file [~]$ ls -ale file -rw-r--r-- 1 warren warren 0 Apr 7 14:10 file xattr should be available here, if it's down, I can email you a copy: http://dev.bignerdranch.com/public/bnr/eXttra.zip no extended attributes yet [~]$ xattr --list file file no ACLs either [~]$ ls -ale file -rw-r--r-- 1 warren warren 0 Apr 7 14:19 file add an ACL [~]$ chmod +a "jane allow write" file [~]$ ls -ale file -rw-r--r-- + 1 warren warren 0 Apr 7 14:10 file 0: user:jane allow write add an extended attribute [~]$ xattr --set name Tom file [~]$ xattr --list file file name Tom send it to another (HFS+) drive; note that rsync makes one of those dot-underscore files [~]$ rsync -avvE file /Volumes/Godzilla/ building file list ... [sender] expand file_list to 131072 bytes, did move done delta-transmission disabled for local transfer or --whole-file file ._file total: matches=0 tag_hits=0 false_alarms=0 data=242 sent 413 bytes received 60 bytes 946.00 bytes/sec total size is 0 speedup is 0.00 [~]$ cd /Volumes/Godzilla/ [/Volumes/Godzilla]$ xattr --list file file name Tom [/Volumes/Godzilla]$ ls -ale file -rw-r--r-- + 1 warren warren 0 Apr 7 14:10 file 0: user:jane allow write I assume this will work on other than HFS+ filesystems, with that dot-underscore file and all. SignatureW. Oates > But wait, I may be too clever for my own good. I compiled a nice fresh > rsync-2.6.9, (and the CVS) and played with that. It won't do ACLs, nor > will the -E switch seem to carry extended attributes. However, the > rsync-2.6.3 included with the latest Tiger update seems to have been > patched by Apple to carry both: Doesn't wok for me. tms@imac% rsync --version rsync version 2.6.9 protocol version 29 tms@imac% ls -lde t0 drwxr-x--- + 6 tms staff 204 Jun 28 2006 t0/ 0: group:family allow list,add_file,search,delete,add_subdirectory,delete_child,chown,file_inhe rit,directory_inherit tms@imac% rsync -E -vaub t0 /Volumes/Test building file list ... done t0/ t0/f01 t0/f02 t0/t01/ t0/t01/f011 t0/t01/f012 t0/t02/ t0/t02/f021 t0/t02/f022 t0/t02/t021/ t0/t02/t021/f0211 t0/t02/t021/f0212 sent 606 bytes received 220 bytes 1652.00 bytes/sec total size is 0 speedup is 0.00 tms@imac% pushd /Volumes/Test/ /Volumes/Test ~/Desktop/Desktop Stuff /Volumes/Test tms@imac% ls -led t0 drwxr-x--- 6 tms tms 204 Apr 7 15:39 t0 tms@imac% SignatureTom Stiller PGP fingerprint = 5108 DDB2 9761 EDE5 E7E3 7BDA 71ED 6496 99C0 C7CF > Doesn't wok for me. > > tms@imac% rsync --version > rsync version 2.6.9 protocol version 29 That's I think because you've compiled your own version of rsync? Have you got the Apple-supplied version? It's a patched 2.6.3, you can get the source at the Darwin web site. SignatureW. Oates > > Doesn't wok for me. > > [quoted text clipped - 4 lines] > you got the Apple-supplied version? It's a patched 2.6.3, you can get > the source at the Darwin web site. Right you are! the Fink /sw/bin is in my path ahead of /usr/bin and I failed to notice where rsync was loaded from. On top of that I misread the version number in your post and thought I was using the Apple supplied version. Thanks again for seeing this through. SignatureTom Stiller PGP fingerprint = 5108 DDB2 9761 EDE5 E7E3 7BDA 71ED 6496 99C0 C7CF > make a file: > [~]$ touch file [quoted text clipped - 17 lines] > -rw-r--r-- + 1 warren warren 0 Apr 7 14:10 file > 0: user:jane allow write I'm confused by the timestamps in the above example. It looks like the modification time was set backward by 9 minutes, for no readily apparent reason. SignatureTom "Tom" Harrington MondoMouse makes your mouse mightier See http://www.atomicbird.com/mondomouse/ > I'm confused by the timestamps in the above example. It looks like the > modification time was set backward by 9 minutes, for no readily apparent > reason. Probably I didn't do it in the same order that I wrote the message; meaning, I might have cut and pasted and done stuff twice. It's confusing, and you have a sharp eye. GOOD NEWS -- the latest CVS of rsync not only supports OS X extended attributes, it carries the ACLs across volumes with the xattrs. I love it. It seems to be less flakey than the patched version shipped with Darwin. SignatureW. Oates > I compressed a subset the original materials using ditto to archive and > zip a smaller directory. It went from 2.4GB to 1.9GB. For those who [quoted text clipped - 4 lines] > and compressing files is one of those occasions for me. Mileage > variations welcomed. Just one more piece of info, Phil, in case you are at all concerned with the metadata that some others are. According to this site: http://blog.plasticsfuture.org/2006/04/23/mac-backup-software-harmful ditto (used by Carbon Copy Cloner in the comparison table) evidently doesn't maintain some of the metadata properly. --Fred > ditto (used by Carbon Copy Cloner in the comparison table) evidently > doesn't maintain some of the metadata properly. Thanks, Fred. The article is a year old, and the article on ditto is even older. I've archived and compressed a file with ditto, so now would be a good time to determine what, if anything, is screwed up. Unfortunately, I have no clue how to compare the metadata in my ditto archive and my directory. Any clues? Should I email plasticsfuture and ask? SignaturePhil Stripling | email to the replyto address is presumed The Civilized Explorer | spam and read later. email from this URL http://www.cieux.com/ | http://www.civex.com/ is read daily. > > ditto (used by Carbon Copy Cloner in the comparison table) evidently > > doesn't maintain some of the metadata properly. [quoted text clipped - 6 lines] > have no clue how to compare the metadata in my ditto archive and my > directory. Any clues? First, it's important to restate plascticfuture's perspective: 'my recommendation is based solely on the metadata preservation capabilities (no other features are judged), and on my perspective that a backup tool should preserve every bit of metadata of every file. There are good reasons to have different preferences; in that case, study the list of each tools¹ issues and decide for yourself if you can live with it.' He is concerned about maintaining an authentic file creation date as well as ACLs and BSD flags (immutable bit anyone?). For your personal backups, these are not so important. For anyone in a networked or server environment, they may well be crucial. My understanding (I'm not an official Apple developer, so I don't have inside knowledge) is that ACLs were supposed to be fully introduced in 10.4 but proved too complex, so they were only added to 10.4 server. Presumably the 10.5 client will have full implementation. > Should I email plasticsfuture and ask? Sure. It can't hurt to ask and express your needs and concerns, and see if he has performed any more recent tests. Don't know if email or posting to the discussion is the better approach. Post 188 says that rsync for 10.4.9 has been updated and now works properly, so you could join Warren and Tom rolling your own. --Fred > Are there any freeware compression apps that I can use to compress a > .dmg? It's 26GB, and I understand some apps choke on files that large. Disk images can be compressed themselves, in which case further compression is neither necessary nor possible. However once you do that they become read-only disks. If it's supposed to be read-only then this is probably the best choice. To do this with a disk image, run Disk Utility. If the disk image doesn't appear in the list on the left, drag it into the window. Then select the disk image and use Images --> Convert to convert to a read-only compressed image. If you want the disk to remain writable, you can use any sort of file-compression scheme to compress the disk image file. One way would be to select the file in the Finder, right-click (or control-click) on it, and select the "Create archive" entry on the menu. That'll give you a zip file of the image. You could use other compression apps but this way is convenient and already on your Mac. SignatureTom "Tom" Harrington MondoMouse makes your mouse mightier See http://www.atomicbird.com/mondomouse/ > > Are there any freeware compression apps that I can use to compress a > > .dmg? It's 26GB, and I understand some apps choke on files that large. [quoted text clipped - 15 lines] > a zip file of the image. You could use other compression apps but this > way is convenient and already on your Mac. If the disk image needs to be writable, it could also be stored as a sparse image, which expands only to the size of the data stored on it, and which shrinks when you remove files from it. > If the disk image needs to be writable, it could also be stored as a > sparse image, which expands only to the size of the data stored on it, > and which shrinks when you remove files from it. And it can be converted to compressed, and back. Once an image is compressed, compressing it again has very little effect. Use compressed images, get a good night's sleep, move on. SignatureW. Oates > And it can be converted to compressed, and back. Once an image is > compressed, compressing it again has very little effect. Depends on the compression algorithm, of course. I used to think that double-compressing using Disk Utility would be a waste of time. Now I'm not so sure. For example: I have a folder with the Pixen SVN source tree. I create a dmg file using Disk Utility. Then I put that inside a new folder and compress to a new disk image. The results: Orginal folder: 52.7MB 1st Compressed Disk Image: 20.3MB 2nd Compressed Disk Image: 12.2MB (Triple-compressing offered no new savings.) Cheers, R. > If you want the disk to remain writable, you can use any sort of > file-compression scheme to compress the disk image file. One way would > be to select the file in the Finder, right-click (or control-click) on > it, and select the "Create archive" entry on the menu. That'll give you > a zip file of the image. You could use other compression apps but this > way is convenient and already on your Mac. I agree with Tom; however, if you want different compression options or a GUI interface, I've found the app GUI Tar to work quite well. --Fred |
Reply to this Message |
 Sign In
 Join
 My Latest Posts My Monitored Threads My Blog My Photo Gallery My Profile My Homepage Start New Thread Enable EMail Alerts Rate this Thread
|
©2009 Advenet LLC Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.