TweetFollow Us on Twitter

Journaling Bits

Volume Number: 21 (2005)
Issue Number: 6
Column Tag: Programming

Journaling Bits

A Look At The OS X "Personal Diary"

by Brad Belyeu

Welcome

My typical work day is filled with interruptions. Phones constantly ringing; people asking questions, etc. Everyone wants a piece of my time. Interruptions are not only a major hit to productivity and effective time management; but when you're trying to replace a PowerBook logic board, it can mean bigger problems. They sometimes leave me wondering, "Where did I set my screwdriver?", or "Where does this screw go again?" Now imagine having a secretary that follows you around all day recording what you do. Whenever you finish a task, it is scratched off a list; and whenever you start a new task, it is added to a list. Anytime you had an interruption, you could simply ask your secretary what you were doing before the interruption. That would be amazing! This is what Apple's software engineer's were thinking when they introduced file system journaling.

Meet The Secretary

To understand why file system journaling is important, we need to understand file systems & take a look at OS X systems prior to journaling. File systems are like library cataloging systems. Library catalogs can tell you an exact name & location of any book in the library; just like file systems can tell you the exact name & location of a piece of data on a drive. Both systems regulate naming & location conventions for what they store. If a file system gets corrupted, it would be like trying to read a library catalog in a language you can't understand. Journaling was introduced into OS 10.2.2 Server edition and into the client in 10.3. In previous OS versions, when you have any of these failures, they leave your system volume in an unknown state because there is no record of where the disk was interrupted. The OS then had to do a data integrity check of the entire disk. Interruptions can also damage system files rendering the boot volume unusable. This is usually when you restart and are presented with a folder and the infamous flashing question mark because the computer can't find a disk to startup. But when journaling is enabled, the computer tracks file system operations and immediately logs them in a journal. When restarting after a failure, the operating system can use the journal to return the files system to its previous state. This eliminates the need to check the entire drive for inconsistencies. Instead, when the computer is restarted, it takes a look at its journal, reads to find out what it was doing, and picks up right where it left off. File system journaling is a major advancement in protecting the file system from power outages, hardware failures, or software crashes.

The Good

A system continuity failure interrupts the read & write processes of a hard drive. These interruptions create discrepancies between the file system (library catalog) and the actual location of the stored files (location of books in library). In a journaled file system the OS has a record of disk activity, preventing the disk from becoming unusable (most of the time) which also prevents repairs that cost both time & money. It also cuts down on the time it takes to restart the computer after one of these failures because the entire disk doesn't have to be checked for inconsistencies block-by-block. Although a multi-gigabyte hard drive only takes several minutes to check, the original idea in introducing file system journaling was to minimize down-time for servers because a multi-terabyte disk could take hours to check. A journaled file system takes just a few seconds to return to operating condition no matter what the size of the drive is.

File system journaling was developed by Apple to be an extension to the current file system. This is good news because it lets you enable/disable journaling without reformatting the disk! The Mac OS Extended volume format (HFS+) can change between journaled and non-journaled without any data loss. The advantages of this will become clear later in the article as we discuss reasons you may not want to use file system journaling.

Because the journal works at the system level, it is invisible to the applications on the drive. Other than some disk utilities, all applications and network setups are compatible with journaling. Most 3rd party disk utilities will also work with journaling. Just in case you were wondering, finished actions are removed from the journal so the journal file doesn't become too large. Just like that the secretary crosses completed tasks off your list and throws them in the trash.

Journaled file systems are backward compatible with the regular HFS+ file systems. Meaning that computers using an older Mac OS can have full access to journaled volumes. This is great news for external hard drive users with multiple computers. That way you can use journaling on your hard drive and all your Macs can use the drive whether they are running OS 10.3 or an earlier version.

The Not So Good

Journaling doesn't come without its cost, which happens to be performance. But fortunately, the performance hit only comes when the system is writing to the disk and not when it is reading from the disk. I've never been able to actually tell the difference in speed on drives running journaled verses non-journaled drives. Supposedly, if you have a client version of the OS, the performance hit can be up to 20%, but the server version of the OS comes with a buffered version of journaling. If you have enough RAM, the server version is only supposed to take a 2-3% hit on hard drive performance.

Here's my general opinion on two occasions when you shouldn't use journaling. If you have a drive that is primarily set up to be read-only access, you don't need journaling. For example, if you have a hard drive that you keep your applications on (or just the OS), but not your actual documents or working files on, then you probably don't need file system journaling. This is because you are just pulling data off the drive 99% of the time and are rarely saving data back to the drive. If your system fails, your drive probably wasn't in the middle of writing data. Or if you have a file server disk that is always under heavy speed demands AND you back it up on at least a daily basis, I would consider disabling file system journaling. This might be the case if you are storing large data files containing audio or video that are accessed frequently.

Although file system journaling will help you save data that has already been journaled to your drive; you may still lose data in the event of a failure that is in the buffer before it is written to the drive. So file system journaling definitely needs to be complimented by a battery backup system.

The last drawback to consider is the failure of some 3rd party disk utilities to work with file system journaling. Make sure you check compatibility on a manufacturer's website before using a 3rd party utility on a journaled file system. Many of the vendors released updates specifically for their product to work with a journaled file system. I've heard nightmares of people losing all their data by running an incompatible disk utility with a journaled file system.

File system journaling has its limitations and is not a fix-all answer to your data problems. According to Apple, file system journaling is one of several measures you should take to avoid data loss. File system journaling should be coupled with RAID (redundant array of indexed disks) storage, a continuous backup strategy, and an uninterrupted power source (UPS) for maximum protection of you digital assets.

Enabling/Disabling

You can enable or disable file system journaling using Disk Utility (located in the Applications/Utilities folder). Select a volume in Disk Utility (figure 1).


Figure 1.

If you want to enable journaling, you can simply click 'Enable Journaling' from the pane. This will enable journaling without erasing data on the disk. If you'd like to disable journaling, you can select the volume and then click File-Disable Journaling from the menu bar.

You can also enable or disable file system journaling using the command line version of Disk Utility, diskutil. To have sufficient privileges you'll have to use sudo (super user do) with diskutil. To enable file system journaling on the root directory type:

sudo diskutil enableJournal /

and then type in your administrator password. If you'd like to disable file system journaling on the root directory use:

sudo diskutil disableJournal /

followed by your administrator password. To enable or disable on volumes other than the startup disk replace / with /Volumes/(VolumeName).

Repairing Journaled Drives

To repair an ailing journaled drive you can once again use Disk Utility. The trick is that you can't repair the disk you booted from; so if you want to repair your startup volume with Disk Utility, you have to startup to a CD or another drive. Once you have Disk Utility open, select the drive that you want to repair and then click 'Repair Disk'. If you don't have another drive you can startup from you'll be better off using a 3rd party utility or the command line.

If you don't want to spend the money on a 3rd party disk utility, try using the command line utility fsck_hfs. To force fsck_hfs to check a journaled volume you need to use the argument -f. Also, if you just want to verify status of the drive, use the -n flag; but if you want to repair the drive, use the -y flag.

There are a number of excellent 3rd party disk utilities. My favorite are DiskWarrior X & TechTool Pro. There are also a number of shareware & freeware applications to be found just by searching versiontracker.com or macupdate.com.

Wrapping up Journaling

Using file system journaling is a great idea for most users. There are the occasions to disable it, but for the most part it makes our lives easier. That is where the analogy leaves the library catalog. File system journaling is done automatically, but looking up a book in a library can sometimes be challenging. I'm just glad file system journaling keeps track of everything without my lifting a finger. But remember, file system journaling does not excuse you from needing a regular system backup!


Brad Belyeu is the President of ABConsulting based out of Oklahoma City, OK. He is an Apple Certified Technician and a certified member of the Apple Consultant Network. Most importantly, he is happily married.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

iMazing 2.3.2 - Complete iOS device mana...
iMazing (was DiskAid) is the ultimate iOS device manager with capabilities far beyond what iTunes offers. With iMazing and your iOS device (iPhone, iPad, or iPod), you can: Copy music to and from... Read more
Cocktail 10.4.1 - General maintenance an...
Cocktail is a general purpose utility for macOS that lets you clean, repair and optimize your Mac. It is a powerful digital toolset that helps hundreds of thousands of Mac users around the world get... Read more
Backup and Sync 3.35.5978.2967 - File ba...
Backup and Sync (was Google Drive) is a place where you can create, share, collaborate, and keep all of your stuff. Whether you're working with a friend on a joint research project, planning a... Read more
Adobe Lightroom 6.12 - Import, develop,...
Adobe Lightroom is available as part of Adobe Creative Cloud for as little as $9.99/month bundled with Photoshop CC as part of the photography package. Lightroom 6 is also available for purchase as a... Read more
Apple iTunes 12.6.2 - Play Apple Music a...
Apple iTunes lets you organize and stream Apple Music, download and watch video and listen to Podcasts. It can automatically download new music, app, and book purchases across all your devices and... Read more
Apple macOS Sierra 10.12.6 - The latest...
With Apple macOS Sierra, Siri makes its debut on Mac, with new features designed just for the desktop. Your Mac works with iCloud and your Apple devices in smart new ways, and intelligent... Read more
VMware Fusion 8.5.8 - Run Windows apps a...
VMware Fusion 8 and Fusion 8 Pro--the latest versions of its virtualization software for running Windows on a Mac without rebooting--include full support for Windows 10, OS X El Capitan, and the... Read more
Apple Safari 10.1.2 - Apple's Web b...
Note: The direct download link is currently unavailable. It is available in the OS X 10.12.6 release, as well as in the Apple Security Updates. Apple Safari is Apple's web browser that comes with OS... Read more
OnyX 3.2.7 - Maintenance and optimizatio...
OnyX is a multifunction utility that you can use to verify the startup disk and the structure of its system files, to run miscellaneous maintenance and cleaning tasks, to configure parameters in the... Read more
Postbox 5.0.16 - Powerful and flexible e...
Postbox is a new email application that helps you organize your work life and get stuff done. It has all the elegance and simplicity of Apple Mail, but with more power and flexibility to manage even... Read more

Latest Forum Discussions

See All

Realpolitiks Mobile (Games)
Realpolitiks Mobile 1.0 Device: iOS Universal Category: Games Price: $5.99, Version: 1.0 (iTunes) Description: PLEASE NOTE: The game might not work properly on discontinued 1GB of RAM devices (iPhone 5s, iPhone 6, iPhone 6 Plus, iPad... | Read more »
Layton’s Mystery Journey (Games)
Layton’s Mystery Journey 1.0.0 Device: iOS Universal Category: Games Price: $15.99, Version: 1.0.0 (iTunes) Description: THE MUCH-LOVED LAYTON SERIES IS BACK WITH A 10TH ANNIVERSARY INSTALLMENT! Developed by LEVEL-5, LAYTON’S... | Read more »
Full Throttle Remastered (Games)
Full Throttle Remastered 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: Originally released by LucasArts in 1995, Full Throttle is a classic graphic adventure game from industry legend Tim... | Read more »
Stunning shooter Morphite gets a new tra...
Morphite is officially landing on iOS in September. The game looks like the space shooter we've been needing on mobile, and we're going to see if it fits the bill quite shortly. The game's a collaborative effort between Blowfish Studios, We're Five... | Read more »
Layton's Mystery Journey arrives to...
As you might recall, Layton's Mystery Journey is headed to iOS and Android -- tomorrow! To celebrate the impending launch, Level-5's released a new trailer, complete with an adorable hamster. [Read more] | Read more »
Sidewords (Games)
Sidewords 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: Grab a cup of coffee and relax with Sidewords. Sidewords is part logic puzzle, part word game, all original. No timers. No... | Read more »
Noodlecake Games' 'Leap On!...
Noodlecake Games is always good for some light-hearted arcade fun, and its latest project, Leap On! could carry on that tradition. It's a bit like high stakes tetherball in a way. Your job is to guide a cute little blob around a series of floating... | Read more »
RuneScape goes mobile later this year
Yes, RuneScape still exists. In fact, it's coming to iOS and Android in just a few short months. Jagex, creators of the hit fantasy MMORPG of yesteryear, is releasing RuneScape Mobile and Old School RuneScape for mobile devices, complete with... | Read more »
Crash of Cars wants you to capture the c...
Crash of Cars is going full on medieval in its latest update, introducing castles and all manner of new cars and skins fresh from the Dark Ages. The update introduces a new castle-themed map (complete with catapults) and a gladiator-style battle... | Read more »
Golf Clash guide: How to rise through th...
For a little game as cartoony and colorful as Golf Clash, competition can be quite fierce. You need to be on top of your game and have the best equipment possible if you want to get very far. True success is measured by both player skill and the... | Read more »

Price Scanner via MacPrices.net

DEVONthink To Go 2.1.7 For iOS Brings Usabili...
DEVONtechnologies has updated DEVONthink To Go, the iOS companion to DEVONthink for Mac, with enhancements and bug fixes. Version 2.1.7 adds an option to clear the Global Inbox and makes the grid... Read more
15-inch 2.2GHz Retina MacBook Pro, Apple refu...
Apple has Certified Refurbished 2015 15″ 2.2GHz Retina MacBook Pros available for $1699. That’s $300 off MSRP, and it’s the lowest price available for a 15″ MacBook Pro. An Apple one-year warranty is... Read more
13-inch 2.3GHz Silver MacBook Pro on sale for...
B&H Photo has the new 2017 13″ 2.3GHz/256GB Silver MacBook Pro (MPXU2LL/A) on sale for $1399 including free shipping plus NY & NJ sales tax only. Their price is $100 off MSRP. Read more
Apple Tackles Distracted Driving With iOS 11...
One of the most important new features coming in iOS 11 is Do Not Disturb while driving, intended to help drivers stay more focused on the road. With Do Not Disturb while driving, your iPhone can... Read more
iMazing Mini for Mac: Free Automatic and Priv...
Geneva, Switzerland-based indie developer DigiDNA has released iMazing Mini, their free macOS utility designed to automatically back up iOS devices over any local Wi-Fi network. The app offers users... Read more
Clearance 2016 13-inch MacBook Airs, Apple re...
Apple dropped prices recently on Certified Refurbished 2016 13″ MacBook Airs, with models now available starting at $809. An Apple one-year warranty is included with each MacBook, and shipping is... Read more
9.7-inch 2017 iPads available for $299, save...
B&H Photo has 2017 9.7″ 32GB WiFi iPads on sale for $30 off MSRP for a limited time. Shipping is free, and pay sales tax in NY & NJ only: – 32GB iPad WiFi: $299, $30 off Read more
Welcome to the new MacPrices.net!
Welcome to the newly redesigned MacPrices.net! MacPrices has been comprehensively redesigned from the ground up over the past couple of weeks. The new design is cleaner, with less clutter, minimal... Read more
Clearance iMacs available for up to $370 off...
B&H Photo has clearance 21″ and 27″ Apple iMacs available for up to $370 off original MSRP, each including free shipping plus NY & NJ sales tax only: – 27″ 3.3GHz iMac 5K: $1929 $370 off... Read more
Sale! 15-inch 2.8GHz MacBook Pros for $100 of...
B&H Photo has the new 2017 15″ 2.8GHz Touch Bar MacBook Pros on sale for $100 off MSRP. Shipping is free, and B&H charges sales tax in NY & NJ only: – 15″ 2.8GHz MacBook Pro Space Gray: $... Read more

Jobs Board

Frameworks Engineering Manager, *Apple* Wat...
Frameworks Engineering Manager, Apple Watch Job Number: 41632321 Santa Clara Valley, California, United States Posted: Jun. 15, 2017 Weekly Hours: 40.00 Job Summary Read more
*Apple* Customer Experience (ACE) Leader - A...
…management to deliver on business objectivesTraining partner store staff on Apple products, services, and merchandising guidelinesCoaching partner store staff on Read more
Frameworks Engineering Manager, *Apple* Wat...
Frameworks Engineering Manager, Apple Watch Job Number: 41632321 Santa Clara Valley, California, United States Posted: Jun. 15, 2017 Weekly Hours: 40.00 Job Summary Read more
*Apple* Solutions Consultant - Apple Inc. (U...
…about helping others on a team while also delighting customers? As an Apple Solutions Consultant (ASC), you will discover customers needs and help connect them Read more
Frameworks Engineering Manager, *Apple* Wat...
Frameworks Engineering Manager, Apple Watch Job Number: 41632321 Santa Clara Valley, California, United States Posted: Jun. 15, 2017 Weekly Hours: 40.00 Job Summary Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.