TweetFollow Us on Twitter

Looking for Open Directory

Volume Number: 20 (2004)
Issue Number: 11
Column Tag: Programming

Looking for Open Directory

by Dean Shavit

In the Beginning, there was NetInfo

I remember being awed and mystified by NetInfo at Apple Presentations by former NeXT System Engineers of Mac OS X Server version 1 in 1999. The idea of hierarchies and domains, administrator accounts and authentication, entries and attributes seemed downright weird to a Mac OS devotee like myself. Growing into the UNIX-y side of things with OS X Server as it evolved, I found myself more and more intrigued with the control a Directory Service brought to a group of Mac users, the mount records, machine accounts, and URLs visible in NetInfo Manager provided a valuable head-scratching and learning experience, to say the least.

Initially, NetInfo was a brilliant solution to a common UNIX problem--how to distribute and consolidate user, group, and host information over a network without having to maintain copies of /etc/passwd /etc/users, /etc/groups and /etc/hosts over multiple machines. As a matter of fact, extracting and capturing valid host, passwd, and group flat files for use on a UNIX system is as easy as:

$ nidump passwd . > mypasswds.txt
$ nidump hosts  . > myhosts.txt
$ nidump group  . > mygroup.txt

The real magic came in having applications, not just users, access authentication information in a central repository--without having to duplicate flat files all over the network. Mail Services, HTTP Services, FTP Services and file services can all share the same source of authentication. NetInfo, as implemented in NeXTSTEP (the ancestor to OS X), also allowed for a hierarchical arrangement of NetInfo "Domains" or databases of information, where defining administrator accounts at the top (or root) of the hierarchy allowed for them to authenticate at any point on all of its branches, as in the illustration below, where an administrator who had an account in the Corporate domain could authenticate any workstation in either the Sales or Marketing domain, while a user with an account in Sales wouldn't be able to authenticate at a workstation in the Marketing domain.


Netinfo Domain Hierarchy

Each OS X system up to OS X 10.3, either server or client, still has a local NetInfo database that's consulted first by services and applications in need of authentication, regardless of whether the OS X workstation or server is configured to consult shared directories or foreign directories, such as Microsoft's Active Directory or Novell's eDirectory. With NetInfo as a directory service, things got much more interesting with an additional shared NetInfo database created on OS X 10.1 or 10.2 (thereby becoming a directory server), then offered up to other OS X computers on a network via a process of "binding, " which took place at reboot by automatic configuration (DHCP), static configuration (specifying the IP address of the server which hosted the shared Network NetInfo database, along with the "tag" or name of the database) or by broadcast binding (which required the creation of machine records in the shared NetInfo and was widely ignored in OS X Server, a legacy from when NexTSTEP didn't support DHCP services).

With OS X Server 10.1, configuring a shared NetInfo domain could be a hit or miss proposition for all but the most learned gurus or the most patient and stalwart administrators, with the process of creating and populating a shared domain at times resulting in a spinning disc of death. Destroying a shared NetInfo database was sometimes cause for a reinstall of the whole server. OS X Server 10.1 relied heavily on a properly configured DNS server (which is still a requirement for most OS X Servers) but with many Mac professionals just getting into UNIX (myself included) DNS configuration was a black art, soon mastered with long nights of hair-pulling.


NetInfo Manager in OS X Server 10.1

OS X Server 10.1 stored a lot of system and service configuration information in NetInfo that would be moved to XML property list (.plist) files in OS X Server 10.2 and 10.3, notably settings for the IP Firewall Service, Mail Server, and Apple File Server.

NetInfo Becomes Open Directory, with Its Apprentice, OpenLDAP

Open Directory (I), which premiered with OS X Server 10.2, was Apple's new moniker for the collection of properties and values it had previously collected in NetInfo. It had some significant enhancements other than its capability to serve up directory information through LDAP via the OpenLDAP slapd daemon. Open Directory had new features that allowed for preference management by workgroup and computer accounts with presets that made creation of users and groups more efficient. With the release of OS X Server 10.2, NetInfo was still the default method for storing shared directory data, but it had been extended into something much more interesting. Previous to the release of OS X Server 10.2, there were rumblings that NetInfo has been thrown under the bus in favor of OpenLDAP or "slapd." In reality, OS X 10.2, which ushered in the Open Directory era, was an evolutionary step towards OpenLDAP. OS X 10.2 used NetInfo for its directory storage, or "domains" which is Apple's term for the actual databases that contain the directory information, but did integrate OpenLDAP so that the shared NetInfo domains could be accessed through an LDAPv3 plug-in to the Directory Access application, via a pre-defined set of Open Directory LDAP mappings, allowing for a smoother transition to Open Directory II in OS X Server 10.3. Also a significant advance of Open Directory was the addition of the Password Server which supported multiple authentication protocols based on the Simple Authentication and Security Layer (SASL) Standard which superseded the deprecated and insecure crypt password algorithm, that OS X 10.1 (not OS 9!) clients are still forced to use to this day.


Netinfo Manger: Shared NetInfo Domain in OS X Server 10.2

Open Directory services in OS X 10.2 also introduced the Workgroup Manager Application, which allowed for the easy insertion and editing of mcx (managed user and workgroup settings) but offered no real interface for adding LDAP attributes for populating such entries as email address, phone number, department, and title that would make the LDAP support useful with clients such as Apple's Address Book or Microsoft Entourage. Insertion of such data could easily be done with good 'ol NetInfo Manager, by creating the requisite properties and values within the user records.


LDAP Contact Information in NetInfo Manager

One of the best tools for populating user records with contact and organizational information is the open-source X Windows application Directory Administrator (available at fink.sourceforge.net ) that provide pre-set fields that makes entering personal data a pleasure.

Another nice touch was the Open Directory Assistant, which guided admins through the setup of directory domains and the password server and came in handy as a troubleshooting tool for those who forgot that the password server was necessary for authenticating Windows clients and gave themselves a "Basic" (now labeled "Crypt") password in Workgroup Manager denying them the privilege to set password server passwords for other users. With OS X Server 10.3, it's done by deleting the .AppleSetupDone file in /var/db and rebooting, which forces the Server Setup Assistant to run, allowing the administrator to reset their password and become a password server administrator once again. Upon setting up Open Directory, the personal installing OS X Server had three basic choices for a directory. First, they could store user account information in a local directory (single local NetInfo Domain). Second, they could connect to a directory on another server either by NetInfo or LDAP or NIS. Third, they could choose to host a directory that other computers and servers could access over the network (shared NetInfo domain) and could enable LDAP support for NetInfo. Each change or session of the Open Directory Assistant required a reboot, but it was a vast improvement over the riskiness of adding or deleting directory domains in OS X Server 10.1. Jaguar Server also proved the value of Apple's Workgroup Management scheme, modeled loosely on the interface and features of Macintosh Manager, the Classic Mac Managed Workgroup solution, but delivered with the robustness and reliability that Macintosh Manager administrators could only dream of.

Open Directory II: The Apprentice is now the Master

They went ahead and did it, they really did! It's extremely unusual, in the spirit of NIH (not invented here), that a computer company with as rich of a tradition as Apple (and NeXT) would dump its home-brewed network directory structure in favor of an open-source replacement, but that's exactly what happened in OS X Server 10.3. Shared NetInfo domains were no more, replaced by Open Directory Masters that used OpenLDAP exclusively and BerkleyDB as the back-end storage for the directory domain. An Open Directory Master with sufficient memory and storage can operate smoothly with 100,000 user accounts and can handle 250 simultaneous LDAP connections! For larger networks, this meant that it might no longer be necessary to arrange servers in hierarchies, as with NetInfo, allowing more flexibility in management and authentication.

Setting up and installing OS X Server is still relatively straightforward, the Open Directory Assistant morphed into the new Server Setup Assistant and gave up some of its capabilities to the new Server Admin application. On first look, Open Directory II appears little changed from Open Directory for Jaguar Server. However, the nomenclature has changed significantly. A shared domain is now an "Open Directory Master." A local directory is labeled a "Standalone Server." With these shades of Microsoft-speak, Apple accomplished once again what the others dared not to imagine: with Panther Server, an administrator could change the structure (role) of Open Directory without rebooting. Try that on a Windows Server! How did Apple do it? Well, OpenLDAP is quite a different beast than NetInfo. While NetInfo domains bound together at boot time, Open Directory II acts as an external directory domain connected locally at /LDAPv3/127.0.0.1, which is the same as a connection to an LDAP directory running on a different server at another IP address.


Choosing Directory Domain in WorkGroup Manager


Custom Search Path on Open Directory Master

Note that the Server Admin or Server Assistant adds the Open Directory Master LDAP node with the "Custom path" as if it were manually connected computer. As a matter of fact, aside from a few very important differences, which I'll get to later, there's really little difference between the way an OS X client would connect to an Open Directory II Master and the way the OS X Server that hosts it actually connects.

Connecting an OS X Server to another Open Directory Server is also accomplished through the LDAPv3 plug-in in Directory Access, using the "Open Directory Server" built-in mappings. There's a plug-in for Active Directory that doesn't require editing the Active Directory Schema to leverage accounts on a Windows 2000 or 2003 Server. Open Directory Masters can emulate Windows Domain Controllers for Windows Workstations allowing a single OS X Server to act as both home directory host and authentication server to mixed environments.

In addition to Apple's Password Server, Open Directory II features a new authentication authority: Kerberos. Given a properly configured DNS Server on the network or on the Open Directory Server itself, an Open Directory Master auto-configures itself as a KDC (Key Distribution Center) for OS X 10.3 clients (without additional configuration) and OS X 10.2 clients configured with the proper /etc/authorization edits, /etc/ krb5.keytab files, and edu.mit.Kerberos preference files. All OS X 10.3 clients receive their edu.mit.Kerberos preferences through the kerberosautoconfig command. The following from the man page describes the process:

the kerberosautoconfig command creates the 
edu.mit.Kerberos file from information stored in the open 
directory config record named KerberosClient. The existing 
edu.mit.Kerberos file is only replaced if the autogenerated 
header is present and the generation_id in the KerberosClient 
config record is greater than that within the file. The default 
location of the output file is /Library/Preferences/edu.mit.Kerberos.

This addition to Kerberos is Apple's unique method of simplifying the configuration of an authentication protocol that typically requires much work at the command-line. Even the task of adding other OS X Servers to the Kerberos Realm is a relatively simple process that allows multiple servers connected to a an Open Directory Master to grant access to services like ssh, afp, ftp, pop and imap without having users re-authenticate. When I first got single-sign on going here at our training lab, I was startled to be able to ssh into a server without authenticating again! It's easy to get used to, though! With Kerberos being the main authentication protocol for Windows Servers, and being supported by every major OS (even OS 9!), it's great to see Apple embracing an open standard and improving on it....wait did I just say that? Let me repeat myself, and repeat....

Only once an administrator starts scratching the surface of the Panther Server's Workgroup Manager application, specifically by going to its Preferences dialog and checking the "All Records" tab and inspector, does it becomes clear how much Apple has enriched Open Directory II.


Enabling "All Records" and Inspector in Workgroup Manager

Of course, such enrichment can't come without a requisite warning:


Danger Will Robinson!

Looking at the raw directory data is an interesting way to twiddle an evening or two away.


Raw LDAP Data in Workgroup Manager

Clicking on the "New Attribute..." button brings up a window with a popup of all supported Open Directory attributes. However, Workgroup Manager falls way short of NetInfo Manager in one significant way. It does not allow the person editing the directory data to see the hierarchy, structure, or relationships between much the attributes. NetInfo Manager still exists, but none of the Open Directory Data is really visible there on an Open Directory Master anymore. For instance, it is possible to add a KDCConfigData attribute, but it is not possible, without working with the command-line dscl tool, to get a sense of where in the LDAP directory it should go.

rclark:~ rclark$ dscl -u rclark -p /LDAPv3/127.0.0.1/ -list /Config                 
Password: 
KerberosClient
KerberosKDC
ldapreplicas
macosxodconfig
mcx_cache
passwordserver

Mcx_cache and passwordserver are familiar holdovers from Open Directory II. KerberosClient and KerberosKDC are new additions to the family. A closer look at the KerberosClient attribute reveals the magic of Apple's Kerberos implementation:

dscl -u rclark -p /LDAPv3/127.0.0.1/ -read /Config/KerberosClient

cn: KerberosClient
objectClass: apple-configuration top
AppleMetaNodeLocation: /LDAPv3/127.0.0.1
PasswordPlus: ********
RecordName: KerberosClient
XMLPlist: <?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple Computer//DTD PLIST 1.0//EN" 
     "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
        <key>edu.mit.kerberos</key>
        <dict>
                <key>domain_realm</key>
                <dict>
                        <key>.most.com</key>
                        <string>RCLARK.MOST.COM</string>
                        <key>most.com</key>
                        <string>RCLARK.MOST.COM</string>
                </dict>
                <key>libdefaults</key>
                <dict>
                        <key>default_realm</key>
                        <string>RCLARK.MOST.COM</string>
                </dict>
                <key>realms</key>
                <dict>
                        <key>RCLARK.MOST.COM</key>
                        <dict>
                                <key>KADM_List</key>
                                <array>
                                        <string>rclark.most.com</string>
                                </array>
                                <key>KDC_List</key>
                                <array>
                                        <string>rclark.most.com</string>
                                </array>
                        </dict>
                </dict>
        </dict>
        <key>generationID</key>
        <integer>1114977345</integer>
</dict>
</plist>

Here's the property list (.plist) used to automatically generate the edu.mit.Kerberos file when an OS X 10.3 client logs into an Open Directory Master with a running Kerberos KDC (Key Distribution Center).

Open Directory II also allows setting the passwords of multiple users simultaneously, as well as setting other attributes, such as home directory path. Just make a multiple selection of user accounts in Workgroup Manager and set a password for all of the users, check the option to "change password at next login" and with the correct password policies in place, there's no more need to worry about setting unique passwords and recording them. Password policies have expanded to include password length, composition of number and letters, difference from account name, and difference from last x number of passwords used when a change of password is required, though Open Directory still lacks an allow/deny schedule for users and groups.


Password Properties in Server Admin

The ldapreplicas attribute is a new addition to Open Directory as well. With two unique serial numbers (don't try it without them), an Open Directory Master will replicate the directory, password server, and Kerberos KDC to another OS X 10.3 Server in its entirety, and quickly. It takes just a few minutes to replicate an Open Directory Master on a 100-megabit Ethernet network with a few hundred users and a KDC. This is great for large educational institutions and enterprises concerned about downtime. Replication can occur on a schedule, or whenever the Open Directory Master is changed. Failover occurs naturally and the client logs into the first available replica.

Searching for the "Look"

OS X Server 10.3 is certainly one beast of a Directory server, but it does share one unfortunate characteristic with Windows 2000 and 2003 Server that its predecessors didn't. Though Workgroup Manager gives administrators access to all LDAP attributes and values, it doesn't allow for the hierarchical view that NetInfo manager provided in previous iterations of OS X Server. As with Windows Servers, administrators can see parts of the directory in certain applications, but never the "whole" thing. Certain important elements, such as the /Config container, aren't readily visible, even from using the command-line utilities. I, for one, despite have been dipped in the river of UNIX, am still a very visual person--things tend to make more sense to me if I can visualize them, eyeball them. GUIs make me smile.

So, my search for a utility (Directory Administrator, despite being a great editor, doesn't have a hierarchical mode) to view Open Directory II was on. I toyed around with phpldapadmin (http://phpldapadmin.sourceforge.net/) other web-based utilities, frankly I wanted something I could run on an iBook or Powerbook without having to configure a web server. Eventually, I stumbled upon a great utility called LBE.jar (short for LDAP Browser/Editor), a Java applet that finally gave me that "look" I'd been missing from previous version of OS X Server. LBE (http://www-unix.mcs.anl.gov/~gawor/ldap/) is old software (it hasn't been updated since 2002), but seems to work perfectly with Open Directory, which is either a testament to Open Directory's adherence to the OpenLDAP standard, or LBE's adherence to it, or both.

Downloading and unpacking LBE is simple, and requires no further tweaking to work on OS X 10.3.5. It launches with a double-click on the LBE.jar file. Configuring LBE to connect to Open Directory isn't very straightforward--it took me a few tries to get it right, as in the screenshot below:


Configure LDAP Connection in LBE.jar

Browsing Open Directory with LBE is certainly an eye-opening experience! Finally, I have a hierarchical tool that not only reveals all of the attributes, but shows them in proper relation to their container, sub containers, and organizational units. LBE is a great learning tool for connecting the "LDAP dots", but I'm not about to start editing Open Directory attributes with it...I'm a little concerned that it might not write the data properly, so I'd have to recommend that any editing be done on a test server, rather than a production server. I'm also a little concerned that it may be sending my account and password in the clear, so I'm careful not to run it over any network I'm unsure about, especially WAPs (Wireless Access Points).


Hierarchical View of Open Directory LDAP Master

Just about everything's connecting to LDAP these days, and not just address books. Soon, even freeware content management systems may have the ability to connect directly to and OS X Server for user and group information, ecommerce accounts created at online stores will live in LDAP on OS X Servers. Some of the latest builds of the PHP (Pre Hypertext Processor) library have LDAP support rolled in. And who knows what Apple will have up its sleeve for Open Directory III due out in mid-2005 with Tiger Server? Given the pre-announcement of several features, I can safely guestimate that new attributes will appear for access control lists (ACLs), Windows Group and User Policies (yes, there'll probably be registry information living, like alien larvae, in Open Directory), and new Kerberos Features that allow Windows clients authenticated by Windows Server KDCs to access services on an OS X Server, not to mention some new home directory options. It's great to see Apple embracing an open standard and improving on it....wait did I just say that again? Let me repeat myself, and repeat....and repeat.


Dean Shavit is an ACSA (Apple Certified System Administrator) who leads training sessions and manages consulting projects for MOST (Mac OS Training & Consulting) in Chicago. If you have questions or feedback you can contact him at dean@macworkshops.com.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

Latest Forum Discussions

See All

COSMOS RINGS (Games)
COSMOS RINGS 1.0.0 Device: iOS iPhone Category: Games Price: $5.99, Version: 1.0.0 (iTunes) Description: This game cannot be played without the Apple Watch.Released anniversary sale until August 31,2016 PST! A tragic tale of time's... | Read more »
How to get started selling on Mercari
As far as ecommerce has come over the last decade or so, there's still a tremendous opportunity to make it easier for people to buy and sell goods. That's especially true when it comes to shopping apps, which should only continue to increase in... | Read more »
Human Anatomy Atlas 2017 Edition - Compl...
Human Anatomy Atlas 2017 Edition - Complete 3D Human Body 1.0.24 Device: iOS iPhone Category: Medical Price: $24.99, Version: 1.0.24 (iTunes) Description: | Read more »
Heroes of Normandie (Games)
Heroes of Normandie 1.5 Device: iOS Universal Category: Games Price: $14.99, Version: 1.5 (iTunes) Description: The game does not support iPhone 4s and below | Read more »
Why you should never power up Pokemon in...
There's no question that candy is dandy in Pokemon GO. You need big quantities of it to evolve your Pokemon, and when combined with stardust, it can be used to power up your favorite pocket monsters as well, making them more formidable for the gym... | Read more »
Webzen launches 3D MMORPG MU Origin on i...
Mu Origin is featured time and time again at the very top of App Stores in China, and within the top five worldwide top-grossing charts on Google Play.Its popularity in Korea and China, featuring more than 120 registered players in China and 6... | Read more »
Severed (Games)
Severed 1.0 Device: iOS Universal Category: Games Price: $5.99, Version: 1.0 (iTunes) Description: LAUNCH DISCOUNT ON NOW!! ENDS AUGUST 4! ==== Take control of a one-armed warrior named Sasha, wielding a living sword on her journey... | Read more »
CSR Racing 2: How to master Live Races
Getting better at racing the AI in CSR Racing 2 is a pretty straightforward process. You run enough races with a particular car to get its shift timing down, continually improve it by buying upgrades whenever you can, and add any fusion parts you... | Read more »
VisualRuler - turns your iPhone into rul...
VisualRuler - turns your iPhone into ruler 1.0 Device: iOS iPhone Category: Utilities Price: $2.99, Version: 1.0 (iTunes) Description: Need to measure the size of the object but do not have a ruler? VisualRuler calculates the size of... | Read more »
Blyss (Games)
Blyss 2.0 Device: iOS Universal Category: Games Price: $1.99, Version: 2.0 (iTunes) Description: Travel through Beautiful mountains, serene valleys and harsh deserts solving Blyss' unique and self-evolving puzzles. The endless... | Read more »

Price Scanner via MacPrices.net

Notebook Makers In No Rush To Adopt USB-C – R...
Digitimes’ Cage Chao and Joseph Tsai note that while the USB Type-C interface is enjoying growing popularity among smartphones and tablet makers, notebook and all-in-one (AIO) PC vendors (other than... Read more
iMacs on sale for up to $250 off MSRP
B&H Photo has 21″ and 27″ Apple iMacs on sale for up to $250 off MSRP including free shipping plus NY sales tax only: - 27″ 3.3GHz iMac 5K: $2049 $250 off MSRP - 27″ 3.2GHz/1TB Fusion iMac 5K: $... Read more
12-inch 1.1GHz Retina MacBooks on sale for up...
Amazon has 2016 12″ 1.1GHz/256GB Retina MacBooks on sale for up to $100 off MSRP including free shipping: - 12″ 1.1GHz Space Gray Retina MacBook: $1199 $100 off MSRP - 12″ 1.1GHz Silver Retina... Read more
Bare Bones Software Releases Free TextWrangle...
Bare Bones Software has announced the release and immediate availability of TextWrangler 5.5, a significant update to its powerful, free, general purpose text editor for Mac OS X. TextWrangler is a... Read more
Apple’s 2016 Back to School promotion: Free B...
Purchase a new Mac or iPad using Apple’s Education Store and take up to $300 off MSRP. All teachers, students, and staff of any educational institution qualify for the discount. Shipping is free, and... Read more
Apple refurbished iPad Air 2s available start...
Apple has Certified Refurbished iPad Air 2 available starting at $339. Apple’s one-year warranty is included with each model, and shipping is free: - 128GB Wi-Fi iPad Air 2: $499 - 64GB Wi-Fi iPad... Read more
13-inch 2.5GHz MacBook Pro available for $964...
Overstock has the 13″ 2.5GHz MacBook Pro available for $964.21 including free shipping. Their price is $135 off MSRP. Read more
External Keyboard Innovations For iPad Pro (1...
I’m an input device aficionado. With non-touchscreen computers, which includes all Macs, the keyboard and mouse or trackpad are the tactile points of interface between user and machine, and the... Read more
GSK Rheumatoid Arthritis Study Leverages iPho...
Global healthcare products company GlaxoSmithKline (GSK) says that since 2014 they have begun transforming the way they conduct research, by leveraging state-of-the-art digital technologies — a... Read more
Clearance 12-inch Retina MacBooks, Apple refu...
Apple has Certified Refurbished 2015 12″ Retina MacBooks available starting at $929. Apple will include a standard one-year warranty with each MacBook, and shipping is free. The following... Read more

Jobs Board

*Apple* Solutions Consultant - APPLE (United...
Job Summary As an Apple Solutions Consultant, you'll be the link between our future customers and our products. You'll showcase your entrepreneurial spirit as you Read more
Lead *Apple* Solutions Consultant - APPLE (...
Job Summary The Lead ASC is an Apple employee who serves as the Apple business manager and influencer across a number of Reseller locations. The Lead ASC's role Read more
*Apple* Retail - Multiple Positions, Charles...
Job Description:SalesSpecialist - Retail Customer Service and SalesTransform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
*Apple* Retail - Multiple Positions, Willow...
Job Description:SalesSpecialist - Retail Customer Service and SalesTransform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
*Apple* Evangelist - JAMF Software (United S...
The Apple Evangelist is responsible for building and cultivating strategic relationships with Apple 's small and mid-market business development field teams. This Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.