As long as you have your contacts address on file in gmail contacts, You can easily create a Folder on your desktop and a Shortcut to the Google Maps Icon "Directions" as long as you select vehicle when creating and turn by turn navigation is selected shortcut will be 1 click turn by turn directions to that contacts destination.
//
or if your fine with 2 extra clicks a shortcut to just the contact, since it gives you the option to call e-mail .. and selecting view home address brings up contacts address on map clicking name of contact on map give you the navigate option.