This feature is not enabled by default, at least in Ubuntu 11.04 with Audacious version 2.4.4. However, there is a plugin which enables this feature, the plugin name is called Status Icon and it is located in Preferences -> Plugins -> General.

After you have enabled the plugin, click on the system tray Audacious icon to hide the program completely.