If you have a good encryption (WPA2 with AES, for example) and a reasonably long and unpredictable passphrase (mine is about 50 characters long, easy as hell to remember and almost impossible to guess), as well as the SSID broadcast disabled, the probability of it being hacked out of malicious intent is very low, as cracking the AES encryption would take considerable amounts of (time * computing power), and some asshole who just wants to use some network for something evil wouldn't even think of hacking into it if there is a not or just WEP encrypted WLAN anywhere near.
However, turning it off has some nice side effects on it's own (lower power consumption, it doesn't get as warm, all of the processing power is available for wired traffic, and some people are concerned about the WLAN being actually harmful for the body, and of course the reduction of the risk of being hacked to zero), so if you don't use it anyway, that's indeed the best option.