Ctrl-Shift-U
followed by the number of the character.
If you see a small box with four even smaller numbers inside, then that simply means you don't have the right font installed.
DecodeUnicode.org can give you a preview of some unicode characters.
Managing day-to-day stuff with Ubuntu
Ctrl-Shift-U