To add a bit of background story:
Since the messages are only sent to the users when they are online, it is a client preference. Due to the redesign in beta1 those messages had been removed and was it was therefore a bug that they we’re not present. - Bugreport for this issue
Meaning if someone is not in the channel, while users join / leave, they can not lurk afterwards someone was in that channel.
