Oh, I see; this is a separate feature.
I think that once you've posted in a thread, it will always keep track of that thread for you, because it does have "your posts" in it.
The "Notify" button is how I follow threads; it sends me emails of new messages.