No, you normally only do that if it's obvious that it's your own without context needed. For a phrase like "my arm hurts", it would be silly to think you have pain in somebody else's arm. It might not always be quite that perfectly obvious, but it doesn't generally extend into ambiguity.
In words like "familj", ending with a "J". Do you still pronounce it or is the consonant dropped?