@jtinro I knowww!!! It’s very tricky to choose the appropriate first person pronoun in Japanese, even for us the native speakers!
Like you say, 自分 can mean you and I both.
And I think a lot of people especially find it difficult to choose the FPP when talking to their family members.(I don’t think this fact is taught in classes?)
For example I find it awkward to use 俺 to, say, my mom, because it’s got this… a bit of aggressive tone. But then other FPPs also give some particular tones to the sentence, and none of them suit my need.(ah, it’s really hard to explain exactly how I feel)
So in many cases we consciously try to avoid to put the first person pronoun, and sort of “work around” to say the same thing without using the very word “I”.
Well, the thing is that in Japanese we don’t really put the first person pronoun, but in many cases we just mutually understand it by context.
So if you want to sound natural, I recommend you to cut out all the “I” unless it’s necessary.
Well, good luck for your study anyways! Keep learning :) これからも頑張ってください！