English Question?

You're correct. "Began" is past tense, "begun" is the present participle. When using the word "have" you need to use "begun".