Combine first 5 ingredients in a small bowl, stirring to form a streusel. Set aside.
Mash your sweet potatoes in a large bowl. Stir in 1 cup streusel, granulated sugar, vanilla, egg white, and milk. Spoon into a 2-quart casserole coated with cooking spray; top with remaining streusel. Bake at 350° for 45 minutes.