COMBINE sugar and cocoa in medium saucepan; stir. Gradually stir in 1/3 cup milk to make a smooth paste; stir in remaining milk.
WARM over medium heat, stirring constantly, until hot (do not boil). Remove from heat; stir in vanilla extract. Top with whipped cream or marshmallows, if desired, before serving.