The Anniversary Update for Windows 10 has lots of improvements and tons of new features for you to enjoy. One of them being is the addition of badge icon for universal apps pinned to the Taskbar. You can’t turn icon badges on and off for individual apps but you can disable all badges if you wish.
On the left-hand side of the Personalization page, click taskbar.
On the right, scroll down a bit and turn off (or on) the “Show badges on taskbar buttons” toggle.
And you are done, you are now back to the normal taskbar you are more used to.
While it would be nice to control badges for individual apps–and we’re guessing that will be added eventually–at least you have the ability to turn badges off completely if, like many people, you find them distracting.