Well you can’t exactly remove the Apps, but it turns out that you can hide them. Just go to:
Settings > General > Parental Controls
As you scroll down you will see every App with the ability to hide it.
Source: http://finerthings.in/featured/apple-tv-hide-apps
