Well you can’t exactly remove the Apps, but it turns out that you can hide them. Just go to:

Settings > General > Parental Controls

As you scroll down you will see every App with the ability to hide it.