The default apps that come pre-installed on iOS can't be removed without jail-breaking. There are a few default Apple Apps (Stocks & Weather) that I never use so I put them in a folder out of the way but Newsstand doesn't let you do that as technically Newsstand is a folder.
Thankfully someone has already come up with a workaround to put Newsstand in a folder that doesn't require you to jail-break your device. I have read instructions on many different websites and watched a few videos and have chosen the best video to demonstrate the workaround in action.
