Hi,
Actually you don't have to enter the phone settings to do so. Just switch status to one that has configured PUSH notifications=OFF (eg DND) and close the app as you would close any other app on your phone.
Doing this the app won't be running in the background, PUSH notifications won't be...