Is there a way to turn of notifications for replies?

Which client do you use?

Well, let's see. Did you get this as a notification? If so, I am sorry to inform you you haven't found a way yet :)

You can block notifications from the app in your phones settings.