To make sure that reviewers recieve an email notification that you answered them, do the following:
1. Enable the Email Notifications option in the App Settings Window:
2. Enter your email address in the window that pop-up, and then click "Enable":
3. After enabling email notifications, you can select the "Notify visitors about replies to their comments" option to achieve the requested behavior.