Go to settings and check off ‘show actions bar by default for comments’

For some reason the default is to NOT show the reply button to individual comments resulting in you needing to long press the comment to unhide the reply button.