Cannot cancel an up/a down vote on a comment

Currently after the user has up or down voted a comment, that cannot be cancelled. It should be possible for the users to cancel their actions due to misclicks. The current functionality can lead to unintended visibility for a comment that may not deserve it (or the other way around).