Hello!

If I understand correctly, you would like to deduct points for users' activity. If so then yes - you can set negative points values for voting and any other available actions, i.e. just put minus sign before points value.