Is there a way to delete other people's votes from my own stories?
Deleting votes
I could be wrong but I think using the Blocked Users feature in your stories advanced options can remove other people's roles and votes.
Go to “Edit Story” and add the users in question to the blocked list.