There's nothing special about this. When you Remove the record from EF it's just TAGGED to be deleted. It won't be deleted from the database until you call SaveChanges on your DbContext.
So, if you don't want the record to be removed, just change its state back to Unchanged:
myDbContext.Entry(myEntityObject).State = EntityState.Unchanged
But, you've got a bigger problem in your logic. Why are you even "deleting" the record unless you have confirmed that it needs to be deleted?