Add a button the same way you have added the textbox. What difficulty are you having?
$('.deleteButton').click(function()
{
var parent = $(this).parent();
parent.empty();
});
This adds a click event handler to the delete button which will get the parent element, the p tag in this case, and empty all elements in it.