To do that, you have to create your own CurrencyUpDown control, and derive it from NumericUpDown.
1) Create a CustomControl called CurrencyUpDown
2) At the top of the Solution Explorer pane, click "Show all files".
3) Open the CurrencyUpDown branch of your project, and double click "CurrencyUpDown.Designer.vb"
4) Change the Inherits line from UserControl to NumericUpDown
5) Save and close the file.
6) Go to the Code view for the control, and add an override method:
Protected Overrides Sub UpdateEditText()
Text = CultureInfo.CurrentCulture.NumberFormat.CurrencySymbol & Value.ToString()
End Sub