Anybody know why stream reader not reading superscript characters(VB.NET)

Question

0.00/5 (No votes)

See more:

I am Using StreamReader to import data from Tab Delim Text file to a Data Table called Import Data. For some reasons none of the superScript characters are readable once its imported to the table.

For example If i have a ProductName value "Universal 360° Rotating Finger Ring Holder" in the text file, after import the value becomes like "Universal 360� Rotating Finger Ring Holder" It's same with other characters like " ® , ™ ".

Is there something to do with my code?

What I have tried:

Public Function FillData(ByVal Fpath As String) As Boolean
        Dim XRead As System.IO.StreamReader = New IO.StreamReader(FilePath)
        Dim XLine As String = Nothing
        Dim XSplitLine() As String
        Dim i As Integer = ImportedData.Rows.Count + 1
        Try
            XRead.ReadLine()
            XLine = XRead.ReadLine()
            Do Until XLine Is Nothing

                XLine = i & vbTab & XLine & vbTab & FilePath
                XSplitLine = XLine.Split(CType(vbTab, Char()))

                ImportedData.Rows.Add(XSplitLine)
                XLine = XRead.ReadLine
                i += 1
            Loop
            XRead.Close()

        Catch ex As Exception
            MessageBox.Show("Error")
            Return False
            Exit Function
        End Try

        Return True
    End Function

Posted 15-Oct-18 2:39am

Member 14000611

Updated 16-Oct-18 1:14am

Add a Solution

Comments

CHill60 15-Oct-18 8:47am

When creating the new streamreader define an encoding that recognises unicode values

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

CHill60 · Accepted Answer · 2018-10-16T01:15:00

I disagree with Solution 1. Quote from Encoding.Default Property (System.Text) | Microsoft Docs[^]

Quote:
Different computers can use different encodings as the default, and the default encoding can change on a single computer. If you use the Default encoding to encode and decode data streamed between computers or retrieved at different times on the same computer, it may translate that data incorrectly. In addition, the encoding returned by the Default property uses best-fit fallback to map unsupported characters to characters supported by the code page. For these reasons, using the default encoding is not recommended. To ensure that encoded bytes are decoded properly, you should use a Unicode encoding, such as UTF8Encoding or UnicodeEncoding. You could also use a higher-level protocol to ensure that the same format is used for encoding and decoding.

I would explicitly use

VB

Dim XRead As System.IO.StreamReader = New IO.StreamReader(FilePath, System.Text.Encoding.UnicodeEncoding)

For more information see Encoding Class (System.Text) | Microsoft Docs[^]