Click here to Skip to main content

Submit your article

UTF-8

UTF-8

Great Reads

A custom string to handle UTF8 natively in C#

by Pascal Ganaye

A custom C# string implementation that stores its data in a UTF8 byte array.

Setting NLS_LANG Value for Oracle

by WernfriedD

How to set NLS_LANG value for Oracle to support all special characters you need in your language/application.

Doing UTF-8 in Windows

by Mircea Neacsu

This is (yet another!) article on how to handle UTF-8 encoding on a platform that still encourages the UTF-16 encoding.

Tracking Microsoft Solutions (a Newer SCM tool)

by sbarnes

A small utility that feature-creeped into Yet Another SCM tool - a useful app to examine

Latest Articles

Doing UTF-8 in Windows

by Mircea Neacsu

This is (yet another!) article on how to handle UTF-8 encoding on a platform that still encourages the UTF-16 encoding.

Simple UTF library for C++

by Devatrun

This is a project about a C++ header-only library that fills the C++17 standard gap in support for Unicode strings. The library was created to work exclusively with Unicode, without support for other encodings.

Unicode / Creating, Writing, Appending / a text (*.txt) File

by Member 15078716

Unicode / Creating, Writing, Appending / a text (*.txt) file - how to do it

Setting NLS_LANG Value for Oracle

by WernfriedD

How to set NLS_LANG value for Oracle to support all special characters you need in your language/application.

All Articles

UTF-8

MultiByteToWideChar WINE vs Win32 not returning same result!?

21 Jan 2015 by Jochen Arndt

Both handling is compliant. The Unicode specs allow signaling an error, removing the invalid code, or replacing it with a replacement character (usually the U+FFFD REPLACEMENT CHARACTER).If you need identical behaviour you can try to use the MB_ERR_INVALID_CHARS flag. Then the function calls...

How to get exact UTF8 string in C#

23 Sep 2014 by Sergey Alexandrovich Kryukov

There is no such thing as "UTF string" per se. String in .NET is always a Unicode string, never anything else.If you have a string and encode it as UTF (any UTF), it's the array of bytes. Different encodings can give you different bytes from the same string. Unicode defines one-to-one...

A custom string to handle UTF8 natively in C#

16 Dec 2011 by Pascal Ganaye

A custom C# string implementation that stores its data in a UTF8 byte array.

Escaping URI data string in particular encoding

19 Mar 2013 by Sergey Alexandrovich Kryukov

I cannot be sure that what I suggest will work, because this situation with your gateway looks quite pathological to me.However, I strongly suspect that you simply have to percent-encode all characters beyond ASCII with and pass all characters with ASCII subset (up to code point 127) as is....

Convert utf-16 to utf-8 in C

4 Dec 2015 by Kobayashi Porcelain

I have a university assignment i need some help with. Don't give me the solution; hints or small portions of code would be appreciated.So, my university project is all about unicode. To be exact, I have to write code that takes character input in utf-16 format, converts it to utf-8 and...

Convert utf-16 to utf-8 in C

4 Dec 2015 by Sergey Alexandrovich Kryukov

First, you did not show how your objects named char… are declared. You need to do all the calculations on 32-bit unsigned integer; in other cases, the size would be not enough to represent a code point beyond BMP.I did not check up UTF16 part, but at least one part is missing: there...

How do I make my C# application stop showing question mark

10 Jul 2017 by RickZeeland

Make sure you use NVARCHAR() instead of VARCHAR() (I assume your are using SQL Server), this is necessary for storing Unicode characters. Internally C# always uses Unicode, 2 bytes for every character, unless you specify otherwise with Encoding, see: Encoding Class (System.Text)[^] Also see...

Include a BOM (byte order mark) utf-8 the saved text (unicode)

27 Jun 2022 by merano99

For UTF-8 you code this: DWORD dwBytesWritten = 0; BOOL bErr = 0; TCHAR *fname = TEXT("A_Unicode_WriteSTuff_天_file.txt"); HANDLE hFile = CreateFile(fname, GENERIC_READ | GENERIC_WRITE, 0, NULL, CREATE_ALWAYS, FILE_ATTRIBUTE_NORMAL, NULL);...

Setting NLS_LANG Value for Oracle

10 Jan 2016 by WernfriedD

How to set NLS_LANG value for Oracle to support all special characters you need in your language/application.

Reading characters from UTF-8 Encoded File

6 Jan 2012 by DrBones69

Maybe this article will get you started in the right direction.

Detect UTF-8 double-byte characters

11 May 2012 by 0ddball

After hours of looking and finally desperately posting it on here I think I found the solution at http://msdn.microsoft.com/en-us/library/system.globalization.stringinfo.aspx[^]Thanks anyway though!

convert utf8 string to unicode - VB.NET

20 Jun 2013 by TnTinMn

You have a downloaded text file in UTF-8 format. You must you have read the file to get that string. So why not set the encoding when you read it and let reader do the conversion?' set monospaced fontTextBox1.Font = New System.Drawing.Font("DejaVu Sans Mono", 10, _ ...

Unknown character in UTF-8 encoded text

4 Dec 2013 by Pascal-78

I think your sequence C3 83 EF BF BF is the result of an other UTF8 encoding with the "ANSI" sequence C3 BC.Let me explain:1) when trying to convert char C3 to UTF8, you will get C3 832) if BC is not known in the CodePage, the Unicode result might be FF FF3) Encoding to UTF8 the...

Converting from iso-8859-1 to UTF-8

6 Apr 2015 by Jochen Arndt

The message is encoded according to RFC 2047[^]. The encoding mechanism from your example is Base64[^] (indicated by the 'B').If you don't want to use an additional library, you must write your own parser to get the code page and encoding ('B' for Base64 or 'Q' for quoted-printable) and decode...

Decrypt email in vb.net

21 Apr 2015 by Sergey Alexandrovich Kryukov

What make you thinking that the e-mail is encrypted? Hardly. If this is base64, it has nothing to do with "encryption".This is how you can work with it: https://msdn.microsoft.com/en-us/library/system.convert.frombase64string%28v=vs.110%29.aspx[^],see other base64 methods:...

how to store hindi text in mysql database using java program

6 Dec 2015 by Maciej Los

A set of articles about your issue: How to insert Unicode values to MySQL using Java[^]

How to convert byte to readable string in C#?

4 Mar 2019 by Richard MacCutchan

See Secure Password Authentication Explained Simply[^].

How to convert byte to readable string in C#?

4 Mar 2019 by OriginalGriff

What makes you think that a password is encrypted? It shouldn't be: that's insecure, nearly as bad as storing it in plain text. And System.Text.Encoding has nothing whatsoever to do with encryption - it's a translation, is all. Passwords should be hashed, not encrypted - specifically so thay...

C++ utf8 characters above 127 not showing properly

16 Jun 2020 by OriginalGriff

That's because the Console font doesn't support them - you would need to select a different font, which isn't trivial: Set font text in console application[^] This may help you select an appropriate font:...

Reading characters from UTF-8 Encoded File

9 Jan 2012 by Member 8540109

I try to read one by one character in the Unicode (utf-8) file, but I don't know how to read a single character. So can you tell me what is the easiest way to read a single character?

Reading characters from UTF-8 Encoded File

6 Jan 2012 by «_Superman_»

There are several options depending on the type of stream you're using like fgetc or ReadFile or fstream.>> etc.

Reading characters from UTF-8 Encoded File

7 Jan 2012 by Sergey Chepurin

After reading a good article referenced above by DrBones69, you can also use sample code from this thread: Read unicode file into wstring[^]

Reading characters from UTF-8 Encoded File

8 Jan 2012 by Jochen Arndt

Due to the fact that UTF-8 encoded characters have a variable length, you have to check each byte read. A possible solution (using file a file handle opened in binary mode) would be:typedef struct { int nLen; unsigned char cByte[6];} utf8char_t;// Read UTF-8 char into...

c++ :parse utf-8 file failed using expat library

15 Mar 2012 by shimmer8711

I have a strange problem when I parse utf-8 file using expat. The code can parse xml correctly in windows.(I test this usign vc6.0), But it cannot parse xml when i run the code in android. I don't know why, the code and the xml file is the same.For solving this problem, i did some tests:1....

c++ :parse utf-8 file failed using expat library

15 Mar 2012 by shimmer8711

sorry, the xml i didn't write before

c++ :parse utf-8 file failed using expat library

15 Mar 2012 by Richard MacCutchan

If the file is UTF-8 then chances are that the first three characters are the UTF-8 BOM sequence. These characters will not be removed when you fread() the data from the file, and I suspect the XML parser will not like them either. See the discussion of how to handle this situation in my tip...

Problem in displaying unicode displaying in Asp.net

2 Apr 2012 by mohammadghaderian.bp

HiI have a project that is developed by Asp.net(vb.net).This project is developed for Persian language.when I run it in Internet Explorer for testing it it show me Persian string in bad format.I set my web site in IIS and other PC network can see webforms right but in host my webforms...

Problem in displaying unicode displaying in Asp.net

8 Apr 2012 by AshishChaudha

try print your querystring in a label control...let me know if it helps..thanks

problem with converting text into UTF 8 in Flex

10 May 2012 by ashriv

Hi,I am facing a problem to convert text into UTF-8 encoding scheme in Flex. since the web-service which consumes this text, works only with UTF-8 encoding scheme. my text is:- "å, ä och" and it's equivalent UTF-8 string is :- "Ã¥, Ã¤ och"but I'm not able to get equivalent UTF-8...

Detect UTF-8 double-byte characters

11 May 2012 by Rob Philpott

Well, it sounds like you may already have a solution, but here are my thoughts, for what its worth.In .NET strings are represented as a collection of 2-byte unicode characters, the idea being that you can fit just about any set of letters into 16 bits. As such it shouldn't make any...

text conversion UTF-8 with c-language

17 Sep 2012 by younwoo

hi.i am jap student.i make marmalade game project.i have problem about Text Conversion ( to/from UTF8 ).do you have solution with c-language?very thanks. :)ps. i make function - only c versionoriginal...

text conversion UTF-8 with c-language

17 Sep 2012 by Mehdi Gholam

Start here : http://www.cl.cam.ac.uk/~mgk25/unicode.html[^]

WEB SERVICE.NET, Error parsing data with Encoding UTF-8

4 Oct 2012 by Rene Bustos

Hi.i have a problem with a Web ServiceRight now, i have a Web Service developed in .Net.And my client has a System Develop in Delphi.... the problem is this.when the client send me a Data with "ñ" or "´" or any special character this convert into a "??".I Search in google, about...

WEB SERVICE.NET, Error parsing data with Encoding UTF-8

10 Oct 2012 by Rene Bustos

Good afternoon,after a few days, which was able to find the error.the error was not in my web service, was in the customer's application.check my web.config and everything perfect. when I generate test data delivery .. all tests were successful .. but when the client sent the same data,...

Quoted Printable Encoding

16 Oct 2012 by Tweak90

Hello,i would like to ask you to help me with a very big problem i cant solve by myself...I need a quoted Printable encoder for CSharp that uses UTF-8 Charset.... Chikat Class cant help me cause:this string:abcdefghijklmnopqrstuvwxyz...

vb.net http post data in polish language messed up

2 Nov 2012 by amit_upadhyay

Hi iam using Encoding.UTF8.GetBytes(postData) to post my polish language content to my website database. But when i open the text in cpanel phpmyadmin i see different content (i say different because i see tonnes of garbage things).You see on pc side i am able to read and write polish...

vb.net http post data in polish language messed up

3 Nov 2012 by Sergey Alexandrovich Kryukov

UTF is just one of Unicode UTFs, one of the most practical one's in most cases, and standard de-factor for Internet and other uses. All UTFs represent 100% of all Unicode code point and have one-to-one correspondence but not trivial one. In Windows, presentation of Unicode stings in memory is...

Escaping URI data string in particular encoding

19 Mar 2013 by Matej Hlatky

Hello friends,I need to escape URI data string using ISO-8859-15 encoding.As I am using this code, the output is still escaped by using UTF-8 encoding, since Uri.EscapeDataString is internally using UTF-8 encoding.var srcEnc = Encoding.Unicode;var uniString = "This is a test £.";var...

Remove unicode characters from ISO encoded string in c#

28 May 2013 by Sergey Alexandrovich Kryukov

Please see my comment to the question. Your input can be in any encoding, but if your input is UTF-8, it potentially covers all the Unicode character repertoire. It means, that you should use only Unicode for further processing, nothing else. You can store the data in any of the UTFs, they all...

How to encode unicode in XLSX sheet ?

29 Jul 2013 by Jitendra Ku. Sahoo

Hi I have an application that generate xls sheet .But it is unable to render unocode character like Russian,Chinese correctly.How to set encoding here ?Is dere any other way to handle it .Thanks

How to encode unicode in XLSX sheet ?

29 Jul 2013 by Fredrik Bornander

A good tool for generating Excel sheet is the EPPlus library, which you can download from here; http://epplus.codeplex.com/[^]An example;using System.IO;// Reference EPPlus.dllusing OfficeOpenXml;namespace AccessExcelUnicodeTest { class Program { public static void...

Unknown character in UTF-8 encoded text

3 Dec 2013 by Nicholas Marty

I have a file which contains some data. That data is encoded in UTF-8 (without a BOM)Those bytes are usually no problem to handle. Yet know in that file there is a byte sequence I don't know what it should represent (neither could I find any information about it too)To examine the date I...

How to convert UTF16 string to UTF8?

20 May 2014 by Member 9664591

I create a XML file. It took but I want How i convert it?Here is my code.I update my code. Now please look it. And warning msg is DOMDocument::loadXML(): Document labelled UTF-16 but has UTF-8 content in...

How to convert UTF16 string to UTF8?

20 May 2014 by Kornfeld Eliyahu Peter

Quote: XmlWriterSettings.Encoding[^]The Encoding property only applies to the XmlWriter instances that are created either with the specified Stream or with the specified file name. If the XmlWriter instance is created with the specified TextWriter, the Encoding property is overridden by the...

ASP.Net-MVC Exporting to PNG Inkscape Unicode Character problem

8 Aug 2014 by Fatihx

i am trying to get Kendo Charts to png or pdf with Inkspace.But i have a problem with Chart's Title. I am using Turkish characters and i can't show Turkish characters on title section. How can i solve this problem?Thank you.Inkspace forum link with...

How to get exact UTF8 string in C#

24 Sep 2014 by Richard MacCutchan

See http://www.w3schools.com/jsref/jsref_decodeuri.asp[^].

How to Get exact unicode tring from website

24 Sep 2014 by Richard MacCutchan

Why have you reposted this, we have already expalined the issue to you at How to get exact UTF8 string in C#[^].

How to Get exact unicode tring from website

24 Sep 2014 by Sergey Alexandrovich Kryukov

Sigh… You need to stop being so stubborn and start learning how Unicode works, from the very beginning.In addition, to Solution 1, I have to explain how HTML entity works. I already tried to explain that Unicode standardized one-to-one correspondence between characters (taken as...

How to get exact UTF8 string in C#

24 Sep 2014 by Sergey Alexandrovich Kryukov

Your next question was recently auto-removed, due to some abuse reports. I'll answer again.In that question, you asked about HTML representation using HTML entities. One of the answers explained the API for entities. I added the explanation of the background: in my Solution 1 (on this page)...

MultiByteToWideChar WINE vs Win32 not returning same result!?

21 Jan 2015 by Tomice

I am converting utf8 to utf16/unicode and I want to get the same result under windows and linux.Note: "0xBF" is not valid utf8 character.c:char str[] = { 0xBF, 0 };MultiByteToWideChar(CP_UTF8, 0, str, nLen8, pszUtf16, nLen16);c#byte[] abCH = new byte[] { 0xBF };string str =...

MIME encoding to UTF-8 for a POP3 client

2 Apr 2015 by TAREK BAZINGA

Bonjour a tous.Je travaille sur une application Client POP3 pour récupérer quelques informations des courriers reçus sur une boite mail. Je veux récupérer l'objet des mails qui contiennent des caractères accentués comme é è à..., mais j'arrive pas a les lire en UTF-8, plutôt je reçois du...

Converting from iso-8859-1 to UTF-8

6 Apr 2015 by TAREK BAZINGA

Good morning everyone.I am writing a C++ application which tries to get some information from a mail box using POP3 protocol. The information I am trying to get contains French characters, means accentuated characters like "é, ç, à". I need to store this information in a MySQL database. To...

utf16 in unicode strings

22 May 2015 by Zon-cpp

Hi, In my VC++ project (that is set 'Use Unicode Character Set' for Character Set):I get a struct from a C# dll that is registered as .tlb .In this struct , I have some string members.I have problem to use this strings. MY_InterfacePtr Myi(__uuidof(MY_Class));InfoSTC...

How Do I Convert Excel Sheet Having Shivaji Fonts To Csv Having Google Unicode Utf-8 Encoding?

5 Aug 2015 by Dinesh92

I have an excel file which uses Shivaji fonts, I want to convert it to csv file using google's unicode utf-8 encoding. I have tried all the methods of this but i didn't get any result because when saving file as csv it shows ????? symbols while i need something like this: Ã Â¤ÂÃ Â¤â€¢Ã Â¤Å¸Ã...

How Can I Convert Excel Data Having Japanese Character Into Utf-8

30 Nov 2015 by EnterCodeWrld

how can i convert excel data having japanese character into utf-8

How Can I Convert Excel Data Having Japanese Character Into Utf-8

11 Dec 2015 by CHill60

This article[^] might help you, or possibly this forum post[^]

Opening a file with unicode path.

11 Feb 2016 by Marko Ilic

Hi every one, I come in need of big help. I have a file that I want to open but the problem is that the file can be in a UTF directory (path can be in a cyrilic or latin). So I did an extensive search, read and tried almost 10 stack solution but came out empty, at this point am really...

Opening a file with unicode path.

11 Feb 2016 by Marko Ilic

The problem was that I was saving the CPP file as ANSI... I had to convert it to UTF-8. I tried this before posting but VS 2015 turns it into ANSI, I had to change it in VS so I could get it working.I tried opening the cpp file with notepad++ and changing the encoding but when I turn on VS...

Opening a file with unicode path.

11 Feb 2016 by Jochen Arndt

This is mainly a solution to the question raised in solution 1.When a file is opened in an editor, that tries to identify the encoding. With Unicode files, there may be a Byte order mark - Wikipedia, the free encyclopedia[^]. If that is present, the editor knows the encoding.If there is...

Why is nsgmls parser giving error “character data not allowed here” for utf-8 encoded file ?

22 Feb 2016 by Member 12342624

nsgmls parser giving error for UTF-8 encoded file "Character Data Not Allowed Here"I am saving a file using the below function Public Function SavetoFile(ByVal p_sFileName As String, ByVal p_sMessage As String, ByVal p_sEncoding As String) As Boolean Dim oEncoding As...

Why is nsgmls parser giving error “character data not allowed here” for utf-8 encoded file ?

22 Feb 2016 by Jochen Arndt

You may compare the generated files from all methods using a text editor to see what is the difference (the nsgmls message should give you the line number).One point is that you are calling StartDocument() but not EndDocument().A probable error source may be the passed p_sMessage string...

Reading signed UTF-8 with streamreader - basestream position and returned length mismatch

9 Nov 2016 by Member 12786978

I am not new to coding, but I am a bit newbie to VB.netWhile experimenting with StreamReader in VB.net in .Net Framework 2, I noticed if when I try to read the file characters with UTF-8 encoding while keeping a wrapper integer for counting byte position, there is a mismatch that occurs at...

How to embedded chinese names (title, artist, year, genre and abum) in a mp3 file

11 Nov 2016 by Shaik Izaz

I am trying to embedded Chinese names (title, Artist, Year, Genre and Album) in a mp3 file. title names will be taken from a CSV file(which has Chinese data).The code is working but the when i check the mp3 files details, every thing is shown in '?????' this is happening only when the data...

Help with asian characters, encodings & viewers. Trying to write korean text to a file

19 Apr 2017 by Simon Langdon

I need to write Korean characters into a DXF file (that's an AutoCAD drawing file, it's not binary but text). Our customer has supplied us with a DXF file from a rival product that outputs Korean characters (when viewed in some viewers..) Now (AFAIK) there is no UTF or other header in their...

Help with asian characters, encodings & viewers. Trying to write korean text to a file

19 Apr 2017 by Simon Langdon

A bit more reading The Absolute Minimum Every Software Developer Absolutely, Positively Must Know About Unicode and Character Sets (No Excuses!) – Joel on Software[^][^] + Adding the UTF8-BOM characters helps the viewer see these characters as DBCS

How I do correct this PHP script?

10 May 2017 by Отабек Мансуров

This script is "insensitive" and when I enter "Pear" to response a give uncorrect result "Pupil". Ho do it work correct and convert result to utf-8? When I enter "Саша" in response i give result "???????" and not "Михаил" $data = 'Олег Саша Тимур they are students'; $search =...

regular-expression

960923 - converting a sequence of bytes into proper characters

14 Dec 2017 by ilostmyid2

I use this site to convert sequence of bytes like this: Ð Ð°Ð±Ñ‹Ð½Ð¸ into proper character sequences like this: Рабыни It seems that the site decodes the UTF8 sequences into their original characters. For some reason, some of my files names are corrupted and I need to convert them back to...

How do I convert a string with a UTF-8 code to plain text in java

18 Jul 2018 by Member 13917072

I have a string which contains "C3A1" which is the utf-8 equivalent of á How do I convert this to á in Java. What I have tried: I've tried some ways to parse it as a char but nothing's worked

How do I convert a string with a UTF-8 code to plain text in java

18 Jul 2018 by Jochen Arndt

If you have a byte array representing an UTF-8 string use the Java String constructor accepting a byte array and an encoding: String str = new String(utf8Bytes, "UTF-8"); If you really have a String object containing an UTF-8 string, you have to convert it first to a byte array: byte[] utf8Bytes...

From clr to mysql transfer data

1 Sep 2018 by Member 13969232

I have Database on localhost (xampp, mysql). I have some symbols cyrillics (russian symbols). All fields of database are setting as utf8mb4_general_ci. From Database I receive data to application CLR windows form (visual studio). It's work correctly. If I try change data at database from...

MySQL-Connector

C++ utf8 characters above 127 not showing properly

16 Jun 2020 by pvzzombs

I'm working in Window's console and it seems that window does not support utf-8 characters such as character 0x80 which is € but it the window console it shows blank. Note that I'm using wcout and I just want to show the correct character for...

Trying to save an email as HTML and PDF - encoding problem, keep having � , Â and \u2020

29 Oct 2020 by Member 14978731

I'm trying to write a program that will download my emails and save them as PDF. I've encountered a problem with encoding. I'm using the email and imaplib modules. When I use this method to write the file: part.get_payload(decode=True) I get an...

Read non-ASCII characters of TIFF tag values in java

11 Nov 2020 by Member 12213239

I am trying to read different tag values (like tags 259 (Compression), 33432 (Copyright), 306 (DateTime), 315 (Artist) etc.) from a TIFF image in Java 11. What I have tried: I tried with ImageIO like following: File tiffFile = new...

Read non-ASCII characters of TIFF tag values in java

9 Nov 2020 by Patrice T

Quote: Can anyone tell me how to get byte values of the tag, then decode it with utf-8 to get the exact tag values ? First, you need to understand that before unicode (DOS era), ascii codes between 128-255 where used for special chars and with...

UTF-8 encoding problem

20 Sep 2021 by User 15041314

Hi there, Now I have prepared validation processes by writing rest api. And I prepared a resource-bundle operation for each validation operation. However, when I send a query in the postman, some UTF-8 characters that I added in the...

I want t convert cstring to UTF8 and encrypt it with tobase64string

10 Nov 2021 by OriginalGriff

Base64 isn't encryption: it is translation, and is so easy to reverse that it's doesn't count as encryption in any shape, form, or manner. If you want to convert text to Base64 it's pretty trivial as a simple google will show: Base64 C++ -...

Include a BOM (byte order mark) utf-8 the saved text (unicode)

28 Jun 2022 by Member 15078716

QUESTION: How do I write the file contents with a BOM? __________ Using CodeBlocks 17.12 / GCC 5.1 / Microsoft Windows XP . From my previous question on page Save file with unicode string in old windows system[^] "Quote: If I want to update...

How to store emojis in a mysql table? Tried everything...

11 Feb 2023 by Graeme_Grant

Here is a list of the EMOJI codes: Full Emoji List, v15.0[^] Here is one solution: How to store Emoji Character in MySQL Database - StackOverflow[^]

How to store emojis in a mysql table? Tried everything...

11 Feb 2023 by diadon2

Hi, I have a CSV file containing tweets with emojis (eg. "Cool! 💕") and I need to import them into a MySQL table in such a way they will be saved/displayed correctly... What do I have to set up and how for a correct import (I mean collation,...

Doing UTF-8 in Windows

9 Oct 2023 by Mircea Neacsu

This is (yet another!) article on how to handle UTF-8 encoding on a platform that still encourages the UTF-16 encoding.

Tracking Microsoft Solutions (a Newer SCM tool)

13 Feb 2014 by sbarnes

A small utility that feature-creeped into Yet Another SCM tool - a useful app to examine

Simple UTF library for C++

5 Oct 2022 by Devatrun

This is a project about a C++ header-only library that fills the C++17 standard gap in support for Unicode strings. The library was created to work exclusively with Unicode, without support for other encodings.

Detect UTF-8 double-byte characters

11 May 2012 by 0ddball

I'm seriously struggling to parse a line from a UTF-8 file into an array of strings.My file has content:Gȯrecki John12345678901234The first name "John" starts at the 10th position. (Here the 2nd character is UTF-8 U+022F.)In code I need to do LineRead.Substring(11,4)to get "John",...

How to Get exact unicode tring from website

24 Sep 2014 by Thomas Daniels

ë is an HTML Entity[^]. The Html Agility Pack has a HtmlEntity class, which contains a DeEntitize method. You can use this one here.string deEntitized = HtmlAgilityPack.HtmlEntity.DeEntitize(yourString);If yourString is "Sarandë", deEntitized will contain "Sarandë".

SmtpClient charset trouble

25 Nov 2015 by Member 11266633

I have code that send message to purpose email. When i run program from Windows - charset work correctly. But when i run this app in Linux VDS (Centos) charset incorrect - example �� . Message on cyrillic. I try make charset utf-8, but it also not workSmtpClient smtp = new...

How to convert UTF16 string to UTF8?

20 May 2014 by lukeer

Use the XmlWriterSettings.Encodeing property to use the encoding you want:{ XmlWriterSettings xws = new XmlWriterSettings(); xws.Indent = true; xws.Encoding = Encoding.UTF8; // ...}This will cause your application to write UTF-8 encoded XML.But UTF-8 already is the...

Unicode / Creating, Writing, Appending / a text (*.txt) File

1 Jul 2022 by Member 15078716

Unicode / Creating, Writing, Appending / a text (*.txt) file - how to do it

convert utf8 string to unicode - VB.NET

20 Jun 2013 by g77777

Hello good people, As the title says - I have a Non-English string I got from the web (by URLDownloadToFile())and I am trying to convert it to a readable, MySQL friendly, Unicode. This is the code I found in the MSDN but somehow it fails to do the work for me (strLine is the input string)....

How to get exact UTF8 string in C#

24 Sep 2014 by ductuan_itpro

I have a UTF8 string ('Sarandë')I want to get it exactly but I only get this tring ('Sarandë')I try to use Encoding with some Internet's example. But they are not working.Pls help.Detail: I want to get string value ('Sarandë') on website and add to sqlite database.My field type is...

Remove unicode characters from ISO encoded string in c#

28 May 2013 by Ruthra vijayakumar

I have a data whose encoding format is in UTF-8.While converting the UTF-8 data to ISO,certain characters gets broken. I need to remove all the unicode broken characters present in the ISO encoded data.I would like to do this in c#.Please suggest some solution.Current code is as...

convert utf8 string to unicode - VB.NET

20 Jun 2013 by Marc A. Brown

Take a look at this[^]. The guy was originally doing pretty much what you are trying with poor results but his answer seems to have solved his problem. Now, his code is in C#, but you should be able to convert it easily enough.Here's the code from the post:private byte[]...

Converting to jsonString

30 Nov 2013 by 78ATI

Hi,I am trying to convert a list to a json sting, that contains a series of Chinese characters. But instead of seeing the actual Chinese text, I am seeing [???]. Is there a way to avoid that?Thank you.

Converting to jsonString

1 Dec 2013 by Abhinav S

Its best to use unicode encoding - http://tools.ietf.org/html/rfc4627#section-3[^].

How to convert UTF16 string to UTF8?

20 May 2014 by Bernhard Hiller

Response.Write(sr.ToString());...

Decrypt email in vb.net

21 Apr 2015 by oronsultan

hey guys,about a year ago i developed a program to my comapny that extract customers call from our website, decrypt it and pushed it to our internel software and from ther to the support department.here the problem: during the last week, my basic assumption is that our server did some...

how to store hindi text in mysql database using java program

5 Dec 2015 by Akash gods

i can store the hindi text using MySQL database wihtin database.but when im using same process to store data into MySQL with java programit showing ??????? marks.How to store hindi text कंप्यूटर in mySQL using java program?

How do I make my C# application stop showing question mark

10 Jul 2017 by Member 12982342

I start to make a project using c# language and it's done now i want to test it on another pc runnig windows 10 but it show's perisian letter az '?' and it save the data to data base again with '?' how to fix this? please help me What I have tried: create table and data base in utf 8

How do I convert a string with a UTF-8 code to plain text in java

18 Jul 2018 by Patrice T

Quote: How do I convert this to á in Java. As is, this is non sense. As 'á' is not ASCII, you need to understand a few things: - what is ascii code - what is ascii with codepages - what is UTF encoding and UTF8 - you need to understand how Java handle char encoding. Then you will decide what...

How to convert byte to readable string in C#?

4 Mar 2019 by Michelle Anne Rigor

foreach (DataRow row in dt.Rows) { username = row["USERNAME"].ToString(); byte[] bytePassword = (byte[])row["PASSWORD"]; decryptPassword = Encoding.Default.GetString(bytePassword, 0, bytePassword.Length-1); password = row["PASSWORD"].ToString(); } string result...

I want t convert cstring to UTF8 and encrypt it with tobase64string

10 Nov 2021 by a_alise

In C# We Have This Below : private string Base64Encode(string plainText) { var plainTextBytes = System.Text.Encoding.UTF8.GetBytes(plainText); return System.Convert.ToBase64String(plainTextBytes); } How I Will Do It In VC++ 6.0 ...