Hướng dẫn php utf8_decode question mark

kode68 ¶

6 years ago

Update Answer from okx dot oliver dot koenig at gmail dot com for PHP 5.6 since e/ modifier is depreciated

// This finally helped me to do the job, thanks to Blackbit, had to modify deprecated ereg:
// original comment: "Squirrelmail contains a nice function in the sources to convert unicode to entities:"

function charset_decode_utf_8[$string]
    {
        /* Only do the slow convert if there are 8-bit characters */
        if [ !preg_match["/[\200-\237]/", $string] && !preg_match["/[\241-\377]/", $string] ]
               return $string;

        // decode three byte unicode characters
          $string = preg_replace_callback["/[[\340-\357]][[\200-\277]][[\200-\277]]/",
                    create_function ['$matches', 'return \'&#\'.[[ord[$matches[1]]-224]*4096+[ord[$matches[2]]-128]*64+[ord[$matches[3]]-128]].\';\';'],
                    $string];

        // decode two byte unicode characters
          $string = preg_replace_callback["/[[\300-\337]][[\200-\277]]/",
                    create_function ['$matches', 'return \'&#\'.[[ord[$matches[1]]-192]*64+[ord[$matches[2]]-128]].\';\';'],
                    $string];

        return $string;
    }

Enjoy

visus at portsonline dot net ¶

15 years ago

Following code helped me with mixed [UTF8+ISO-8859-1[x]] encodings. In this case, I have template files made and maintained by designers who do not care about encoding and MySQL data in utf8_binary_ci encoded tables.

php-net at ---NOSPAM---lc dot yi dot org ¶

16 years ago

I've just created this code snippet to improve the user-customizable emails sent by one of my websites.

The goal was to use UTF-8 [Unicode] so that non-english users have all the Unicode benefits, BUT also make life seamless for English [or specifically, English MS-Outlook users].  The niggle: Outlook prior to 2003 [?]  does not properly detect unicode emails.  When "smart quotes" from MS Word were pasted into a rich text area and saved in Unicode, then sent by email to an Outlook user, more often than not, these characters were wrongly rendered as "greek".

So, the following code snippet replaces a few strategic characters into html entities which Outlook XP [and possibly earlier] will render as expected.  [Code based on bits of code from previous posts on this and the htmlenties page]


rasmus at flajm dot se ¶

17 years ago

If you don't have the multibyte extension installed, here's a function to decode UTF-16 encoded strings. It support both BOM-less and BOM'ed strings, [big- and little-endian byte order.]

thierry.bo # netcourrier point com ¶

17 years ago

In response to fhoech [22-Sep-2005 11:55], I just tried a simultaneous test with the file UTF-8-test.txt using your regexp, 'j dot dittmer' [20-Sep-2005 06:30] regexp [message #56962], `php-note-2005` [17-Feb-2005 08:57] regexp in his message on `mb-detect-encoding` page [//us3.php.net/manual/en/function.mb-detect-encoding.php#50087] who is using a regexp from the W3C [//w3.org/International/questions/qa-forms-utf-8.html], and PHP mb_detect_encoding function.

Here are a summarize of the results :

201 lines are valid UTF8 strings using phpnote regexp
203 lines are valid UTF8 strings using j.dittmer regexp
200 lines are valid UTF8 strings using fhoech regexp
239 lines are valid  UTF8 strings using using mb_detect_encoding

Here are the lines with differences [left to right, phpnote, j.dittmer and fhoech] :

Line #70 : NOT UTF8|IS UTF8!|IS UTF8! :2.1.1 1 byte [U-00000000]: ""
Line #79 : NOT UTF8|IS UTF8!|IS UTF8! :2.2.1 1 byte [U-0000007F]: ""
Line #81 : IS UTF8!|IS UTF8!|NOT UTF8 :2.2.3 3 bytes [U-0000FFFF]: "￿" |
Line #267 : IS UTF8!|IS UTF8!|NOT UTF8 :5.3.1 U+FFFE = ef bf be = "￾" |
Line #268 : IS UTF8!|IS UTF8!|NOT UTF8 :5.3.2 U+FFFF = ef bf bf = "￿" |

Interesting is that you said that your regexp corrected j.dittmer regexp that failed on 5.3 section, but it my test I have the opposite result ?!

I ran this test on windows XP with PHP 4.3.11dev. Maybe these differences come from operating system, or PHP version.

For mb_detect_encoding I used the command :

mb_detect_encoding[$line, 'UTF-8, ISO-8859-1, ASCII'];

punchivan at gmail dot com ¶

14 years ago

EY! the bug is not in the function 'utf8_decode'. The bug is in the function 'mb_detect_encoding'. If you put a word with a special char at the end like this 'accentué', that will lead to a wrong result [UTF-8] but if you put another char at the end like this 'accentuée' you will get it right. So you should always add a ISO-8859-1 character to your string for this check. My advise is to use a blank space.
I´ve tried it and it works!

function ISO_convert[$array]
{
    $array_temp = array[];

         foreach[$array as $name => $value]
    {
        if[is_array[$value]]
          $array_temp[[mb_detect_encoding[$name." ",'UTF-8,ISO-8859-1'] == 'UTF-8' ? utf8_decode[$name] : $name ]] = ISO_convert[$value];
        else
          $array_temp[[mb_detect_encoding[$name." ",'UTF-8,ISO-8859-1'] == 'UTF-8' ? utf8_decode[$name] : $name ]] = [mb_detect_encoding[$value." ",'UTF-8,ISO-8859-1'] == 'UTF-8' ? utf8_decode[$value] : $value ];
    }

    return $array_temp;
}

luka8088 at gmail dot com ¶

15 years ago

simple UTF-8 to HTML conversion:

function utf8_to_html [$data]
    {
    return preg_replace["/[[\\xC0-\\xF7]{1,1}[\\x80-\\xBF]+]/e", '_utf8_to_html["\\1"]', $data];
    }

function _utf8_to_html [$data]
    {
    $ret = 0;
    foreach[[str_split[strrev[chr[[ord[$data{0}] % 252 % 248 % 240 % 224 % 192] + 128] . substr[$data, 1]]]] as $k => $v]
        $ret += [ord[$v] % 128] * pow[64, $k];
    return "&#$ret;";
    }

Example:
echo utf8_to_html["a b č ć ž こ に ち わ [][]{}!#$?*"];

Output:
a b č ć ž こ に ち わ [][]{}!#$?*

j dot dittmer at portrix dot net ¶

17 years ago

The regex in the last comment has some typos. This is a
syntactically valid one, don't know if it's correct though.
You've to concat the expression in one long line.

^[
[\x00-\x7f]|
[\xc2-\xdf][\x80-\xbf]|
[\xe0][\xa0-\xbf][\x80-\xbf]|
[\xe1-\xec][\x80-\xbf]{2}|
[\xed][\x80-\x9f][\x80-\xbf]|
[\xee-\xef][\x80-\xbf]{2}|
[\xf0][\x90-\xbf][\x80-\xbf]{2}|
[\xf1-\xf3][\x80-\xbf]{3}|
[\xf4][\x80-\x8f][\x80-\xbf]{2}
]*$

haugas at gmail dot com ¶

14 years ago

If you don't know exactly, how many times your string is encoded, you can use this function:

Ajgor ¶

15 years ago

small upgrade for polish decoding:

function utf82iso88592[$text] {
$text = str_replace["\xC4\x85", 'ą', $text];
$text = str_replace["\xC4\x84", 'Ą', $text];
$text = str_replace["\xC4\x87", 'ć', $text];
$text = str_replace["\xC4\x86", 'Ć', $text];
$text = str_replace["\xC4\x99", 'ę', $text];
$text = str_replace["\xC4\x98", 'Ę', $text];
$text = str_replace["\xC5\x82", 'ł', $text];
$text = str_replace["\xC5\x81", 'Ł', $text];
$text = str_replace["\xC3\xB3", 'ó', $text];
$text = str_replace["\xC3\x93", 'Ó', $text];
$text = str_replace["\xC5\x9B", 'ś', $text];
$text = str_replace["\xC5\x9A", 'Ś', $text];
$text = str_replace["\xC5\xBC", 'ż', $text];
$text = str_replace["\xC5\xBB", 'Ż', $text];
$text = str_replace["\xC5\xBA", 'ż', $text];
$text = str_replace["\xC5\xB9", 'Ż', $text];
$text = str_replace["\xc5\x84", 'ń', $text];
$text = str_replace["\xc5\x83", 'Ń', $text];

return $text;
} // utf82iso88592

yannikh at gmeil dot com ¶

16 years ago

I had to tackle a very interesting problem:

I wanted to replace all \xXX in a text by it's letters. Unfortunatelly XX were ASCII and not utf8. I solved my problem that way: