python - Broken Korean strings when reading DataFrame from CSV -



python - Broken Korean strings when reading DataFrame from CSV -

i korean user.

when read .csv file pandas dataframe, korean strings broken this: �����

english good.

input info sample:

unnamed: 0 �������� �������ε����� ��x��ǥ ��y��ǥ �����ڵ� ������ ����߻��������� ����Ǽ� �������� 0 165244 20131201 �ٻ�62175541 962170 1955410 331 �������� 1 2 18224.03

why korean text corrupted?

your text format unicode need decode utf-8 :

import csv def unicode_reader('your_file_name',delimiter='your_delimiter', **kwargs): spamreader = csv.reader('your_file_name',delimiter='your_delimiter', **kwargs) row in spamreader: yield [unicode(w, 'utf-8') w in row] reader = unicode_csv_reader(open('your_file_name')) tex in reader: print tex

python unicode pandas

Comments

Post a Comment

Popular posts from this blog

php - Edges appear in image after resizing -

php - Edges appear in image after resizing - i have implemented next function: private static function generatepicture($sizekey, $src, $initialwidth, $initialheight, $imagetype) { $destination = adimage::addsizekey($sizekey, $src); if (file_exists($destination)) { return; } $finalsize = adimage::$sizes[$sizekey]; $initialratio = $initialwidth / $initialheight; $finalratio = $finalsize["w"] / $finalsize["h"]; $newimage = imagecreatetruecolor($finalsize["w"], $finalsize["h"]); imagealphablending( $newimage, false ); imagesavealpha( $newimage, true ); $oldimage = imagecreatefromstring(file_get_contents($src)); if ($initialratio >= $finalratio) { $scale = $finalsize["h"] / $initialheight; $surpluss = abs($initialwidth - ($initialheight * $finalratio)); imagecopyresized($newimage, $oldimage, 0, 0, $surpluss / 2, 0, $finalsize["w"], $finalsize[&q
Read more

ios8 - iOS custom keyboard - preserve state between appearances -

ios8 - iOS custom keyboard - preserve state between appearances - i'm having performance problems custom keyboard i'm working on. loading words in spell correction tree takes quite bit of time. seems done each time keyboard appears - there way preserve state of keyboard? apps can suspend / resume etc - can't find documentation on how extensions, or if there's mechanism doing att all. thanks! you loading dictionary net or disk? first case nsuserdefaults, encoding (nscopying) options store info. can load in background. according docs, os typically kills extension process, so, think there no way prevent keyboard objects deallocation (you may utilize nskeydarchiver). ios8 ios-app-extension custom-keyboard
Read more

Delphi change the assembly code of a running process -

Delphi change the assembly code of a running process - i'm trying alter address 00741fa5 has push test.009e721c . alter push test.009e71c8 . procedure callback; asm force $9e71c8 end; procedure tform2.btn1click(sender: tobject); var ppid :dword; pprocess : cardinal; begin getwindowthreadprocessid(findwindow(nil,pchar('test')), @ppid); pprocess := openprocess(process_all_access, false, ppid); injectasm(pprocess, $741fa5, 10, integer(@callback), 0); end; here injectasm function (with error checking) function injectasm(process: longword; injectaddress, injectsize, codeaddress, codesize : integer): pointer; var csize, rsize : integer; replaced : array of byte; jmp : array [0..4] of byte; jmpaddress : integer; nopv : byte; : integer; nbr: ulong_ptr; begin //injectsize must equal or greater 5, because need space our //(far) jmp wwxxyyzz instruction //if there's no space, inject in place of few instructions if injectsize &
Read more