csv - Python new-line character seen in unquoted field -



csv - Python new-line character seen in unquoted field -

i have big csv file (~5m) , i'm building social network graph out of it. next error:

new-line character seen in unquoted field - need open file in universal-newline mode?

i frankly don't understand means. realise there similar questions on site, solutions don't seem work me (at to the lowest degree implementation of these solutions).

is there way bypass it? alternatively, think line 1638373 faulty one, maybe it's easier erase line? appreciate it.

update:

my initial reader:

in_file=csv.reader(open('file.csv','rb'))

performs analyses (adds nodes , edges) until faulty line (i.e. line 1638373)

with dialect:

in_file=csv.reader(open('file.csv','rb'), dialect=csv.excel_tab)

disregards info in lines, , stops on different line (i.e. 9174)

lines in question:

496907337006067712,"2014-08-06 08:35:15","_krantenkoppen",2420112513,"nl",70858,242,373,9,"kranten koppen",7200,"amsterdam","het laatste krantenoverzicht op één plaats! http://www.krantenkoppen.eu","http://www.krantenkoppen.eu",0,"http://pbs.twimg.com/profile_images/445928980047085568/olhayrn2_normal.png","<a href=""http://twibble.io"" rel=""nofollow"">twibble.io</a>","",0.000000,0.000000,"herdenkingsliedjes voor vlucht mh17 http://t.co/vbzkpsn5t0 #nieuws",0,,,0,"",0,"medium", 496907336833699841,"2014-08-06 08:35:15","wan_botak89",44109734,"en",20147,236,213,0,"ridhwan",28800,"kuala lumpur","herbalife personal wellness coach herbalife consumer herbalife distributor herbalife lover","https://www.facebook.com/healthylifestyleherb?ref=hl",0,"http://pbs.twimg.com/profile_images/495128462894436352/q-gkjnrj_normal.jpeg","<a href=""http://twitter.com/download/android"" rel=""nofollow"">twitter android</a>","kuala lumpur",0.000000,0.000000,"rt @suara_generasi: reply dr mahathir (malaysia ex-prime minister) hanan, israeli gaza - http://t.co/9zspgx1ueb",496900309411581953,,,0,"",0,"medium", 496907338612080640,"2014-08-06 08:35:16","fossforescent",2525009367,"en",5096,71,76,2,"fossfore",0,"","some form of conscious matter yet unexplored content. eager human.","",0,"http://pbs.twimg.com/profile_images/483912213992701952/dik-fnhi_normal.jpeg","<a href=""https://twitter.com/download/android"" rel=""nofollow"">twitter android tablets</a>","",0.000000,0.000000,"rt @federal_reverse: heartfelt letter dutch professor putin: http://t.co/kkmjubb4rl re #mh17 syrian arab republic ukraine &amp; western vilification! …",496878698125996032,,,0,"",0,"medium",

python csv

Comments

Post a Comment

Popular posts from this blog

Delphi change the assembly code of a running process -

Delphi change the assembly code of a running process - i'm trying alter address 00741fa5 has push test.009e721c . alter push test.009e71c8 . procedure callback; asm force $9e71c8 end; procedure tform2.btn1click(sender: tobject); var ppid :dword; pprocess : cardinal; begin getwindowthreadprocessid(findwindow(nil,pchar('test')), @ppid); pprocess := openprocess(process_all_access, false, ppid); injectasm(pprocess, $741fa5, 10, integer(@callback), 0); end; here injectasm function (with error checking) function injectasm(process: longword; injectaddress, injectsize, codeaddress, codesize : integer): pointer; var csize, rsize : integer; replaced : array of byte; jmp : array [0..4] of byte; jmpaddress : integer; nopv : byte; : integer; nbr: ulong_ptr; begin //injectsize must equal or greater 5, because need space our //(far) jmp wwxxyyzz instruction //if there's no space, inject in place of few instructions if injectsize ...
Read more

json - Hibernate and Jackson (java.lang.IllegalStateException: Cannot call sendError() after the response has been committed) -

json - Hibernate and Jackson (java.lang.IllegalStateException: Cannot call sendError() after the response has been committed) - hello have problem hibernate , jackson. have 2 pojos @entity @table(name = "users") public class user implements serializable { static final long serialversionuid = 4235637833262722256l; @id @generatedvalue private int id; @column(name = "creation_date") private date creationdate; @column(name = "first_name") private string firstname; @column(name = "last_name") private string lastname; @version @column(name = "version") private int version; @column(name = "e_mail") private string email; @column(name = "enabled") private boolean enabled; @column(name = "login") private string login; @column(name = "password") private string password; @jsonmanagedreference("role") @onetomany(mappedby = "user", cascade = cascadetype.all,fetch = fetchtyp...
Read more

C++ 11 "class" keyword -

C++ 11 "class" keyword - i've started using c++ 11 little bit more , have few questions on special uses of class keyword. know it's used declare class, there's 2 instances have seen don't understand: method<class t>(); and class class_name *var; why precede typename keyword class in first example, , keyword pointer in sec example? that known elaborated type specifier , necessary when class name "shadowed" or "hidden" , need explicit. class t { }; // love of god don't t t; t t2; if compiler smart, give these warnings: main.cpp:15:5: error: must utilize 'class' tag refer type 't' in scope t t2; ^ class main.cpp:14:7: note: class 't' hidden non-type declaration of 't' here t t; ^ if class not defined, deed forwards declaration. for example: template <typename t> void method() { using type = typename t::value_type; } method...
Read more