python - Pdf to txt from http request -



python - Pdf to txt from http request -

i have set of links pdf files:

https://www.duo.uio.no/bitstream/10852/9012/1/oppgave-2003-10-30.pdf

some of them restricted, meaning won't able access pdf file, while others go straight pdf file itself, link above.

i'm using requests bundle (python) access files, there far many files me download, , don't want files in pdf.

what go each link, check if link pdf file, download file (if necessary), turn txt file, , delete original pdf file.

i have shell script pdf txt converter, possible run shell script python?

kieran bristow has answered part of question how run external programme python.

the other part of question selectively downloading documents checking whether resource pdf document. unless remote server offers alternate representations of documents (e.g. text version), need download documents. avoid downloading non-pdf documents can send initial head request , @ reply headers determine content-type this:

import os.path import requests session = requests.session() url in [ 'https://www.duo.uio.no/bitstream/10852/9012/1/oppgave-2003-10-30.pdf', 'https://www.duo.uio.no/bitstream/10852abcd/90121023/1234/oppgave-2003-10-30.pdf']: try: resp = session.head(url, allow_redirects=true) resp.raise_for_status() if resp.headers['content-type'] == 'application/pdf': resp = session.get(url) if resp.ok: open(os.path.basename(url), 'wb') outfile: outfile.write(resp.content) print "saved {} file {}".format(url, os.path.basename(url)) else: print 'get request url {} failed http status "{} {}"'.format(url, resp.status_code, resp.reason) except requests.httperror exc: print "head failed url {} : {}".format(url, exc)

python shell http pdf converter

Comments

Post a Comment

Popular posts from this blog

c - Compilation of a code: unkown type name string -

c - Compilation of a code: unkown type name string - i have next lines of code compiler says following: "unknown type name 'string'" both in declaration , definition of function. can tell me what's wrong? thanks. #include <stdio.h> #include <stdlib.h> #include <string.h> void frecognizeclient(string *actualclient) there no string type in c. need utilize array so: char array[10]; then can pass in function: void frecognizeclient(char *actualclient); c arrays string compilation
Read more

java - Bypassing "final local variable defined in an enclosing type" -

java - Bypassing "final local variable defined in an enclosing type" - i'm writing programme , i'm getting "the final local variable asd cannot assigned, since it's defined in enclosing type". i provide illustration not code produces error aswell. have arraylist utilize later (if define within button can't utilize later on), outside of button, pressing button should give values arraylist. in illustration "create new arraylist" cause same problem. button btn = new button("asd"); final arraylist asd = new arraylist(); btn.setonaction(new eventhandler<actionevent>() { public void handle(final actionevent event) { asd = new arraylist(); //here's error.. } }); clear arraylist , add together values. java javafx
Read more

json - Hibernate and Jackson (java.lang.IllegalStateException: Cannot call sendError() after the response has been committed) -

json - Hibernate and Jackson (java.lang.IllegalStateException: Cannot call sendError() after the response has been committed) - hello have problem hibernate , jackson. have 2 pojos @entity @table(name = "users") public class user implements serializable { static final long serialversionuid = 4235637833262722256l; @id @generatedvalue private int id; @column(name = "creation_date") private date creationdate; @column(name = "first_name") private string firstname; @column(name = "last_name") private string lastname; @version @column(name = "version") private int version; @column(name = "e_mail") private string email; @column(name = "enabled") private boolean enabled; @column(name = "login") private string login; @column(name = "password") private string password; @jsonmanagedreference("role") @onetomany(mappedby = "user", cascade = cascadetype.all,fetch = fetchtyp...
Read more