 |
 |
PS: for the extraction of URLs (e.g., links to PDFs), then yes, I would use, for instance iMacros Extract command (for a quick GUI solution, interactive solution -- else would go fo some python or PHP script) https://wiki.imacros.net/Data_Extraction E.g., there demo macro (again, on Chrome): TAB T=1 URL GOTO=http://demo.imacros.net/Automate/Extract2 TAG POS=1 TYPE=A ATTR=TXT:H*links* EXTRACT=HREF Extracts the URL found on this page (and then can be downloaded to, using ONDOWNLOAD) -----Original Message----- From: Filipe Bento (UA) <[log in to unmask]> Sent: 15 December 2022 15:07 To: 'Code for Libraries' <[log in to unmask]> Subject: RE: [CODE4LIB] batch download Is iMacros extension a possibility? Even better, and just looked for this: https://chrome.google.com/webstore/detail/chrono-download-manager/mciiogijeh kdemklbdcbfkefimifhecn/related (Chrome, but I guess available for other browsers) Simply copy the URLs (to the clipboard, remove any blank space before or after each of them), go back to the extension, create a new task, and the URL field should be populated with those copied URLs. "Start", and watch the magic happens. Hope this is what is needed (if I understood it correctly). Filipe ---------------- Please note that if I am emailing outside of office hours, this is for my convenience and I do not expect a reply ____________________________________________________________________________ ____________________________________________________________________________ ________________ Dr Filipe Bento (PhD, MSc, Eng) BL Labs Technical Lead Landline: +44 (0)20 7412 7925 Mobile: +44 (0)74 2654 8167 https://wa.me/351927992378 https://www.bl.uk/people/experts/filipe-bento ORCID: https://orcid.org/0000-0001-8135-2304 British Library Labs The British Library, St Pancras, Ldn, NW1 2DB Email: [log in to unmask] Twitter: @BL_Labs Web: http://labs.bl.uk For Living With Machines project related: [log in to unmask] (The Alan Turing Inst.) -----Original Message----- From: Code for Libraries <[log in to unmask]> On Behalf Of Eric Lease Morgan Sent: 15 December 2022 14:26 To: [log in to unmask] Subject: [CODE4LIB] batch download How can I use the Firefox, Chrome, and/or Safari Web browsers to batch download the content found at the other end of a list of URLs? Suppose I have a list of URLs, for example: https://distantreader.org/stacks/journals/crl/crl-11730.pdf https://distantreader.org/stacks/journals/ital/ital-5777.pdf https://distantreader.org/stacks/journals/ital/ital-5582.pdf https://distantreader.org/stacks/journals/ital/ital-4657.pdf https://distantreader.org/stacks/journals/crl/crl-9927.pdf https://distantreader.org/stacks/journals/crl/crl-11945.pdf https://distantreader.org/stacks/journals/crl/crl-12423.pdf Suppose also the list is saved as a file, or in my computer's clipboard. Is there someway I can get the Web browser(s) to download all of the files? From the command-line I can do this work in many ways and with one hand tied behind my back, but most people do not / will not use the command line. Thus I need a way to use the GUI interface of a Web browser to do the work. Got any ideas? Incidentally, all the URLs, above, point to articles written by Fred Kilgour (the founder of OCLC). A more complete list can be garnered with the following URL: https://distantreader.org/stacks/indexes/search?index=journals&query=author% 3Akilgour&format=html -- Eric Lease Morgan Navari Family Center for Digital Scholarship Hesburgh Libraries University of Notre Dame 574/631-8604 https://cds.library.nd.edu