PS: for the extraction of URLs (e.g., links to PDFs), then yes, I would use,
for instance iMacros Extract command (for a quick GUI solution, interactive
solution -- else would go fo some python or PHP script)
https://wiki.imacros.net/Data_Extraction
E.g., there demo macro (again, on Chrome):
TAB T=1
URL GOTO=http://demo.imacros.net/Automate/Extract2
TAG POS=1 TYPE=A ATTR=TXT:H*links* EXTRACT=HREF
Extracts the URL found on this page (and then can be downloaded to, using
ONDOWNLOAD)
-----Original Message-----
From: Filipe Bento (UA) <[log in to unmask]>
Sent: 15 December 2022 15:07
To: 'Code for Libraries' <[log in to unmask]>
Subject: RE: [CODE4LIB] batch download
Is iMacros extension a possibility?
Even better, and just looked for this:
https://chrome.google.com/webstore/detail/chrono-download-manager/mciiogijeh
kdemklbdcbfkefimifhecn/related
(Chrome, but I guess available for other browsers)
Simply copy the URLs (to the clipboard, remove any blank space before or
after each of them), go back to the extension, create a new task, and the
URL field should be populated with those copied URLs. "Start", and watch the
magic happens.
Hope this is what is needed (if I understood it correctly).
Filipe
----------------
Please note that if I am emailing outside of office hours, this is for my
convenience and I do not expect a reply
____________________________________________________________________________
____________________________________________________________________________
________________
Dr Filipe Bento (PhD, MSc, Eng)
BL Labs Technical Lead
Landline: +44 (0)20 7412 7925
Mobile: +44 (0)74 2654 8167
https://wa.me/351927992378
https://www.bl.uk/people/experts/filipe-bento
ORCID: https://orcid.org/0000-0001-8135-2304
British Library Labs
The British Library, St Pancras, Ldn, NW1 2DB
Email: [log in to unmask]
Twitter: @BL_Labs
Web: http://labs.bl.uk
For Living With Machines project related:
[log in to unmask] (The Alan Turing Inst.)
-----Original Message-----
From: Code for Libraries <[log in to unmask]> On Behalf Of Eric Lease
Morgan
Sent: 15 December 2022 14:26
To: [log in to unmask]
Subject: [CODE4LIB] batch download
How can I use the Firefox, Chrome, and/or Safari Web browsers to batch
download the content found at the other end of a list of URLs?
Suppose I have a list of URLs, for example:
https://distantreader.org/stacks/journals/crl/crl-11730.pdf
https://distantreader.org/stacks/journals/ital/ital-5777.pdf
https://distantreader.org/stacks/journals/ital/ital-5582.pdf
https://distantreader.org/stacks/journals/ital/ital-4657.pdf
https://distantreader.org/stacks/journals/crl/crl-9927.pdf
https://distantreader.org/stacks/journals/crl/crl-11945.pdf
https://distantreader.org/stacks/journals/crl/crl-12423.pdf
Suppose also the list is saved as a file, or in my computer's clipboard.
Is there someway I can get the Web browser(s) to download all of the files?
From the command-line I can do this work in many ways and with one hand tied
behind my back, but most people do not / will not use the command line. Thus
I need a way to use the GUI interface of a Web browser to do the work. Got
any ideas?
Incidentally, all the URLs, above, point to articles written by Fred Kilgour
(the founder of OCLC). A more complete list can be garnered with the
following URL:
https://distantreader.org/stacks/indexes/search?index=journals&query=author%
3Akilgour&format=html
--
Eric Lease Morgan
Navari Family Center for Digital Scholarship Hesburgh Libraries University
of Notre Dame
574/631-8604
https://cds.library.nd.edu
|
