 |
 |
Alan, if you are looking for data mining software that runs well in Hadoop, I would definitely recommend looking into Apache Mahout [1]. This software is specifically focused on categorization and clustering, and these algorithms tend to work well in the distributed architecture of a Hadoop-based system. If you are looking for parsers, taggers, tokenizers, then a different system (Gate / OpenNLP / UIMA) would be more appropriate. -Aaron [1] http://mahout.apache.org On Aug 27, 2013, at 7:47 PM, Alan Darnell <[log in to unmask]> wrote: > Do any of these work in Hadoop using MapReduce as a programming model? It seems like Hadoop would be a natural use case for text mining and analysis. > > Alan > > On Aug 27, 2013, at 7:44 PM, "Riley, Jenn" <[log in to unmask]> wrote: > >> This is still command-line, but Mallet is heavily used in the DH >> community: http://mallet.cs.umass.edu/. I think MONK >> (http://monkproject.org/) has a UI, but I'm not overly familiar with its >> features. >> >> Jenn >> >> -------------------------------- >> Jenn Riley >> Head, Carolina Digital Library and Archives >> The University of North Carolina at Chapel Hill >> http://cdla.unc.edu/ >> http://www.lib.unc.edu/users/jlriley >> >> [log in to unmask] >> (919) 843-5910 >> >> >> >> >> >> On 8/27/13 11:24 AM, "Eric Lease Morgan" <[log in to unmask]> wrote: >> >>> What sorts of text mining software do y'all support / use in your >>> libraries? >>> >>> We here in the Hesburgh Libraries at the University of Notre Dame have >>> all but opened a place called the Center For Digital Scholarship. We are >>> / will be providing a number of different services to a number of >>> different audiences. These services include but are not necessarily >>> limited exactly to: >>> >>> * data management consultation >>> * data analysis and visualization >>> * geographic information systems support >>> * text mining investigations >>> * referrals to other "centers" across campus >>> >>> I am expected to support the text mining investigations. I have >>> traditionally used open source tools do to my work. Many of these tools >>> require some sort of programming in order to exploit. To some degree I am >>> expected mount text mining software on our local Windows and Macintosh >>> computers here in our Center. I am familiar with the lists of tools >>> available at Bamboo as well as Hermeneuti.ca. [0, 1] TAPoRware is good >>> too, but a bit long in the tooth. [2] >>> >>> Do you know of other sets of tools to choose from? Are you familiar with >>> SASŪ Text Analytics, STATISTICA Data Miner, or RapidMiner? [3, 4, 5] >>> >>> [0] Bamboo Dirt - http://dirt.projectbamboo.org >>> [1] Hermeneuti.ca - http://hermeneuti.ca/voyeur/tools >>> [2] TAPoRware - http://taporware.ualberta.ca >>> [3] Text Analytics - http://www.sas.com/text-analytics/ >>> [4] Data Miner - http://www.statsoft.com/Products/STATISTICA/Data-Miner/ >>> [5] RapidMiner - http://rapid-i.com/content/view/181/190/ >>> >>> -- >>> Eric Lease Morgan, Digital Initiatives Librarian >>> Hesburgh Libraries >>> University of Notre Dame >>> >>> 574/631-8604