What everybody else has said is completely true -- the type of data makes a
huge, huge difference in how you want to present it on the Web.
If it's social-sciences-type data, though, and you're interested in making
it explorable in a regular web browser, you might take a look at SDA. SDA
stands for "Survey Documentation and Analysis," but it will work on any
data that you can reasonably represent in a spreadsheet-type format (rows
of cases with columns of values for different variables), even if it's an
overwhelmingly massive number of rows and columns. It's not cheap, but I
really like the user experience from the front end. (I teach a *lot* of
students to use it when I'm wearing my data services librarian hat.)
IASSIST (the International Association for Social Science Information
Science and Technology) is a good resource on this topic for social
Their mailing list is closed, but I'm a member, so if you're working with
social sciences data I'd be happy to post your question there and pass on
Social Studies and Data Services Librarian
Grinnell College Libraries
1111 Sixth Ave.
Grinnell, IA 50112
On Wed, Jul 23, 2014 at 4:29 PM, Kyle Banerjee <[log in to unmask]>
> We've been facing increasing requests to help researchers publish datasets.
> There are many dimensions to this problem, but one of them is applying
> appropriate metadata and mounting them so they can be explored with a
> regular web browser or downloaded by expert users using specialized tools.
> Datasets often are large. One that we used for a pilot project contained
> well over 10,000 objects with a total size of about 1 TB. We've been asked
> to help with much larger and more complex datasets.
> The pilot was successful but our current process is neither scalable nor
> sustainable. We have some ideas on how to proceed, but we're mostly making
> things up. Are there methods/tools/etc you've found helpful? Also, where
> should we look for ideas? Thanks,