What everybody else has said is completely true -- the type of data makes a huge, huge difference in how you want to present it on the Web. If it's social-sciences-type data, though, and you're interested in making it explorable in a regular web browser, you might take a look at SDA. SDA stands for "Survey Documentation and Analysis," but it will work on any data that you can reasonably represent in a spreadsheet-type format (rows of cases with columns of values for different variables), even if it's an overwhelmingly massive number of rows and columns. It's not cheap, but I really like the user experience from the front end. (I teach a *lot* of students to use it when I'm wearing my data services librarian hat.) http://sda.berkeley.edu/ IASSIST (the International Association for Social Science Information Science and Technology) is a good resource on this topic for social sciences data: http://www.iassistdata.org/resources/category/data-management-and-curation. Their mailing list is closed, but I'm a member, so if you're working with social sciences data I'd be happy to post your question there and pass on any responses. Julia ********************************************* Julia Bauder Social Studies and Data Services Librarian Grinnell College Libraries 1111 Sixth Ave. Grinnell, IA 50112 On Wed, Jul 23, 2014 at 4:29 PM, Kyle Banerjee <[log in to unmask]> wrote: > We've been facing increasing requests to help researchers publish datasets. > There are many dimensions to this problem, but one of them is applying > appropriate metadata and mounting them so they can be explored with a > regular web browser or downloaded by expert users using specialized tools. > > Datasets often are large. One that we used for a pilot project contained > well over 10,000 objects with a total size of about 1 TB. We've been asked > to help with much larger and more complex datasets. > > The pilot was successful but our current process is neither scalable nor > sustainable. We have some ideas on how to proceed, but we're mostly making > things up. Are there methods/tools/etc you've found helpful? Also, where > should we look for ideas? Thanks, > > kyle >