A scientific databrowser is the ultimate end product of our work. These web-based systems allow users to interactively interrogate their data, creating on-the-fly visualizations based on user input.
In the press ...
Databrowser graphics are "publication ready" and make it easy for any author to include high quality data analysis and visualization in their reports. Below is a sampling of articles, reports and presentations that have used databrowser graphics.
- How Resource Shortages Sparked Egypt's Months-Long Crisis -- The Atlantic, August 19, 2013
- Dead Money ... -- Economic Undertow, June 27, 2011
- Someone is using our oil -- Il Fatto Quotidiano, Apr 11, 2011 (Italian)
- Peak Oil for Dummies -- Marketing in a Small Town, Apr 02, 2011 (Russian)
- Japan's Liquid Fuels Crisis -- The Oil Drum, Apr 01, 2011
- Egypt's Natural Gas Trends and Potential Impacts -- The Oil Drum, Feb 14, 2011
- Saudi Oil Production and Reserves - Reasons Behind Wikileaks Concerns -- The Oil Drum, Feb 09, 2011
- What's Behind Egypt's Problems? -- The Oil Drum, Jan 29, 2011
- Peak oil for visual thinkers -- Transition Voice, Dec 01, 2010
- Current and Future Saudi and Russian Oil Production -- The Oil Drum, Nov 03, 2010
- Natural Gas Net-Export Trends -- ASPO-USA 2010 conference presentation, Oct 07, 2010
- Energy for Asia: an overview -- Apollo Investments, Mar 23, 2010
- Lessons learned from the restructuring of Poland's coal-mining industry -- Global Subsidies Initiative case study, Mar 03, 2010
- Never Mind Peak Oil; Worry about Peak Exports -- Energy & Capital, Jun 11, 2008
More about databrowsers ...
A databrowser is a web based interface that allows non-technical users to interact with scientific data.
Making sense of complex datasets depends upon two very different kinds of machines. Silicon based number crunchers (computers) perform complex mathematical calculations at lightning speed with essentially zero errors while carbon based pattern recognizers (our brains) detect visual patterns much faster than any computer and use these patterns to develop further questions about the data.
People enjoy looking at informative scientific graphics if the barrier to creating them is low. When this happens, our species' extraordinary capabilities as pattern recognizers enable us to convert what we see in excellent scientific graphics into a deeper understanding. The problem in many fields of science is that the barriers to creating excellent graphics are discouragingly high.
A bottleneck exists where information is transferred between number crunchers and pattern recognizers. It can take a large amount of time to organize, format and analyze data before generating the graphics that tell the story of the data. Often, the role of data management and analysis is handed over to computer experts rather than the scientists end users with a real interest in the data. With no easy way to create the graphics that they need, the ability of scientists, managers and interested members of the public to develop their intuition about a dataset is greatly impaired.
Scientific databrowsers attempt to solve this problem by hiding the details of data management and analysis while providing simple, intuitive interfaces to the kinds of analysis that are appropriate for a particular dataset. These analyses are typically vetted statistical routines that are written in code in such a way as to be driven by input from a web browser user interface. In this manner, end users including both experts and non-experts can harness the power of (server side) number crunchers as well as their own (client side) pattern recognizers without having to learn the arcana of data management and scientific analysis software.
Building a databrowser.
The process of building a databrowser involves several steps:
- cleaning up any problems with the source data so that they are consistent and well organized
- writing code that allows vetted statistical analyses to be run interactively
- writing code to create high quality scientific graphics based on the results of the analysis
- embedding the analysis and visualization code in a web-server based databrowser engine
- creating a user interface that allows users to quickly and easily send requests to the analysis and visualization engine running on the server
When properly designed, the code behind a good databrowser can encapsulate a huge amount of institutional memory about the scientific process. Ideally, databrowser graphics should be of high enough quality that they are immediately ready to be included in scientific publications.