Summary	Applications	Compression	Range Queries	Publications	Software

FastBit related publications

• Jerry Chou, Kesheng Wu, Oliver Ruebel, Mark Howison, Ji Qiang, Prabhat, Brian Austin, E. Wes Bethel, Rob D. Ryne, and Arie Shoshani. Parallel Index and Query for Large Scale Data Analysis. SC11. 2011. LBNL-5317E.
• Kesheng Wu, Rishi R Sinha, Chad Jones, Stephane Ethier, Scott Klasky, Kwan-Liu Ma, Arie Shoshani and Marianne Winslett. Finding regions of interest on toroidal meshes. Computational Science & Discovery, Volume 4, Number 1 page 015003. 2011.
• Jinoh Kim, Hasan Abbasi, Luis Chacon, Ciprian Docan, Scott Klasky, Qing Liu, Norbert Podhorszki, Arie Shoshani, and Kesheng Wu. Parallel In Situ Indexing for Data-intensive Computing. LDAV pages 65-72. 2011. LBNL-5280E.
• Kamesh Madduri and Kesheng Wu. Massive-scale RDF Processing Using Compressed Bitmap Indexes. SSDBM pages 470-479. 2011. LBNL-5316E.
• Jerry Chou, Kesheng Wu, and Prabhat. Design of FastQuery: How to Generalize Indexing and Querying System for Scientific Data. Tech Report LBNL-5088E. 2011.
• Jerry Chou, Kesheng Wu, and Prabhat. FastQuery: A Parallel Indexing System for Scientific Data. CLUSTER pages 455-644. 2011. LBNL-5315E.
• Kesheng Wu, Kamesh Madduri, Shane Canon. Multi-Level Bitmap Indexes for Flash Memory Storage. IDEAS'10. 2010.
  [Abstract] [Tech Report LBNL-4217E]
• Daren Hasenkamp, Alexander Sim, Michael Wehner, Kesheng Wu. Finding Tropical Cyclones on a Cloud Computing Cluster: Using Parallel Virtualization for Large-Scale Climate Simulation Analysis. CloudCom2010. 2010.
  [Abstract] [Tech Report LBNL-4218E]
• Oliver Ruebel, Sean Ahern, E. Wes Bethel, Mark D. Biggin, Hank Childs, Estelle Cormier-Michel, Angela DePace, Michael B. Eisen, Charless C. Fowlkes, Cameron G.R. Geddes, Hans Hagen, Bernd Hamann, Min-Yu Huang, Soile V.E. Keraenen, David W. Knowles, Cris L. Luengo Hendriksl, Jitendra Malik, Jeremy Meredith, Peter Messmer, Prabhat, Daniela Ushizima, Gunther H. Weber and Kesheng Wu. Coupling visualization and data analysis for knowledge discovery from multi-dimensional scientific data Procedia Computer Science Volume 1, Issue 1, May 2010, Pages 1751-1758 ICCS 2010.
• K. Wu, A. Shoshani, and K. Stockinger. Analyses of Multi-Level and Multi-Component Compressed Bitmap Indexes. ACM TODS v35, Article 2, 2010
  [Abstract] [Tech report LBNL-60891]
• Kesheng Wu, Sean Ahern, E. Wes Bethel, Jacqueline Chen, Hank Childs, Estelle Cormier-Michel, Cameron Geddes, Junmin Gu, Hans Hagen, Bernd Hamann, Wendy Koegler, Jerome Lauret, Jeremy Meredith, Peter Messmer, Ekow Otoo, Victor Perevoztchikov, Arthur Poskanzer, Prabhat, Oliver Rubel, Arie Shoshani, Alexander Sim, Kurt Stockinger, Gunther Weber, and Wei-Ming Zhang. FastBit: Interactively Searching Massive Data. In Proc. SciDAC 2009
  [Abstract] [Tech report LBNL-2164E]
• Oliver Ruebel, Cameron G R Geddes, Estelle Cormier-Michel, Kesheng Wu, Prabhat, Gunther H Weber, Daniela M Ushizima, Peter Messmer, Hans Hagen, Bernd Hamann, Wes Bethel. Automatic beam path analysis of laser wakefield particle acceleration data. Computational Science & Discovery, vol. 2, no. 1, 2009.
• Ekow Otoo and Kesheng Wu. Accelerating Queries on Very Large Datasets. In Scientific Data Management: Challenges, Technology, and Deployment. Chapman & Hall/CRC Computational Science. 2010.
  [Abstract] [Tech report LBNL-1677E] [Book available from merchants, and libraries]
• Luke J. Gosink, Kesheng Wu, E. Wes Bethel, John D. Owens and Kenneth I. Joy. Data Parallel Bin-Based Indexing for Answering Queries on Multi-core Architectures SSDBM 2009, pages 110-129. DOI: 10.1007/978-3-642-02279-1_9
  [Abstract] [Tech report LBNL-2211E]
• Rishi Rakesh Sinha, Marianne Winslett and Kesheng Wu. Finding Regions of Interest in Large Scientific Datasets. SSDBM 2009, pages 130-147. DOI: 10.1007/978-3-642-02279-1_10
• O. Rubel, Prabhat, K. Wu, H. Childs, J. Meredith, C.G.R. Geddes, E. Cormier-Michel, S. Ahern, G.H. Weber, P. Messmer, H. Hagen, B. Hamann, and E.W. Bethel. High Performance Multivariate Visual Data Exploration for Extremely Large Data. SC08. 2008
  [Abstract] [Tech report LBNL-716E]
• Kurt Stockinger, John Cieslewicz, Kesheng Wu, Doron Rotem, and Arie Shoshani. Using Bitmap Indexing Technology for Using Bitmap Indexing Technology for Combined Numerical and Text Queries. New Trends in Data Warehousing and Data Analysis, Annals of Information Systems. Vol 3. Pages 1-23. 2008.
  [Abstract] [Tech Report LBNL-61768]
• Kesheng Wu, Kurt Stockinger, and Arie Shoshani. Breaking the Curse of Cardinality on Bitmap Indexes. SSDBM. 2008.
  [Abstract] [Tech Report LBNL-173E] [Slides of presentation]
• Rishi Sinha, Marianne Winslett, Kesheng Wu, Kurt Stockinger, and Arie Shoshani. Adaptive Bitmap Indexes for Space-Constrained Systems. ICDE 2008, pages 1418--1420.
• Luke J. Gosink, Kesheng Wu, E. Wes Bethel, John D. Owens, Kenneth I. Joy. Bin-Hash Indexing: A Parallel Method For Fast Query Processing. 2008.
  [Abstract] [Tech Report LBNL-729E Alternative location]
• Kesheng Wu. FastBit Reference Guide. LBNL Tech Report LBNL/PUB-3192. 2007. [overview] [Full text in PDF]
• Elizabeth O'Neil, Patrick O'Neil and Kesheng Wu. Bitmap Index Design Choices and Their Performance Implications. IDEAS 2007.
  [Abstract] [preprint as LBNL-62756]
• Frederick Reiss, Kurt Stockinger, Kesheng Wu, Arie Shoshani, Joseph M. Hellerstein. Enabling Real-Time Querying of Live and Historical Stream Data. SSDBM 2007.
  [Abstract] [ preprint as LBNL-61080, alternative source]
• Kurt Stockinger, E. Wes Bethel, Scott Campbell, Eli Dart, Kesheng Wu. Detecting Distributed Scans Using High-Performance Query-Driven Visualization. SC06, 2006.
  [Abstract] [preprint as LBNL-60053]
• E. Wes Bethel, Scott Campbell, Eli Dart, Kurt Stockinger and Kesheng Wu. Accelerating Network Traffic Analysis Using Query-Driven Visualization. In Symposium on Visual Analytics Science and Technology (VAST), Baltimore, Maryland, USA, October 31 - November 2, 2006, IEEE Computer Society Press.
  [Abstract] [preprint as LBNL-59891]
• Luke Gosink, John Shalf, Kurt Stockinger, Kesheng Wu, Wes Bethel, HDF5-FastQuery: Accelerating Complex Queries on HDF Datasets using Fast Bitmap Indices, SSDBM, 2006.
  [Abstract] [preprint as LBNL-59602]
• Doron Rotem, Kurt Stockinger, Kesheng Wu. Minimizing I/O Costs of Multi-Dimensional Queries with Bitmap Indices. SSDBM, 2006.
  [Abstract] [preprint as LBNL-59949]
• Kurt Stockinger, Kesheng Wu. Bitmap Indices for Data Warehouses. In Wrembel R., Koncilia Ch.: Data Warehouses and OLAP: Concepts, Architectures and Solutions. Idea Group, Inc.
  [Abstract] [preprint as LBNL-59952]
• Kesheng Wu. FastBit: an efficient indexing technology for accelerating data-intensive science J. Phys.: Conf. Ser. 16 556-560 doi:10.1088/1742-6596/16/1/077
  [Abstract] [preprint as LBNL-57982]
• Kurt Stockinger, Doron Rotem, Arie Shoshani, Kesheng Wu. Analyzing Enron Data: Bitmap Indexing Outperforms MySQL Queries by Several Orders of Magnitude. Technical Report, LBNL-59437, Berkeley, California, January 2006.
  [Abstract] [Tech Report]
• Kurt Stockinger, Kesheng Wu, Rene Brun, Philippe Canal. Bitmap Indices for Fast End-User Physics Analysis in ROOT, Nuclear Instruments and Methods in Physics Research -- Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Volume 559, Issue 1, 1 April 2006, Pages 99-102. Elsevier. Accessible through DOI
  
• E. Wes Bethel, Scott Campbell, Eli Dart, Jason Lee, Steven A. Smith, Kurt Stockinger, Brian Tierney, Kesheng Wu. Interactive Analysis of Large Network Data Collections Using Query-Driven Visualization. 2005. Tech Report LBNL-59166.
  [Abstract] [LBNL-59166, alternative source]
• Kurt Stockinger, Kesheng Wu, Scott Campbell, Stephen Lau, Mike Fisk, Eugene Gavrilov, Alex Kent, Christopher E. Davis, Rick Olinger, Rob Young, Jim Prewett, Paul Weber, Thomas P. Caudell, Edward Wes Bethel, Steve Smith. Network Traffic Analysis With Query Driven Visualization - SC 2005 HPC Analytics Results, Supercomputing 2005 (HPC Analytics Challenge), Seattle, Washington, USA, November 2005, ACM Press.
  [movie] [Abstract] [preprint as LBNL-58768]
• Doron Rotem, Kurt Stockinger, Kesheng Wu. Optimizing Candidate Check Costs for Bitmap Indices, Conference on Information and Knowledge Management (CIKM 2005), Bremen, Germany, November 2005, ACM Press.
  [Abstract] [preprint as LBNL-58754]
• Kurt Stockinger, John Shalf, Kesheng Wu, Wes Bethel. Query-Driven Visualization of Large Data Sets, IEEE Visualization, Minneapolis, Minnesota, USA, October 2005, IEEE Computer Society Press.
  [Abstract] [preprint as LBNL-57511]
• Doron Rotem, Kurt Stockinger, Kesheng Wu. Optimizing I/O Costs of Multi-Dimensional Queries using Bitmap Indices, International Conference on Database and Expert Systems Applications (DEXA 2005), Copenhagen, Denmark, August 2005, Springer Verlag.
  [Abstract] [preprint as LBNL-57621]
• Kesheng Wu, Ekow Otoo, and Arie Shoshani. Optimizing bitmap indices with efficient compression ACM Transactions on Database Systems, v 31, pages 1-38, 2006.
  [Abstract] [preprint as LBNL-49626, ACM TODS version]
• Kesheng Wu, Junmin Gu, Jerome Lauret, Arthur M. Poskanzer, Arie Shoshani, Alexander Sim, and Wei-Ming Zhang. Grid Collector: Facilitating Efficient Selective Access from Data Grids. In Proceedings of International Supercomputer Conference 2005, Heidelberg, Germany.
  [Abstract] [preprints as LBNL-57677]
• Kesheng Wu, Ekow Otoo and Arie Shoshani. Optimizing Connected Component Labeling Algorithms, In Proceedings of SPIE Medical Imaging Conference 2005.
  [Abstract] [Preprint as LBNL-56864]
• Kurt Stockinger, John Shalf, Wes Bethel, and Kesheng Wu. DEX: Increasing the Capability of Scientific Data Analysis Pipelines by Using Efficient Bitmap Indices to Accelerate Scientific Visualization, International conference on Scientific and Statistical Database Management (SSDBM 2005), Santa Barbara, California, USA, June 2005, IEEE Computer Society Press.
  [Abstract] [Preprint as LBNL-57023]
• Kesheng Wu, Wei-Ming Zhang, Victor Perevoztchikov, Jerome Lauret and Arie Shoshani. The Grid Collector: Using an Event Catalog to Speedup User Analysis in Distributed Environment, In Proceedings of Computing in High Energy and Nuclear Physics (CHEP) 2004, 2004.
  [PDF document] [powerpoint slides]
• Kurt Stockinger and Kesheng Wu. Improved searching for spatial features in spatio-temporal data, LBNL tech report LBNL-56376, 2004.
  [Abstract] [Preprint as LBNL-56376]
• Kurt Stockinger, Kesheng Wu and Arie Shoshani. Evaluation Strategies for Bitmap Indices with Binning, In Proceedings of International Conference on Database and Expert Systems Applications (DEXA) 2004, 2004.
  [Abstract] [Preprint as LBNL-55540]
• Kesheng Wu, Ekow Otoo, and Arie Shoshani. On the Performance of Bitmap Indices for High Cardinality Attributes. VLDB 2004, pages 24 - 35.
  [Abstract] [Preprint as LBNL-54673]
• Kesheng Wu, Wei-Ming Zhang, Alexander Sim, Junmin Gu and Arie Shoshani. Grid Collector: an Event Catalog with Automated File Management. In Proceedings of IEEE NSS 2003.
  [Abstract] [Full document (a draft)]
• Kesheng Wu, Wendy Koegler, Jacqueline Chen and Arie Shoshani. Using Bitmap Index for Interactive Exploration of Large Datasets. In Proceedings of SSDBM 2003.
  [Abstract] [Preprint as LBNL-52535]
• Kurt Stockinger, Kesheng Wu and Arie Shoshani. Strategies for Processing ad hoc Queries on Large Data Warehouses. In Proceedings of DOLAP'02.
  [Abstract] [Preprint as LBNL-51791] [slides of the presentation]
• Kesheng Wu, Ekow Otoo and Arie Shoshani. Compressing Bitmap Indexes for Faster Search Operations. In Proceedings of SSDBM 2002.
  [Abstract] [Preprint as LBNL-49627]
• Kesheng Wu, Ekow Otoo and Arie Shoshani. A Performance Comparison of bitmap indexes. In Proceedings of CIKM 2001.
  [Abstract] [Preprint as LBNL-48975]
• Kesheng Wu, Ekow Otoo and Arie Shoshani. Compressed bitmap indices for efficient query processing LBNL Tech report LBNL-47807.
  [Abstract] [PDF document]
• Kesheng Wu, Ekow Otoo, Arie Shoshani and Henrik Nordberg. Notes on Design and Implementation of Compressed Bit Vectors. Tech report LBNL/PUB-3161.
  [Abstract] [PDF document]

More research work by John Wu

Bitmap Index

Connected Component Labeling

Eigenvalue Computation

Inforamtion available through various search engines

CiteSeer, DBLP, Google scholar Scientific Commons