Author : Akshita S. Khoriya 1
Date of Publication :7th March 2016
Abstract: In data warehousing and OLAP applications, large amount of data are processed. To perform operations of predicates in SQL, large amount of data become highly inadequate which requires supporting to compare a tuples of group with a number of values. Currently available queries are complex, complex to write and create as well as challenging for database engine to optimize, which results in costly evaluation. Many of the available query processing algorithms does not take the advantage of the smallresult-set property, which incurs intensive disk accesses as well as needed computations, which results in long processing time. Optimized query processing approach achieved by various studied algorithms shows very good performance to processing set predicates. We presented here bitmap index and developed a very effective bitmap pruning strategy by using Huffman coding which is variable length compression technique for processing queries, which completely removes the necessity of scanning and processing the entire data set (table), which results in efficient execution of the query processing. Experiments verified our technique is much more efficient than existing algorithms in processing queries and retrieving data from large datasets.
Reference :
-
- Chengkai Li, Member,IEEE, Bin He, Ning Yan, Muhammad Assad Safiullah ”Set Predicates in SQL: Enabling Set-Level Comparisons for Dynamically Formed Groups” IEEE Transactions on Knowledge and Data Engineering , Vol. 26, No. 2, FEBRYARY 2014
- Chiranjeev D. Garhwani, Shreya S. Kandekar, Payal S. Chirde”, A Review on Query Processing and Optimization in SQL with different Indexing Techniques”,IJARCCE,Vol 5,Issue 1,pp no-329- 332,2016.
- Bin He,Hui-l Hsiao, Member IEEE, Ziyang Liu ,Yu Huang,and Yi Chen,Member,IEEE, “Efficient Iceberg Query Evaluation Using Comressed Bitmap Index”, IEEE Transactionson K1nowledge and Data Engineering , Vol. 24, No. 9, SEPTEMBER 2012.
- Jayant Rajurkar, T.Khan, ”A System for Query Processing and Optimization in SQL for Set Predicates using Compressed Bitmap Index”, IJSRD - International Journal for Scientific Research & Development, Vol. 3, Issue 02, 2015 | ISSN 2321- 0613,pp no 798-801.
- M. Fang, N. Shivakumar, H. Garcia-Molina, R. Motwani, and J.D.Ullman, “Computing Iceberg Queries Efficiently,”Proc. Int’l Conf.Very Large Data Bases (VLDB),pp. 299-310, 1998.
- J. Bae and S. Lee, “Partitioning Algorithms for the Computation of Average Iceberg Queries,”Proc. Second Int’l Conf. Data Warehousing and Knowledge Discovery (DaWaK),2000
- K. Wu, E.J. Otoo, and A. Shoshani, “Optimizing Bitmap Indices with Efficient Compression, ”ACM Trans. Database Systems,vol. 31, no. 1, pp. 1-38, 2006.
- P.E. O’Neil and D. Quass, “Improved Query Performance with Variant Indexes,”Proc. ACM SIGMOD Int’l Conf. Management of Data,pp. 38-49, 1997
- Jayant Rajurkar, T.K.Khan,” Efficient Query Processing and Optimization in SQL using Compressed Bitmap Indexing for Set Predicates”, IEEE Sponsored 9th International Conference on Intelligent Systems and Control (ISCO) Page No.619- 623.DOI.10.1109/ISCO.2015.7282354.
- S. Melnik and H. Garcia-Molina, “Adaptive Algorithms for Set Containment Joins,”ACM Trans. Database Systems,vol. 28, no. 1, pp. 56-99, 2003.
- S. Melnik, A. Gubarev, J.J. Long, G. Romer, S. Shivakumar, M.Tolton, and T. Vassilakis, “Dremel: Interactive Analysis of WebScale Data Sets,”Comm. ACM,vol. 54, pp. 114-123, June 2011.
- G. Antoshenkov, “Byte-Aligned Bitmap Compression,”Proc. Conf. Data Compression,p. 476, 1995.
- Jayant Rajurkar, Lalit dole, ,” A Decision Support System for Predicting Student Performance”, International Journal of Innovative Research in Computer and Communication Engineering(IJIRCCE). Vol. 2, Issue 12, December 2014, Pages- 7232-37.
- D. Chatziantoniou and K.A. Ross, “Querying Multiple Features of Groups in Relational Databases,”Proc. Int’l Conf. Very Large Databases (VLDB),pp. 295-306, 1996.
- D. Chatziantoniou and K.A. Ross, “Groupwise Processing of Relational Queries,”Proc. 23rd Int’l Conf. Very Large Databases (VLDB),pp. 476-485, 1997.
- D. Chatziantoniou and E. Tzortzakakis, “Asset Queries: A Declarative Alternative to Mapreduce,”ACM SIGMOD Record, vol. 38, no. 2, pp. 35-41, Oct. 2009.
- K. Wu, E. Otoo, and A. Shoshani, “An efficient compression scheme for bitmap indices” in ACM Transactions on Database Systems, 2004.
- K.Wu, E. J. Otoo, and A.Shoshani, “Compressing bitmap indexes for faster search operations” in Proceedings of the 2002 International Conference on Scientific and Statistical DatabaseManagement Conference (SSDBM’02), pages 99–108, 2002.
- Zainab Qays Abdulhadi, Zhang Zuping and Hamed Ibrahim Housien, “Bitmap Index as Effective Indexing for Low Cardinality Column in Data Warehouse” in International Journal of Computer Applications (0975 – 8887) Volume 68– No.24, April 2013.
- Sirirut Vanichayobon, Le Gruenwald,“Indexing Techniques for Data Warehouses Queries”.
- https://en.wikipedia.org/wiki/B-tree.
- https://www.quora.com/What-is-a-B+-Tree.