一种基于查询聚类的物化视图动态调整策略

doi:10.13190/j.jbupt.2017-234

北京邮电大学学报 ›› 2018, Vol. 41 ›› Issue (4): 16-22.doi: 10.13190/j.jbupt.2017-234

一种基于查询聚类的物化视图动态调整策略

冯霞^1,2, 张江², 左海超¹

1. 中国民航信息技术科研基地, 天津 300300;
2. 中国民航大学计算机科学与技术学院, 天津 300300

收稿日期:2017-11-08 出版日期:2018-08-28 发布日期:2018-10-09
作者简介:张江(1992-),男,硕士生,E-mail:jzhangmike@163.com;冯霞(1970-),女,教授,硕士生导师.
基金资助:
国家自然科学基金项目（61502499）；中央高校科研业务费专项资金项目（3122015z007）

A Dynamic Adjustment Strategy of Materialized Views Based on Query Clustering

FENG Xia^1,2, ZHANG Jiang², ZUO Hai-chao¹

1. Information Technology Research Base of Civil Aviation Administration of China, Tianjin 300300, China;
2. College of Computer Science and Technology, Civil Aviation University of China, Tianjin 300300, China

Received:2017-11-08 Online:2018-08-28 Published:2018-10-09

摘要/Abstract

摘要： 为了提高数据仓库的查询响应性能，避免视图集频繁调整引发的"抖动性"，提出了一种基于查询聚类的物化视图动态调整策略，运用关联规则挖掘方法计算属性字段相似性，进而计算查询语句相似性，并对一个查询周期内的查询语句集进行聚类，产生候选视图集，根据效益模型计算候选视图的效益，再运用物化视图动态调整算法生成物化视图.在航空公司机票结算数据集上的实验结果表明，在单机环境和分布式环境下，较基准算法相比，所提出的方法均能显著提升数据仓库的查询响应性能，尤其是对高频查询语句的响应性能.

关键词: 数据仓库, 物化视图集, 动态选择, 查询聚类, 属性字段相似度

Abstract: In order to improve performance of query response of data warehouse, and avoid the frequent "jitter" phenomenon for materialized views set caused by immediate adjustment algorithm, a dynamic adjustment strategy of materialized views based on query clustering is presented. Firstly, attribute similarity can be calculated based on method of mining association rules, then queries similarity can be calculated and candidate views set can be generated by clustering the queries set during a statistical time, and then the benefits of candidate views can be calculated according to benefit model. Finally, the latest materialized views can be selected using dynamic management algorithm of materialized views. Based on the experimental results with data of air ticket settlement recorded by airlines. Whether in single-machine environment or distributed environment, compared to other benchmark algorithms, the overall performance of query response of data warehouse has been improved greatly, especially for high frequency queries.

Key words: data warehouse, materialized views set, dynamic selection, query clustering, attribute similarity

中图分类号:

TP311

冯霞, 张江, 左海超. 一种基于查询聚类的物化视图动态调整策略[J]. 北京邮电大学学报, 2018, 41(4): 16-22.

FENG Xia, ZHANG Jiang, ZUO Hai-chao. A Dynamic Adjustment Strategy of Materialized Views Based on Query Clustering[J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2018, 41(4): 16-22.

参考文献

[1] Kumar A, Kumar T V V. Materialized view selection using discrete genetic operators based particle swarm optimization[C]//International Conference on Inventive Systems and Control. Coimbatore:IEEE, 2017:1-5.
[2] Kumar T V V, Arun B. Materialized view selection using marriage in honey bees optimization[J]. International Journal of Natural Computing Research, 2015, 5(3):1-25.
[3] 谭红星, 周龙骧. 多维数据实视图的动态选择[J]. 软件学报, 2002, 13(6):1090-1096. Tan Hongxing, Zhou Longxiang. Dynamic selection of materialized view of multi-dimensional data[J]. Journal of Software, 2002, 13(6):1090-1096.
[4] Sathya M, Isakki D P. Apriori algorithm on web logs for mining frequent link[C]//International Conference on Intelligent Techniques in Control, Optimization and Signal Processing(INCOS). Srivilliputhur:IEEE, 2017:1-5.
[5] 延皓, 张博, 刘芳, 等. 基于量值的频繁闭项集层次聚类算法[J]. 北京邮电大学学报, 2011, 34(6):64-68. Yan Hao, Zhang Bo, Liu Fang, et al. A new method of items' quantities based closed frequent itemsets hierarchical clustering[J]. Journal of Beijing University of Posts and Telecommunications, 2011, 34(6):64-68.
[6] 赵金东, 于彦伟, 刘惊雷. 面向实时海量数据流的数据聚类[J]. 北京邮电大学学报, 2016, 39(3):114-119. Zhao Jindong, Yu Yanwei, Liu Jinglei. A data clustering algorithm over real time high-volume data streams[J]. Journal of Beijing University of Posts and Telecommunications, 2016, 39(3):114-119.
[7] 张柏礼, 孙志挥, 孙翔. 物化视图选择的预处理算法[J]. 计算机研究与发展, 2004, 41(10):1645-1651. Zhang Baili, Sun Zhihui, Sun Xiang. Preprocessor of materialized views selection[J]. Journal of Computer Research and Development, 2004, 41(10):1645-1651.
[8] Yao D, Abulizi A, Hou R. An improved algorithm of materialized view selection within the confinement of space[C]//2015 IEEE Fifth International Conference on Big Data and Cloud Computing. Dalian:[s.n.], 2015:310-313.

一种基于查询聚类的物化视图动态调整策略

A Dynamic Adjustment Strategy of Materialized Views Based on Query Clustering

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 4

编辑推荐

Metrics

本文评价

[1]	吴建林. 基于ECA扩展企业经营信息主动服务机制[J]. 北京邮电大学学报, 2009, 32(s1): 102-105.
[2]	张晓军, 孟祥武. 多维数据访问监视器的设计与实现[J]. 北京邮电大学学报, 2004, 27(2): 113-117.
[3]	范春晓,　刘　杰. 基于多作业步的数据库映射平台的研究[J]. 北京邮电大学学报, 2003, 26(3): 71-74.
[4]	张英海,张斌,王云,刘杰,范春晓. 数据仓库技术在SDH配置管理中的运用[J]. 北京邮电大学学报, 2000, 23(2): 77-81.