XIA Yuan1, HE Ying-si2. Push Data Prefetching Scheme in a Distributed File System[J]. Journal of Southwest China Normal University(Natural Science Edition), 2018, 43(5): 101-105. doi: 10.13718/j.cnki.xsxb.2018.05.017
Citation: |
XIA Yuan1, HE Ying-si2. Push Data Prefetching Scheme in a Distributed File System[J]. Journal of Southwest China Normal University(Natural Science Edition), 2018, 43(5): 101-105. doi: 10.13718/j.cnki.xsxb.2018.05.017
|
Push Data Prefetching Scheme in a Distributed File System
-
1. College of Economics and Management, Southwest University, Chongqing, 400715, China;
2. School of Computer and Information Science, Southwest University, Chongqing, 400715, China
More Information
-
Received Date:
07/07/2017
-
-
Abstract
In order to overcome the shortcomings of the traditional data prefetching scheme, this paper proposes a push data prefetching scheme in a distributed file system. It can reduce the amount of data communication and network communication delay. At the same time, it can reduce the client's burden of work by freeing the computing nodes running the client file system from tracking I/O operation and predicting I/O operation. So our data prefetching scheme improves the performance of storage system.
-
-
References
[1]
|
YU W,VETTER J,CANON R S,et al.Exploiting Lustre File Joining for Effective Collective I/O[C]//IEEE International Symposium on CLUSTER Computing and the Grid (CCGRID '07). New York:IEEE Computer Society Press,2007.
Google Scholar
|
[2]
|
SEHRISH S,SON S W,LIAO W K,et al.Improving Collective I/O Performance by Pipelining Request Aggregation and File Access[C]//Proceedings of the 20th European MPI Users' Group Meeting.Providence:ACM Press,2013.
Google Scholar
|
[3]
|
周斌,毕传美.一种基于频繁项挖掘的大量小文件动态合并算法[J].中南民族大学学报(自然科学版),2016, 42(5):708-714.
Google Scholar
|
[4]
|
KALLURKAR P,SARANGI S R.pTask:A Smart Prefetching Scheme for OS Intensive Applications[C]//IEEE/ACM International Symposium on Microarchitecture.New York:IEEE Computer Society Press,2016:1-12.
Google Scholar
|
[5]
|
HE J,BENT J,TORRES A,et al.I/O Acceleration with Pattern Detection[C]//International Symposium on High-Performance Parallel and Distributed Computing.Providence:ACM Press,2013:25-36.
Google Scholar
|
[6]
|
吴峰光,奚宏生,徐陈锋.一种支持并发访问流的文件预取算法[J].软件学报,2010,21(8):1820-1833.
Google Scholar
|
[7]
|
郝杰, 逯彦博, 刘鑫吉, 等. 分布式存储中的再生码综述[J]. 重庆邮电大学学报(自然科学版), 2013, 25(1):30-38.
Google Scholar
|
[8]
|
CHANG F,DEAN J,GHEMAWAT S,et al.Bigtable:A Distributed Storage System for Structured Data[J].Acm Transactions on Computer Systems,2008,26(2):1-26.
Google Scholar
|
[9]
|
DEAN J,GHEMAWAT S.MapReduce:Simplified Data Processing on Large Clusters[J].Communication of ACM,2008,51(1):107-113.
Google Scholar
|
[10]
|
温昱晖, 陈广勇, 赵劲涛, 等. 基于CP-ABE在云计算中实现数据访问控制的方案[J]. 重庆邮电大学学报(自然科学版), 2013, 25(5):658-664.
Google Scholar
|
-
-
Access History
-