arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1411.7639cs.DC
收藏

云计算环境下利用Hadoop MapReduce分析Web应用程序日志文件获取命中数

Analyzing Web Application Log Files to Find Hit Count Through the Utilization of Hadoop MapReduce in Cloud Computing Environment

Sayalee Narkhede, Trupti Baraskar, Debajyoti Mukhopadhyay

摘要:

MapReduce已广泛应用于数据和计算密集型应用的各个领域,是云计算的重要编程模型。Hadoop是MapReduce的一个开源实现,它使用商用硬件处理TB级的数据。我们已经应用了Hadoop MapReduce编程模型来分析Web日志文件,以便我们可以获得特定Web应用程序的点击数。该系统使用Hadoop文件系统来存储日志文件,并使用Map和Reduce函数对结果进行评估。实验结果显示了日志文件中每个字段的命中次数。另外,由于MapReduce运行时并行化,响应时间减少了。

英文摘要:

MapReduce has been widely applied in various fields of data and compute intensive applications and also it is important programming model for cloud computing. Hadoop is an open-source implementation of MapReduce which operates on terabytes of data using commodity hardware. We have applied this Hadoop MapReduce programming model for analyzing web log files so that we could get hit count of specific web application. This system uses Hadoop file system to store log file and results are evaluated using Map and Reduce function. Experimental results show hit count for each field in log file. Also due to MapReduce runtime parallelization response time is reduced.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑