如何利用MapReduce的分治策略提高KNN算法的运行速度Word格式文档下载.docx

如何利用MapReduce的分治策略提高KNN算法的运行速度Word格式文档下载.docx

《如何利用MapReduce的分治策略提高KNN算法的运行速度Word格式文档下载.docx》由会员分享，可在线阅读，更多相关《如何利用MapReduce的分治策略提高KNN算法的运行速度Word格式文档下载.docx（22页珍藏版）》请在冰豆网上搜索。

注意：

此时所有的测试集都在一个文本中（test.txt）存放，作为输入路径

ＫＮＮ算法运行日志：

16/07/1719:

32:

24INFOclient.RMProxy:

ConnectingtoResourceManagerathadoop22/10.187.84.51:

8032

25WARNmapreduce.JobSubmitter:

Hadoopcommand-lineoptionparsingnotperformed.ImplementtheToolinterfaceandexecuteyourapplicationwithToolRunnertoremedythis.

25INFOinput.FileInputFormat:

Totalinputpathstoprocess:

1

25INFOmapreduce.JobSubmitter:

numberofsplits:

1

26INFOmapreduce.JobSubmitter:

Submittingtokensforjob:

job_1468752229715_0016

26INFOimpl.YarnClientImpl:

Submittedapplicationapplication_1468752229715_0016

26INFOmapreduce.Job:

Theurltotrackthejob:

http:

//hadoop22:

8088/proxy/application_1468752229715_0016/

Runningjob:

32INFOmapreduce.Job:

Jobjob_1468752229715_0016runninginubermode:

false

map0%reduce0%

49INFOmapreduce.Job:

map1%reduce0%

33:

05INFOmapreduce.Job:

map2%reduce0%

20INFOmapreduce.Job:

map3%reduce0%

35INFOmapreduce.Job:

map4%reduce0%

50INFOmapreduce.Job:

map5%reduce0%

34:

02INFOmapreduce.Job:

map6%reduce0%

17INFOmapreduce.Job:

map7%reduce0%

map8%reduce0%

47INFOmapreduce.Job:

map9%reduce0%

35:

map10%reduce0%

14INFOmapreduce.Job:

map11%reduce0%

29INFOmapreduce.Job:

map12%reduce0%

44INFOmapreduce.Job:

map13%reduce0%

59INFOmapreduce.Job:

map14%reduce0%

36:

12INFOmapreduce.Job:

map15%reduce0%

27INFOmapreduce.Job:

map16%reduce0%

42INFOmapreduce.Job:

map17%reduce0%

57INFOmapreduce.Job:

map18%reduce0%

37:

map19%reduce0%

map20%reduce0%

39INFOmapreduce.Job:

map21%reduce0%

54INFOmapreduce.Job:

map22%reduce0%

38:

09INFOmapreduce.Job:

map23%reduce0%

24INFOmapreduce.Job:

map24%reduce0%

map25%reduce0%

51INFOmapreduce.Job:

map26%reduce0%

39:

06INFOmapreduce.Job:

map27%reduce0%

22INFOmapreduce.Job:

map28%reduce0%

37INFOmapreduce.Job:

map29%reduce0%

52INFOmapreduce.Job:

map30%reduce0%

40:

07INFOmapreduce.Job:

map31%reduce0%

map32%reduce0%

map33%reduce0%

map34%reduce0%

41:

04INFOmapreduce.Job:

map35%reduce0%

map36%reduce0%

map37%reduce0%

map38%reduce0%

42:

map39%reduce0%

map40%reduce0%

map41%reduce0%

53INFOmapreduce.Job:

map42%reduce0%

43:

08INFOmapreduce.Job:

map43%reduce0%

23INFOmapreduce.Job:

map44%reduce0%

41INFOmapreduce.Job:

map45%reduce0%

56INFOmapreduce.Job:

map46%reduce0%

44:

map47%reduce0%

30INFOmapreduce.Job:

map48%reduce0%

45INFOmapreduce.Job:

map49%reduce0%

45:

00INFOmapreduce.Job:

map50%reduce0%

15INFOmapreduce.Job:

map51%reduce0%

map52%reduce0%

48INFOmapreduce.Job:

map53%reduce0%

46:

03INFOmapreduce.Job:

map54%reduce0%

18INFOmapreduce.Job:

map55%reduce0%

33INFOmapreduce.Job:

map56%reduce0%

map57%reduce0%

47:

map58%reduce0%

map59%reduce0%

map60%reduce0%

55INFOmapreduce.Job:

map61%reduce0%

16/07/17