Hadoop2.5 Eclipse插件制作、连接集群、及hadoop eclipse中hadoop插件
1.hadoop-eclipse-plugin源码如何下载?
2.插件编译需要哪些准备?
3.使用什么命令可以编译Eclipse插件?
制作过程:
1.首先从git下载源码
下载地址:
https://github.com/winghc/hadoop2x-eclipse-plugin百度网盘下载:
链接:http://pan.baidu.com/s/1o6DMY4U 密码:y95i
下载之后,我们会看到下面文件夹
对于像安装git的用户,可以查看下面帖子
软件版本控制-在Windows中使用Git视频介绍
win7安装 git软件下载以及遇到的问题解决解决方法
2.win7编译
2.1编译准备
win7的编译首先需要安装jdk、ant、Eclipse
同样window也可以进行编译,环境如下图所示这里的
Eclipse的版本:
Version: 3.9.1.201308190730
Build id: 3.9.0.201308190730
Eclipse的安装
Eclipse安装很重要,而且版本很重要,最好能版本一致,因为如果你在Linux制作的插件,只能用于Linux,windows插件只能用于windows,具体的Eclipse版本也尽可能一致,否则会遇到各种问题
2.2编译
aboutyun@master:~/hadoop2x-eclipse-plugin/src/contrib/eclipse-plugin$ ant jar -Dversion=2.5.0 -Declipse.home=/usr/eclipse -Dhadoop.home=/usr/hadoop
参数说明:
1.Dversion是你编译的版本,此版本为2.5.0
2.Declipse.home是Eclipse安装目录
3.Dhadoop.home是Hadoop安装目录
执行如下命令:
E:hadoop2x-eclipse-pluginsrccontribeclipse-plugin>ant jar -Dversion=2.5.0 -D
eclipse.home=E:eclipseIDE -Dhadoop.home=E:bianyihadoop-2.2.0
复制代码
上面Hadoop home需要说明的是,这里并不是使用的Hadoop2.5.0,经过各种验证,Dhadoop.home如果使用的是Hadoop2.5是非常痛苦的,需要各种修改,而且不一定能改正确。那么为什么Hadoop home是Hadoop2.2版本的也可以连接Hadoop2.5,这个需要了解内部原理了,感兴趣的同学,可以研究下。
下面附上在win7下,Eclipse版本为3.9.1的插件
链接:http://pan.baidu.com/s/1dDkZbWH 密码:游客,如果您要查看本帖隐藏内容请回复
然后尝试连接集群:
首先确认集群版本:
1.把插件放入plugins文件夹
然后打开win7下Eclipse,将hadoop-eclipse-plugin-2.5.0.jar插件放到Eclipse安装目录的plugins文件夹下,我这里的路径是E:eclipseIDEplugins
其实放到这里面已经完成大部分了。
2.重启Eclipse
通过window-》preference 找到下图所示,选择Hadoop安装目录
3.创建New hadoop location
通过下面操作,单击other
弹出show view对话框,然后单击map/reduce location
看到小象,如下图
右键New hadoop location
4.配置New hadoop location
5.查看效果
配置完毕,查看效果
问题总结:
插件的制作过程还是比较复杂的,原先使用的是Hadoop2.5版本,编译成功了,不能创建New Hadoop location查看log下面问题
java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
at org.apache.hadoop.eclipse.server.HadoopServer.<init>(HadoopServer.java:224)
at org.apache.hadoop.eclipse.servers.HadoopLocationWizard.<init>(HadoopLocationWizard.java:88)
at org.apache.hadoop.eclipse.actions.NewLocationAction$1.<init>(NewLocationAction.java:41)
at org.apache.hadoop.eclipse.actions.NewLocationAction.run(NewLocationAction.java:40)
at org.eclipse.jface.action.Action.runWithEvent(Action.java:499)
at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:584)
at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:501)
at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:411)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1057)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4170)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3759)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1113)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:997)
at org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:138)
at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:610)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:567)
at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150)
at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:124)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:354)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:636)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:591)
at org.eclipse.equinox.launcher.Main.run(Main.java:1450)
复制代码
网上有很多这方面的资料,尝试,但是还是未能解决。
使用Hadoop2.5作为编译目录,遇到下面问题:
ivy-resolve-common:
[ivy:resolve]
[ivy:resolve] :: problems summary ::
[ivy:resolve] :::: WARNINGS
[ivy:resolve] module not found: org.apache.hadoop#hadoop-mapreduce-cli
ent-jobclient;2.5.0
[ivy:resolve] ==== maven2: tried
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapredu
ce-client-jobclient/2.5.0/hadoop-mapreduce-client-jobclient-2.5.0.pom
[ivy:resolve] -- artifact org.apache.hadoop#hadoop-mapreduce-client-jobclien
t;2.5.0!hadoop-mapreduce-client-jobclient.jar:
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapredu
ce-client-jobclient/2.5.0/hadoop-mapreduce-client-jobclient-2.5.0.jar
[ivy:resolve] module not found: org.apache.hadoop#hadoop-mapreduce-cli
ent-core;2.5.0
[ivy:resolve] ==== maven2: tried
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapredu
ce-client-core/2.5.0/hadoop-mapreduce-client-core-2.5.0.pom
[ivy:resolve] -- artifact org.apache.hadoop#hadoop-mapreduce-client-core;2.5
.0!hadoop-mapreduce-client-core.jar:
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapredu
ce-client-core/2.5.0/hadoop-mapreduce-client-core-2.5.0.jar
[ivy:resolve] module not found: org.apache.hadoop#hadoop-mapreduce-cli
ent-common;2.5.0
[ivy:resolve] ==== maven2: tried
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapredu
ce-client-common/2.5.0/hadoop-mapreduce-client-common-2.5.0.pom
[ivy:resolve] -- artifact org.apache.hadoop#hadoop-mapreduce-client-common;2
.5.0!hadoop-mapreduce-client-common.jar:
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-mapredu
ce-client-common/2.5.0/hadoop-mapreduce-client-common-2.5.0.jar
[ivy:resolve] module not found: org.apache.hadoop#hadoop-hdfs;2.5.0
[ivy:resolve] ==== maven2: tried
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/2.
5.0/hadoop-hdfs-2.5.0.pom
[ivy:resolve] -- artifact org.apache.hadoop#hadoop-hdfs;2.5.0!hadoop-hdfs.ja
r:
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/2.
5.0/hadoop-hdfs-2.5.0.jar
[ivy:resolve] module not found: org.apache.hadoop#hadoop-common;2.5.0
[ivy:resolve] ==== maven2: tried
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/
2.5.0/hadoop-common-2.5.0.pom
[ivy:resolve] -- artifact org.apache.hadoop#hadoop-common;2.5.0!hadoop-commo
n.jar:
[ivy:resolve] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/
2.5.0/hadoop-common-2.5.0.jar
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: org.apache.hadoop#hadoop-mapreduce-client-jobclient;2
.5.0: not found
[ivy:resolve] :: org.apache.hadoop#hadoop-mapreduce-client-core;2.5.0:
not found
[ivy:resolve] :: org.apache.hadoop#hadoop-mapreduce-client-common;2.5.
0: not found
[ivy:resolve] :: org.apache.hadoop#hadoop-hdfs;2.5.0: not found
[ivy:resolve] :: org.apache.hadoop#hadoop-common;2.5.0: not found
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]
[ivy:resolve]
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
BUILD FAILED
复制代码
经过多次修改未果,由于Hadoop Eclipse插件源码使用的是Hadoop2.2所以,就尝试用是Hadoop2.2作为Hadoop home,竟然编译成功了。
更多阅读
eclipse中svn插件的安装 eclipse的svn插件安装
eclipse中svn插件的安装——简介Svn(Subversion)是近年来崛起的版本管理工具,在当前的开源项目里(J2EE),几乎95%以上的项目都用到了SVN。Subversion项目的初衷是为了替换当年开源社区最为流行的版本控制软件CVS,在CVS的功能的基础上有很
赣州彩印联盟——集设计、制作、印刷为一体的赣州最有实力的彩印 赣州印刷喷绘
赣州彩印联盟——集设计、制作、印刷为一体——赣州最有实力的彩印公司!本公司专业承接:宣传单、画册、高档名片、名片大小不干胶拼版印刷!另有单色印刷、联单、收据等等!我们承诺:质量最好,价格最实惠、速度最快、服务最好!——有质量
珠三角地区的产业集群 珠三角产业结构
广东省是国内最早出现集群经济形式的省份之一,经过20多年的发展,珠三角地区也形成了规模大、层次高、能力强、数量多的制造业产业集群。在发展过程中,许多产业集群突破了原来的行政区划分范围,迅速向周边扩散,形成了带状产业集
物理科技小制作、小发明活动计划 科技制作小发明
物理科技小制作、小发明活动计划一、指导思想:为了进一步搞好《中学物理校本课程开发》小课题,活跃校园文化,培养学生的创新精神和实践能力,我们物理教研组和备课组积极响应学校即将展开的艺术节活动,2013年3月19日组成
Hadoop2.5 Eclipse插件制作、连接集群、及hadoop eclipse中hadoop插件
问题导读1.hadoop-eclipse-plugin源码如何下载?2.插件编译需要哪些准备?3.使用什么命令可以编译Eclipse插件?制作过程:1.首先从git下载源码下载地址:https://github.com/winghc/hadoop2x-eclipse-plugin百度网盘下载: