Hadoop 2.6.0 用eclipse debug Yarn

it2022-05-28  80

1.下载hadoop源代码,并mvn eclipse:eclipse,完后导入eclipse

2.编辑 $HADOOP_HOME/etc/hadoop/yarn-env.sh

在YARN_OPTS后添加如下内容,注意红色是添加内容

YARN_OPTS="$YARN_OPTS -Dyarn.policy.file=$YARN_POLICYFILE"YARN_NODEMANAGER_OPTS="-Xdebug -Xrunjdwp:server=y,transport=dt_socket,address=18788,suspend=n"YARN_RESOURCEMANAGER_OPTS="-Xdebug -Xrunjdwp:server=y,transport=dt_socket,address=18789,suspend=n"

 

3.启动hadoop,查看sudo netstat -tlnp | grep java,发现18788,18789在监听状态

 

4.eclipse选中hadoop-yarn-server-resourcemanager,debug configurations --> Remote Java Application ,新建一个,然后host 选中hadoop节点,本机是localhost,port选为18789.

 

5.在工程中设置一个短点,然后以hadoop jar xxxxx启动mapreduce任务,即可。

转载于:https://www.cnblogs.com/zjxbr/p/4449409.html


最新回复(0)