开发者

How do you establish single node Hadoop instance on AWS using Apache Whirr?

开发者 https://www.devze.com 2023-03-12 15:53 出处:网络
I am attempting to run a single-node instance of Hadoop on Amazon Web Services using Apache Whirr. I set whirr.instance-te开发者_开发问答mplates equal to 1 jt+nn+dn+tt. The instance starts up fine. I

I am attempting to run a single-node instance of Hadoop on Amazon Web Services using Apache Whirr. I set whirr.instance-te开发者_开发问答mplates equal to 1 jt+nn+dn+tt. The instance starts up fine. I am able to create directories, but when I try to put files, I get a File could only be replicated to 0 nodes, instead of 1 error. When I do a hadoop fsck / I get a Exception in thread "main" java.net.ConnectException: Connection refused error. Does anyone know what is wrong with my configuration?


I made the experience that whirr does not always start all services reliable. It sounds like the namenode started (the namenode is responsible for storing directory information) but the datanode did not start (the datanode stores the data).

Try running

hadoop dfsadmin -report 

to see if a datanode is available.

If not: often it helps to restart the cluster.

0

精彩评论

暂无评论...
验证码 换一张
取 消