开发者

How to retrieve hadoop job configuration based on job id that is currently running?

开发者 https://www.devze.com 2023-02-25 06:04 出处:网络
Is there any way to retrieve job configuration (some property from the configuration) if I开发者_StackOverflow know job id?

Is there any way to retrieve job configuration (some property from the configuration) if I开发者_StackOverflow know job id?

Basically, what I'm doing is checking if there are any running jobs at the moment and then I want to check if some value for property exists in any of currently running jobs?

Part of the code to retrieve currently running jobs:

    JobConf jobConf = new JobConf(conf);
    JobClient client = new JobClient(jobConf);
    JobStatus[] status = client.getAllJobs();
    for (int i = 0; i< status.length; i++)
    {
        if (!status[i].isJobComplete())
        {
        JobID jobid = status[i].getJobID();
        System.out.println(jobid.toString());
        }
    }


You can look at the configuration of running jobs in the jobtracker, which usually runs on port 50030.

0

精彩评论

暂无评论...
验证码 换一张
取 消