java - How can I terminate EMR cluster when a step generated undesirable results in s3 -
java - How can I terminate EMR cluster when a step generated undesirable results in s3 -
my amazon simple workflow spins emr cluster , adds steps depends on output of preceding step. if have 10 steps , 6th step generates output in s3 should looked 7th step determine if step can go on farther or terminate cluster based on 6th step output. work flow runs fine, how terminate cluster if output undesired. using aws java sdk.
when identify problem, utilize code below terminate cluster
you might have used below code launch cluster
amazonelasticmapreduce emr=new amazonelasticmapreduceclient( . . // run job flow runjobflowresult result = emr.runjobflow(request) //shutdown when notice error emr.shutdown();
java amazon-emr amazon-swf
Comments
Post a Comment