Gecko [ www.leshallesdegournay.geraud-market.com ]

Name	Size	Permission	Date
add-instance-fleet.rst	521 B	-rw-r--r--	2017-04-04 16:39
add-steps.rst	4.37 KB	-rw-r--r--	2017-04-04 16:39
add-tags.rst	648 B	-rw-r--r--	2017-04-04 16:39
create-cluster-examples.rst	18.61 KB	-rw-r--r--	2017-04-04 16:39
create-cluster-synopsis.rst	815 B	-rw-r--r--	2017-04-04 16:39
create-default-roles.rst	5.55 KB	-rw-r--r--	2017-04-04 16:39
create-security-configuration.rst	2.14 KB	-rw-r--r--	2017-04-04 16:39
delete-security-configuration.rst	173 B	-rw-r--r--	2017-04-04 16:39
describe-cluster.rst	9.37 KB	-rw-r--r--	2017-04-04 16:39
describe-step.rst	1.12 KB	-rw-r--r--	2017-04-04 16:39
get.rst	258 B	-rw-r--r--	2017-04-04 16:39
list-clusters.rst	670 B	-rw-r--r--	2017-04-04 16:39
list-instance-fleets.rst	1.98 KB	-rw-r--r--	2017-04-04 16:39
list-instances.rst	3.19 KB	-rw-r--r--	2017-04-04 16:39
list-security-configurations.rst	357 B	-rw-r--r--	2017-04-04 16:39
list-steps.rst	151 B	-rw-r--r--	2017-04-04 16:39
modify-cluster-attributes.rst	196 B	-rw-r--r--	2017-04-04 16:39
modify-instance-fleet.rst	333 B	-rw-r--r--	2017-04-04 16:39
put.rst	287 B	-rw-r--r--	2017-04-04 16:39
remove-tags.rst	184 B	-rw-r--r--	2017-04-04 16:39
schedule-hbase-backup.rst	678 B	-rw-r--r--	2017-04-04 16:39
socks.rst	273 B	-rw-r--r--	2017-04-04 16:39
ssh.rst	1.43 KB	-rw-r--r--	2017-04-04 16:39
wait.rst	165 B	-rw-r--r--	2017-04-04 16:39

Rename

**1. To add Custom JAR steps to a cluster**

- Command::

aws emr add-steps --cluster-id j-XXXXXXXX --steps Type=CUSTOM_JAR,Name=CustomJAR,ActionOnFailure=CONTINUE,Jar=s3://mybucket/mytest.jar,Args=arg1,arg2,arg3 Type=CUSTOM_JAR,Name=CustomJAR,ActionOnFailure=CONTINUE,Jar=s3://mybucket/mytest.jar,MainClass=mymainclass,Args=arg1,arg2,arg3

- Required parameters::

Jar

- Optional parameters::

Type, Name, ActionOnFailure, Args

- Output::

{
        "StepIds":[
            "s-XXXXXXXX",
            "s-YYYYYYYY"
        ]
    }

**2. To add Streaming steps to a cluster**

- Command::

aws emr add-steps --cluster-id j-XXXXXXXX --steps Type=STREAMING,Name='Streaming Program',ActionOnFailure=CONTINUE,Args=[-files,s3://elasticmapreduce/samples/wordcount/wordSplitter.py,-mapper,wordSplitter.py,-reducer,aggregate,-input,s3://elasticmapreduce/samples/wordcount/input,-output,s3://mybucket/wordcount/output]

- Required parameters::

Type, Args

- Optional parameters::

Name, ActionOnFailure

- JSON equivalent (contents of step.json)::

[
     {
       "Name": "JSON Streaming Step",
       "Args": ["-files","s3://elasticmapreduce/samples/wordcount/wordSplitter.py","-mapper","wordSplitter.py","-reducer","aggregate","-input","s3://elasticmapreduce/samples/wordcount/input","-output","s3://mybucket/wordcount/output"],
       "ActionOnFailure": "CONTINUE",
       "Type": "STREAMING"
     }
   ]

NOTE: JSON arguments must include options and values as their own items in the list.

- Command (using step.json)::

aws emr add-steps --cluster-id j-XXXXXXXX --steps file://./step.json

- Output::

{
        "StepIds":[
            "s-XXXXXXXX",
            "s-YYYYYYYY"
        ]
    }

**3. To add a Streaming step with multiple files to a cluster (JSON only)**

- JSON (multiplefiles.json)::

[
     {
        "Name": "JSON Streaming Step",
        "Type": "STREAMING",
        "ActionOnFailure": "CONTINUE",
        "Args": [
            "-files",
            "s3://mybucket/mapper.py,s3://mybucket/reducer.py",
            "-mapper",
            "mapper.py",
            "-reducer",
            "reducer.py",
            "-input",
            "s3://mybucket/input",
            "-output",
            "s3://mybucket/output"]
     }
   ]

- Command::

aws emr add-steps --cluster-id j-XXXXXXXX  --steps file://./multiplefiles.json

- Required parameters::

Type, Args

- Optional parameters::

Name, ActionOnFailure

- Output::

{
        "StepIds":[
            "s-XXXXXXXX",
        ]
    }

**4. To add Hive steps to a cluster**

- Command::

aws emr add-steps --cluster-id j-XXXXXXXX --steps Type=HIVE,Name='Hive program',ActionOnFailure=CONTINUE,Args=[-f,s3://mybuckey/myhivescript.q,-d,INPUT=s3://mybucket/myhiveinput,-d,OUTPUT=s3://mybucket/myhiveoutput,arg1,arg2] Type=HIVE,Name='Hive steps',ActionOnFailure=TERMINATE_CLUSTER,Args=[-f,s3://elasticmapreduce/samples/hive-ads/libs/model-build.q,-d,INPUT=s3://elasticmapreduce/samples/hive-ads/tables,-d,OUTPUT=s3://mybucket/hive-ads/output/2014-04-18/11-07-32,-d,LIBS=s3://elasticmapreduce/samples/hive-ads/libs]

- Required parameters::

Type, Args

- Optional parameters::

Name, ActionOnFailure

- Output::

{
        "StepIds":[
            "s-XXXXXXXX",
            "s-YYYYYYYY"
        ]
    }

**5. To add Pig steps to a cluster**

- Command::

aws emr add-steps --cluster-id j-XXXXXXXX --steps Type=PIG,Name='Pig program',ActionOnFailure=CONTINUE,Args=[-f,s3://mybuckey/mypigscript.pig,-p,INPUT=s3://mybucket/mypiginput,-p,OUTPUT=s3://mybucket/mypigoutput,arg1,arg2] Type=PIG,Name='Pig program',Args=[-f,s3://elasticmapreduce/samples/pig-apache/do-reports2.pig,-p,INPUT=s3://elasticmapreduce/samples/pig-apache/input,-p,OUTPUT=s3://mybucket/pig-apache/output,arg1,arg2]

- Required parameters::

Type, Args

- Optional parameters::

Name, ActionOnFailure

- Output::

{
        "StepIds":[
            "s-XXXXXXXX",
            "s-YYYYYYYY"
        ]
    }

**6. To add Impala steps to a cluster**

- Command::

aws emr add-steps --cluster-id j-XXXXXXXX --steps Type=IMPALA,Name='Impala program',ActionOnFailure=CONTINUE,Args=--impala-script,s3://myimpala/input,--console-output-path,s3://myimpala/output

- Required parameters::

Type, Args

- Optional parameters::

Name, ActionOnFailure

- Output::

{
        "StepIds":[
            "s-XXXXXXXX",
            "s-YYYYYYYY"
        ]
    }