Amazon EMR is a web service that makes it easy to process large amounts of data efficiently. Amazon EMR uses Hadoop processing combined with several AWS products to do tasks such as web indexing, data mining, log file analysis, machine learning, scientific simulation, and data warehousing.
emr(config = list())Optional configuration of credentials, endpoint, and/or region.
svc <- emr(
config = list(
credentials = list(
creds = list(
access_key_id = "string",
secret_access_key = "string",
session_token = "string"
),
profile = "string"
),
endpoint = "string",
region = "string"
)
)
| add_instance_fleet | Adds an instance fleet to a running cluster |
| add_instance_groups | Adds one or more instance groups to a running cluster |
| add_job_flow_steps | AddJobFlowSteps adds new steps to a running cluster |
| add_tags | Adds tags to an Amazon EMR resource |
| cancel_steps | Cancels a pending step or steps in a running cluster |
| create_security_configuration | Creates a security configuration, which is stored in the service and can be specified when a cluster is created |
| delete_security_configuration | Deletes a security configuration |
| describe_cluster | Provides cluster-level details including status, hardware and software configuration, VPC settings, and so on |
| describe_job_flows | This API is deprecated and will eventually be removed |
| describe_security_configuration | Provides the details of a security configuration by returning the configuration JSON |
| describe_step | Provides more detail about the cluster step |
| get_block_public_access_configuration | Returns the Amazon EMR block public access configuration for your AWS account in the current Region |
| list_bootstrap_actions | Provides information about the bootstrap actions associated with a cluster |
| list_clusters | Provides the status of all clusters visible to this AWS account |
| list_instance_fleets | Lists all available details about the instance fleets in a cluster |
| list_instance_groups | Provides all available details about the instance groups in a cluster |
| list_instances | Provides information for all active EC2 instances and EC2 instances terminated in the last 30 days, up to a maximum of 2,000 |
| list_security_configurations | Lists all the security configurations visible to this account, providing their creation dates and times, and their names |
| list_steps | Provides a list of steps for the cluster in reverse order unless you specify stepIds with the request of filter by StepStates |
| modify_cluster | Modifies the number of steps that can be executed concurrently for the cluster specified using ClusterID |
| modify_instance_fleet | Modifies the target On-Demand and target Spot capacities for the instance fleet with the specified InstanceFleetID within the cluster specified using ClusterID |
| modify_instance_groups | ModifyInstanceGroups modifies the number of nodes and configuration settings of an instance group |
| put_auto_scaling_policy | Creates or updates an automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster |
| put_block_public_access_configuration | Creates or updates an Amazon EMR block public access configuration for your AWS account in the current Region |
| remove_auto_scaling_policy | Removes an automatic scaling policy from a specified instance group within an EMR cluster |
| remove_tags | Removes tags from an Amazon EMR resource |
| run_job_flow | RunJobFlow creates and starts running a new cluster (job flow) |
| set_termination_protection | SetTerminationProtection locks a cluster (job flow) so the EC2 instances in the cluster cannot be terminated by user intervention, an API call, or in the event of a job-flow error |
| set_visible_to_all_users | Sets the Cluster$VisibleToAllUsers value, which determines whether the cluster is visible to all IAM users of the AWS account associated with the cluster |
# NOT RUN {
svc <- emr()
svc$add_instance_fleet(
Foo = 123
)
# }
# NOT RUN {
# }
Run the code above in your browser using DataLab