Creates an endpoint configuration that SageMaker hosting services uses to deploy models. In the configuration, you identify one or more models, created using the create_model
API, to deploy and the resources that you want SageMaker to provision. Then you call the create_endpoint
API.
See https://www.paws-r-sdk.com/docs/sagemaker_create_endpoint_config/ for full documentation.
sagemaker_create_endpoint_config(
EndpointConfigName,
ProductionVariants,
DataCaptureConfig = NULL,
Tags = NULL,
KmsKeyId = NULL,
AsyncInferenceConfig = NULL,
ExplainerConfig = NULL,
ShadowProductionVariants = NULL,
ExecutionRoleArn = NULL,
VpcConfig = NULL,
EnableNetworkIsolation = NULL
)
[required] The name of the endpoint configuration. You specify this name in a
create_endpoint
request.
[required] An array of ProductionVariant
objects, one for each model that you
want to host at this endpoint.
An array of key-value pairs. You can use tags to categorize your Amazon Web Services resources in different ways, for example, by purpose, owner, or environment. For more information, see Tagging Amazon Web Services Resources.
The Amazon Resource Name (ARN) of a Amazon Web Services Key Management Service key that SageMaker uses to encrypt data on the storage volume attached to the ML compute instance that hosts the endpoint.
The KmsKeyId can be any of the following formats:
Key ID: 1234abcd-12ab-34cd-56ef-1234567890ab
Key ARN:
arn:aws:kms:us-west-2:111122223333:key/1234abcd-12ab-34cd-56ef-1234567890ab
Alias name: alias/ExampleAlias
Alias name ARN:
arn:aws:kms:us-west-2:111122223333:alias/ExampleAlias
The KMS key policy must grant permission to the IAM role that you
specify in your create_endpoint
,
update_endpoint
requests. For more
information, refer to the Amazon Web Services Key Management Service
section Using Key Policies in Amazon Web Services KMS
Certain Nitro-based instances include local storage, dependent on the
instance type. Local storage volumes are encrypted using a hardware
module on the instance. You can't request a KmsKeyId
when using an
instance type with local storage. If any of the models that you specify
in the ProductionVariants
parameter use nitro-based instances with
local storage, do not specify a value for the KmsKeyId
parameter. If
you specify a value for KmsKeyId
when using any nitro-based instances
with local storage, the call to
create_endpoint_config
fails.
For a list of instance types that support local instance storage, see Instance Store Volumes.
For more information about local instance storage encryption, see SSD Instance Store Volumes.
Specifies configuration for how an endpoint performs asynchronous inference. This is a required field in order for your Endpoint to be invoked using InvokeEndpointAsync.
A member of create_endpoint_config
that enables explainers.
An array of ProductionVariant
objects, one for each model that you
want to host at this endpoint in shadow mode with production traffic
replicated from the model specified on ProductionVariants
. If you use
this field, you can only specify one variant for ProductionVariants
and one variant for ShadowProductionVariants
.
The Amazon Resource Name (ARN) of an IAM role that Amazon SageMaker AI can assume to perform actions on your behalf. For more information, see SageMaker AI Roles.
To be able to pass this role to Amazon SageMaker AI, the caller of this
action must have the iam:PassRole
permission.
Sets whether all model containers deployed to the endpoint are isolated. If they are, no inbound or outbound network calls can be made to or from the model containers.