Introduction
Poolside has two main deployment modalities:- Amazon EC2
- Amazon Bedrock
Amazon EC2
To subscribe on Amazon EC2, work with your Account Manager to ensure your AWS account is unblocked on the AWS Marketplace listing page. Then go to Poolside AWS Subscription.You must be signed in to an AWS account to access the Poolside AWS Subscription page.
Metering only accounts for the number of output tokens. For example, if you send 7000 input tokens and the model generates 500 output tokens, you are charged 500 tokens times the model unit price.
Amazon GovCloud for EC2-based deployments
To subscribe to Poolside in AWS GovCloud, navigate to Poolside AWS Subscription from your linked commercial account and follow the same process as in the public AWS Marketplace.You must be signed in to an AWS account to access the Poolside AWS Subscription page.
Amazon Bedrock
To deploy on Amazon Bedrock, work with your Account Manager to ensure your account is unblocked in the listing. Then go to the Amazon Bedrock model catalog, select your Point and Malibu models, and follow the instructions. After you accept the terms, contact your Poolside point of contact. They provide installation scripts and deployment support. After installation, Poolside immediately starts tracking your output tokens and sending them to AWS Bedrock.Marketplace metric collection
The Poolside Platform Core API service publishes metrics to the AWS Marketplace Metering Service API. For more information, see Using the AWS Marketplace Metering API in the AWS documentation. The Poolside Platform pushes metrics every hour, or when a Poolside Core API container stops.Health monitoring
Use Container Insights to monitor the EKS cluster and its nodes. For more information, see Amazon EKS and Kubernetes Container Insights metrics in the AWS documentation. Work with your Poolside representative to explore configuring alarms and alerts using tools such as Amazon CloudWatch.AWS infrastructure costs
To view only Poolside-related costs in your monthly AWS bill, use AWS Cost Explorer with AWS cost allocation tags. In the AWS Billing and Cost Management console, you can enable AWS cost allocation tags. This lets you filter by a specific tag and see only the costs associated with that tag. For Poolside, enable cost allocation tags for a tag applied during your infrastructure setup.If you are using Amazon Bedrock for inference, this does not include those costs.