Creating the CloudFormation Stack in your AWS account
Click the invite link in your email to create your Predibase user account
Once you’ve created a user account, click on “AWS” and your preferred region
on the Select your Cloud page.
Sign into your AWS account.
Click the direct link to navigate to a CloudFormation Stack. Note that this
link is specific to your account and can’t be shared across accounts.
Once you’ve acknowledged the capabilities at the bottom of the page, click
“Create Stack”
Once you’ve clicked Create Stack, navigate to the Outputs Tab and copy
the key CustomerEnvironmentRoleArn’s value. Note that the value will take
about 4-5 minutes to populate.
Switch back to the Predibase setup page and paste the ARN value in the
RoleArn field, click “Validate Role Authorization”, and proceed with
provisioning.
Launch Provisioning of the Data PlaneOnce you’ve confirmed the Role ARN, Predibase will automatically begin to deploy
the Predibase dataplane in your environment.Feel free to navigate away while this provisioning process is in progress. On
average, it takes around 20-30 minutes but exact times can vary. We’ll send you
an email with the login link once the provisioning process is complete.
Do not delete the CloudFormation stack after your environment has finished provisioning.If intend to spin down your usage of Predibase entirely, you’ll need to deprovision your environment first to avoid incurring
unwanted costs.
There are two types of costs to expect with a VPC environment:
Base Cost: The estimated cost for running a VPC environment in AWS
us-west-2 is around $300/month, which covers the full cost to spin up the
dataplane in your environment, including an EKS cluster and S3 buckets.
Compute Usage Cost: Compute costs incurred by using CPU or GPU engines in
the platform. Please contact us to get a quote.
Both of these costs will be billed directly via AWS and appear on the
AWS Billing
Console.
Since the compute will run in your AWS account, you will need to ensure that
your AWS quotas are sufficient to run the Predibase Controlplane.We recommend the following are increased from their default value of 0:
“All G and VT Spot Instance Requests”
“Running On-Demand G and VT instances”
An increase to ~192 for both values should be sufficient to run multi-node
training engines, but a further increase may be necessary if you require more
GPUs for large training jobs.