Skip to main content

​
TrainingComputeSpec

The TrainingComputeSpec class provides configuration options for training compute.

​
General Hyperparameters

ParameterTypeRequiredDefaultDescription
regionstringYesThe region to use for training
requestsTrainingComputeRequestsYesThe number of requests to use for training

​
TrainingComputeRequests

The TrainingComputeRequests class contains specifications for training compute.

​
General Hyperparameters

ParameterTypeRequiredDefaultDescription
trainerComputeRequestYesThe instance type to use for training

​
ComputeRequest

The ComputeRequest class allows the user to request specific compute resources for training.
ParameterTypeRequiredDefaultDescription
skustringYesThe SKU to use for training
You can find the list of available SKUs here.

​
Example Usage

from predibase import TrainingComputeSpec, TrainingComputeRequests, ComputeRequest

compute_spec = TrainingComputeSpec(
    region="us-west-2",
    requests=TrainingComputeRequests(
        trainer=ComputeRequest(
            sku="a100_80gb_100"
        )
    )
)

pb.finetuning.jobs.create(
    config=SFTConfig(
        base_model="qwen3-8b",
        epochs=1,
        rank=8,
        target_modules=["q_proj", "v_proj", "k_proj"],
    ),
    dataset="tldr_news",
    compute_spec=compute_spec
)