Comet ☄️

Comet provides experiment tracking and logging for machine learning workloads. The integration enables tracking of fine-tuning jobs and LLM traces.

Setup

  1. Create a Comet account and get an API key
  2. Navigate to Settings > My Profile in Predibase
  3. Paste your Comet API key under “Comet API Token”
  4. Click “Save Token”
Your fine-tuning jobs will automatically be logged to your Comet dashboard under the project “predibase”. The run name will be your adapter ID (repo-name/version number).

Comet Opik

Comet’s Opik platform allows you to log, view and evaluate your LLM traces during development and production. Using Opik’s “LLM as a Judge” evaluators, you can identify and fix issues in your LLM application. Try Opik with Predibase and Langchain