Skip to main content

☄️ Comet

Comet is an experiment tracking and logging platform for machine learning workloads. The Predibase / Comet integration allows developers to seamlessly track their fine-tuning jobs in Predibase from their Comet dashboard.

Track fine-tuning runs with Comet​

  1. Create a Comet account. Get an API key by clicking your avatar in the top right of app and clicking the API keys tab.
  2. Navigate to the Predibase app and go to Settings > My Profile. Under "Comet API Token" paste your API key.
  3. Click "Save Token" to save your API key.

Once you have saved your API key, your fine-tuning jobs will automatically be logged to your Comet dashboard. They will be under the project "predibase".

Project "predibase" auto-generated

The run name will be your adapter ID (which is the repo-name/version number).

Comet UI showing training metrics and logs for your adapter ID

Log LLM traces with Comet Opik​

The Opik platform allows you log, view and evaluate your LLM traces during both development and production. Using the Opik platform and its "LLM as a Judge" evaluators, you can identify and fix issues in your LLM application.

Try Opik with Predibase and Langchain