Logging of Prompt Requests and Responses with Model Metrics

[houssam38]

Hi,

Add a logging feature to capture prompt requests and responses, including details such as the model name, input token count, and output token count.

This feature would provide valuable metrics on model usage, helping track and analyze how each model is utilized. Having these metrics available could also aid in optimizing prompt inputs, monitoring token usage, and managing costs.

Thx

[sixlive]

This data should be available.

$response = Prism::text()
    ->using(Provider::Anthropic, 'claude-3-sonnet')
    ->withPrompt('Explain quantum computing.')
    ->generate();

Total token usage for the request/response:

$response->usage->promptTokens
$response->usage->completionTokens

If you are using multi-step generation then you can get the usage of each step:

foreach ($response->steps as $step) {
   echo "Prompt tokens: {$step->usage->promptTokens}";
   echo "Completion tokens: {$step->usage->completionTokens}";
}

You can also see all the messages but inspecting each step. Each step is an instance of TextResult:

class TextResult
{
   /**
    * @param  array<int, ToolCall>  $toolCalls
    * @param  array<int, ToolResult>  $toolResults
    * @param  array{id: string, model: string}  $response
    * @param  array<int, Message>  $messages
    */
   public function __construct(
       public readonly string $text,
       public readonly FinishReason $finishReason,
       public readonly array $toolCalls,
       public readonly array $toolResults,
       public readonly Usage $usage,
       public readonly array $response,
       public readonly array $messages = [],
   ) {}
}

Was there something specific that you would like that we aren't returning?

[houssam38]

I'd like the package to automatically save requests and responses with usage directly to a database or file.
This system can be activated or deactivated directly via the configuration file.
If you like, I can develop this package in my repo or do the PR for integration?

[pushpak1300]

seems duplicate of this #56

[sixlive]

@houssam38 at the moment, I don't have plans to support storage mechanisms.

@pushpak1300 I think #56 is more about exposing raw request/response data. As I understand it, this request is about adding storage of the parts of the request / response lifecycle.