Skip to content

Add feedback buttons that integrate with observability tools #759

@thepatrickchin

Description

@thepatrickchin

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Medium

Please provide a clear description of problem this feature solves

Currently there is no way to provide feedback on the quality of responses given by the LLM. Providing a way for users to indicate whether an agent's response is good or bad would provide valuable data for helping to refine models and system prompts.

Describe your ideal solution

Simple thumbs-up / thumbs-down button in the chat message component for assistant responses like so:

Image

Assuming the workflow has Weave integration enabled, the Weave call ID would be provided as part of the message payload. When user clicks on one of the buttons, the Weave feedback API would be invoked to set the reaction for that particular trace to display it in Weave UI:

Image

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
  • I have searched the open feature requests and have found no duplicates for this feature request

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions