30 lines
720 B
Markdown
30 lines
720 B
Markdown
|
---
|
||
|
|
title: "LLM Confidence Chat Interface"
|
||
|
|
draft: true
|
||
|
|
date: 2024-06-01
|
||
|
|
tags: ["Python", "ML", "Full-Stack"]
|
||
|
|
summary: "A chat interface making LLM confidence scores accessible to non-technical users."
|
||
|
|
code: "https://github.com/yourusername/project"
|
||
|
|
demo: "https://demo.example.com"
|
||
|
|
---
|
||
|
|
|
||
|
|
## Problem
|
||
|
|
|
||
|
|
Non-technical users have no way to assess how confident an LLM is in its responses.
|
||
|
|
|
||
|
|
## Approach
|
||
|
|
|
||
|
|
Built an interactive chat interface integrating lm-polygraph for
|
||
|
|
uncertainty estimation with an intuitive visualization layer.
|
||
|
|
|
||
|
|
## Tech Stack
|
||
|
|
|
||
|
|
- Python, FastAPI
|
||
|
|
- lm-polygraph
|
||
|
|
- React
|
||
|
|
|
||
|
|
## Challenges & Learnings
|
||
|
|
|
||
|
|
Translating probabilistic outputs into user-friendly visual indicators
|
||
|
|
while keeping the interface responsive.
|