{{ benchmark_label }} · Question Pool

Review prompts in the current pool and remove any that should no longer be sampled.

Back to Queue Analytics

{% if removed_id %}

Removed question {{ removed_id }} from the pool.

{% elif error_code %}

{% if error_code == 'invalid' %} Unable to remove question. Missing pool path or question id. {% elif error_code == 'not_found' %} Question not found in the current pool. {% elif error_code == 'write_failed' %} Failed to update the question pool file. Please try again. {% else %} Unable to update the pool. {% endif %}

{% endif %} {% if pool_path %}

Pool file: {{ pool_path }} · {{ entries | length }} question(s)

{% else %}

No question pool configured for this benchmark.

{% endif %}

{% if not pool_path %}

Question pool path is not set in the configuration.

{% elif entries %} {% for entry in entries %} {% endfor %}

Rank	Question ID	Model Accuracy	Votes	Prompt Preview	Actions
{{ entry.rank or '—' }}	{{ entry.question_id }}	{% if entry.probability is not none %} {{ (entry.probability * 100) \| round(1) }}% {% else %} — {% endif %}	{{ entry.stats.correct_votes }}/{{ entry.stats.total_votes }} correct {{ entry.stats.inconsistent_votes }} inconsistent	{% set preview = entry.preview or '' %} {% if preview\|length > 160 %} {{ preview[:160] }}… {% else %} {{ preview or '—' }} {% endif %}

{% else %}

No questions found in the pool.

{% endif %}