Issues

• Support multiple values (OR) for a single key in --filter-metadata

  promptfoo/promptfoo#11305 · Filter by author 50kgofpacifictuna opened on Sep 29, 2026

• Example request: multi-dimension rubric eval for a customer support assistant, with severity gating

  promptfoo/promptfoo#11263 · Filter by author kakkarprerna opened on Sep 28, 2026

• anthropic:claude-agent-sdk: copy working_dir into a new directory for each call and each repeat

  promptfoo/promptfoo#11057 · Filter by author moltar opened on Sep 24, 2026
  1

• Prp

  promptfoo/promptfoo#11048 · Filter by author annikkarasabik-cmd opened on Sep 23, 2026

• Add TypeSafe Jev provider

  promptfoo/promptfoo#11042 · Filter by author athul0rameshan9 opened on Sep 23, 2026
  2

• isEmptyResponse treats transport failures (empty, undefined, null) as refusals, so a dead endpoint scores clean on 130 of 138 redteam graders

  promptfoo/promptfoo#11041 · Filter by author shaurya416 opened on Sep 23, 2026

• custom and voice-crescendo strategies ignore an explicitly configured redteamProvider and use remote generation instead

  promptfoo/promptfoo#10977 · Filter by author he-yufeng opened on Sep 17, 2026

• Chat and Tool discussion, all models supported

  promptfoo/promptfoo#10973 · Filter by author fletort opened on Sep 17, 2026
  2

• --filter-providers makes an exception

  promptfoo/promptfoo#10932 · Filter by author fletort opened on Sep 14, 2026
  1

• Python provider hangs or exits without output after worker crashes or a timeout

  promptfoo/promptfoo#10928 · Filter by author mosafariuk opened on Sep 14, 2026

• --no-cache is ignored when an extension hook imports from promptfoo

  promptfoo/promptfoo#10787 · Filter by author Amiyanshu-web opened on Sep 8, 2026

• test(examples): cover trajectory step status in OpenTelemetry agent example

  promptfoo/promptfoo#10609 · Filter by author Asthenia0412 opened on Sep 2, 2026

• feat(assertions): evaluate trajectory step execution status

  promptfoo/promptfoo#10607 · Filter by author Asthenia0412 opened on Sep 2, 2026

• Should avgLatencyMs reflect replayed latency for cache-hit responses?

  promptfoo/promptfoo#10595 · Filter by author roy-tong opened on Sep 1, 2026
  4

• agent-rubric: the only prompt-injection control I found in a 9-framework survey

  promptfoo/promptfoo#10575 · Filter by author idilgozel opened on Aug 31, 2026
  1

• Discussion: Deeper CI/CD PR integration and local Ollama command execution?

  promptfoo/promptfoo#10548 · Filter by author mukundzha opened on Aug 29, 2026
  1

• openai:chat apiBaseUrl must include /v1; default graders still use gpt-5.5

  promptfoo/promptfoo#10526 · Filter by author cursor opened on Aug 28, 2026
  1

• opencode:sdk provider never threads per-call traceparent to the OpenCode server, breaking trajectory:* assertions

  promptfoo/promptfoo#10518 · Filter by author b-per opened on Aug 27, 2026
  1

• Question: stable per-assertion output for an external adapter

  promptfoo/promptfoo#10514 · Filter by author GautamTalksDev opened on Aug 26, 2026
  1

• Proposal: opt-in live pricing fallback via OpenRouter's public models API for unrecognized models

  promptfoo/promptfoo#10513 · Filter by author kimyongjun0129 opened on Aug 26, 2026

• Benchmarked promptfoo against two third-party targets, plus a question about plugin selection

  promptfoo/promptfoo#10505 · Filter by author qatration opened on Aug 26, 2026
  3

• RangeError: Maximum call stack size exceeded (rfdc clone of live Anthropic client) when a grading provider id matches a target provider id — regression in 0.121.13 (still present in 0.122.0)

  promptfoo/promptfoo#10501 · Filter by author kimyongjun0129 opened on Aug 26, 2026
  1

• Do not collapse factuality/closed-QA grader failures into assertion failures

  promptfoo/promptfoo#10481 · Filter by author dgenio opened on Aug 24, 2026

• llm-rubric with value: file:// doesn't interpolate variables

  promptfoo/promptfoo#10447 · Filter by author dkling-it opened on Aug 20, 2026
  1

• Opt-in tamper-evident evals: lock the config's tests + pass threshold to a hash before the run (working example included)

  promptfoo/promptfoo#10439 · Filter by author sk8ordie84 opened on Aug 19, 2026