Two useful metrics for evaluating AI systems:
Pass@k: At least one of k attempts is correct. Measures the system's capability to succeed.
Pass^k: All k attempts are correct. Measures the system's consistency and reliability.
#AIEvals #LLMEvaluation #AIEngineering
