Conversation
0e75662 to
2a77b64
Compare
|
@dantleech I've just tested the PHAR distribution of version 1.6.0 and got error with yq tool. /shared/backups/phar/phpbench-1.6.phar run --progress=json --config=/shared/backups/github/phplint/phpbench.json tests/Benchmark/ | yq -o jsonOr with yq auto-detecting format /shared/backups/phar/phpbench-1.6.phar run --progress=json --config=/shared/backups/github/phplint/phpbench.json tests/Benchmark/ | yqWhen I specify Any idea about incompatibility ? |
|
maybe try it with |
|
I get the same error with Using |
|
I got very strange results/behavior on project https://github.com/overtrue/phplint where I am a contributor since a long time now ! Here is the full benchmark test suite running with only 1 iteration (as suggested in your previous comment)
And if I remove the
Is there something we could do to prevent such failure ? |
|
Related to #1136 (comment), I've try to apply it with : My {
"report.generators": {
"github-action-benchmark": {
"cols": [
"name",
"unit",
"value",
"range",
"extra"
],
"expressions": {
"name": "format('%s::%s%s', first(benchmark_name),first(subject_name),if(first(variant_name) != false, format(' (%s)', first(variant_name)), ''))",
"unit": "coalesce(time_unit(first(subject_time_unit), true),'µs')",
"value": "time_convert(mode(result_time_avg), 'us', time_unit(first(subject_time_unit)))",
"range": "format('± %.2f%%', rstdev(result_time_avg))",
"extra": "format('%d iterations, %d revs', first(variant_iterations), first(variant_revs))"
},
"aggregate": [
"suite_tag",
"benchmark_class",
"subject_name",
"variant_index"
],
"generator": "expression"
}
},
"runner.bootstrap": "autoload.php",
"runner.php_disable_ini": true
}But, if I run full benchmarks tests (including
What was wrong in such condition ? |
this is a problem with phplint opening too many files - I don't think it's related to PHPBench. See https://stackoverflow.com/questions/14748499/fatal-error-too-many-open-files |
Plase comment on the original PR or open an issue :) but you don't need to specify |
|
Thanks @dantleech : Changing the maximum number of open file descriptors with phpbench run --report=github-action-benchmark --progress=json --output json tests/Benchmark/ | yq -p jsonGave me : last chunk of progress json was displayed, and final report
|




This PR adds support for streaming results via. a JSON progress logger: