File tree Expand file tree Collapse file tree 1 file changed +4
-1
lines changed Expand file tree Collapse file tree 1 file changed +4
-1
lines changed Original file line number Diff line number Diff line change @@ -228,7 +228,10 @@ You are strongly recommended to use a sandbox such as [docker](https://docs.dock
228228# If you want to change the RAM address space limit (in MB, 128 GB by default): `--max-as-limit XXX`
229229# If you want to change the RAM data segment limit (in MB, 4 GB by default): `--max-data-limit`
230230# If you want to change the RAM stack limit (in MB, 4 MB by default): `--max-stack-limit`
231- docker run -v $( pwd) :/app bigcodebench/bigcodebench-evaluate:latest --subset [complete| instruct] --samples samples-sanitized-calibrated
231+ docker run -v $( pwd) :/app bigcodebench/bigcodebench-evaluate:latest --subset [complete| instruct] --samples samples-sanitized-calibrated.jsonl
232+
233+ # If you only want to check the ground truths
234+ docker run -v $( pwd) :/app bigcodebench/bigcodebench-evaluate:latest --subset [complete| instruct] --samples samples-sanitized-calibrated.jsonl --check-gt-only
232235` ` `
233236
234237...Or if you want to try it locally regardless of the risks ⚠️:
You can’t perform that action at this time.
0 commit comments