Python wrapper and version management tool for the solc Solidity compiler.
77
Evaluation — 77%
↑ 1.05xAgent success when using this tile
{
"context": "Evaluates whether the solution uses py-solc-x compilation helpers to compile Solidity sources, especially leveraging the allow_empty option to permit scaffold runs with no contracts while still surfacing real compiler errors and artifacts.",
"type": "weighted_checklist",
"checklist": [
{
"name": "allow_empty path",
"description": "Invokes py-solc-x compilation (compile_files or compile_source) with allow_empty=true to let runs with zero contracts complete without raising.",
"max_score": 40
},
{
"name": "error when disallowed",
"description": "With allow_empty=false, relies on py-solc-x to raise a SolcError (or equivalent compile_* exception) for contractless sources instead of swallowing or fabricating errors.",
"max_score": 25
},
{
"name": "real artifacts",
"description": "For non-empty inputs, pulls contract ABI/bytecode data from the compile_* result (e.g., the contracts mapping returned by compile_files/compile_source) rather than constructing placeholders.",
"max_score": 20
},
{
"name": "empty notes",
"description": "When allow_empty succeeds, returns an explicit note derived from the compile_* call (or a detected empty contracts map) indicating no contracts were found while leaving the contracts mapping empty.",
"max_score": 15
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-py-solc-xevals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10