Go client library for accessing the GitHub API v3
Agent Success
Agent success rate when using this tile
65%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.14x
Baseline
Agent success rate without this tile
57%
{
"context": "Evaluates whether the solution uses the go-github ActionsService to manage runners, caches, artifacts, and OIDC subject claim templates exactly as required by the spec, emphasizing correct API selection, pagination handling, and redirect-aware downloads.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Client setup",
"description": "Creates the GitHub client with authentication and base URLs using github.NewClient combined with WithAuthToken and WithEnterpriseURLs so Actions calls authenticate and target the correct API and upload hosts.",
"max_score": 15
},
{
"name": "Runner snapshot",
"description": "Uses Actions.ListRunners with ListRunnersOptions/ListOptions pagination to fetch all self-hosted runners for the repo, tallies Runner.Status and Runner.Busy fields into online/offline/busy counts, and filters LabelCounts using the provided label when present.",
"max_score": 25
},
{
"name": "Cache cleanup",
"description": "Retrieves cache usage via Actions.ListCaches (with ActionsCacheListOptions key prefix and paging), sorts by SizeInBytes, compares LastAccessedAt to the cutoff, and when dryRun is false deletes flagged entries using Actions.DeleteCachesByKey or Actions.DeleteCachesByID while leaving others untouched.",
"max_score": 25
},
{
"name": "Artifact download",
"description": "Finds the latest successful run using Actions.ListWorkflowRunsByFileName with Status='success', enumerates artifacts from Actions.ListWorkflowRunArtifacts to pick the named artifact, and downloads it through Actions.DownloadArtifact handling the returned redirect URL and streaming to the provided writer.",
"max_score": 20
},
{
"name": "OIDC template",
"description": "Reads the subject-claim customization with Actions.GetRepoOIDCSubjectClaimCustomTemplate and only if the required claim is missing calls Actions.SetRepoOIDCSubjectClaimCustomTemplate with an updated OIDCSubjectClaimCustomTemplate.IncludeClaimKeys slice; skips updates when already present and reports the resulting keys.",
"max_score": 15
}
]
}tessl i tessl/golang-github-com-google-go-github@79.0.1docs
evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10