CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/golang-github-com-google-go-github

Go client library for accessing the GitHub API v3

Agent Success

Agent success rate when using this tile

65%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.14x

Baseline

Agent success rate without this tile

57%

Overview
Eval results
Files

rubric.jsonevals/scenario-2/

{
  "context": "Evaluates whether the solution uses the go-github ActionsService to manage runners, caches, artifacts, and OIDC subject claim templates exactly as required by the spec, emphasizing correct API selection, pagination handling, and redirect-aware downloads.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Client setup",
      "description": "Creates the GitHub client with authentication and base URLs using github.NewClient combined with WithAuthToken and WithEnterpriseURLs so Actions calls authenticate and target the correct API and upload hosts.",
      "max_score": 15
    },
    {
      "name": "Runner snapshot",
      "description": "Uses Actions.ListRunners with ListRunnersOptions/ListOptions pagination to fetch all self-hosted runners for the repo, tallies Runner.Status and Runner.Busy fields into online/offline/busy counts, and filters LabelCounts using the provided label when present.",
      "max_score": 25
    },
    {
      "name": "Cache cleanup",
      "description": "Retrieves cache usage via Actions.ListCaches (with ActionsCacheListOptions key prefix and paging), sorts by SizeInBytes, compares LastAccessedAt to the cutoff, and when dryRun is false deletes flagged entries using Actions.DeleteCachesByKey or Actions.DeleteCachesByID while leaving others untouched.",
      "max_score": 25
    },
    {
      "name": "Artifact download",
      "description": "Finds the latest successful run using Actions.ListWorkflowRunsByFileName with Status='success', enumerates artifacts from Actions.ListWorkflowRunArtifacts to pick the named artifact, and downloads it through Actions.DownloadArtifact handling the returned redirect URL and streaming to the provided writer.",
      "max_score": 20
    },
    {
      "name": "OIDC template",
      "description": "Reads the subject-claim customization with Actions.GetRepoOIDCSubjectClaimCustomTemplate and only if the required claim is missing calls Actions.SetRepoOIDCSubjectClaimCustomTemplate with an updated OIDCSubjectClaimCustomTemplate.IncludeClaimKeys slice; skips updates when already present and reports the resulting keys.",
      "max_score": 15
    }
  ]
}
tessl i tessl/golang-github-com-google-go-github@79.0.1

tile.json