CtrlK
BlogDocsLog inGet started
Tessl Logo

jbaruch/koog

Koog 1.0 idioms, gotchas, and scaffolding skills for Kotlin agents on the JVM

86

1.86x
Quality

88%

Does it follow best practices?

Impact

86%

1.86x

Average score across 45 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-12/

{
  "context": "Tests whether the agent installs the SQL feature with read-only mode + schema scoping + row cap — the safety-first configuration — and pins the schema in the system prompt so the LLM doesn't hallucinate table/column names.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Installs the Sql feature in read-only mode",
      "description": "Calls install(Sql) { ... } with readOnly = true. Does NOT install in read-write mode (the developer explicitly wants read-only) and does NOT roll a custom SQL tool without the safety controls the feature provides",
      "max_score": 25
    },
    {
      "name": "Scopes the schema to the named tables",
      "description": "Sets schemaScope (or equivalent) to the developer's two named tables — public.events and public.users. Does not leave schemaScope unset (which would expose the full database) or include unrelated tables",
      "max_score": 25
    },
    {
      "name": "Caps result rows",
      "description": "Sets a maxRows cap (e.g., 100, 500, 1000 — any reasonable hard cap). Without this, an unbounded SELECT can return enormous results that blow context and query cost",
      "max_score": 15
    },
    {
      "name": "Reads DB credentials from environment",
      "description": "Reads ANALYTICS_DB_URL, ANALYTICS_DB_USER, ANALYTICS_DB_PASSWORD from System.getenv. Does not inline literals",
      "max_score": 15
    },
    {
      "name": "Pins schema in system prompt",
      "description": "Either includes the schema explicitly in systemPrompt OR enables a describe_schema discovery tool. Without one of these, the LLM hallucinates column names and queries fail",
      "max_score": 15
    },
    {
      "name": "Adds the agents-features-sql dependency and JDBC driver",
      "description": "Adds ai.koog:agents-features-sql at 1.0.0+ AND a Postgres JDBC driver. Koog does not bundle drivers",
      "max_score": 5
    }
  ]
}

evals

README.md

tile.json