CtrlK
BlogDocsLog inGet started
Tessl Logo

evilissimo/implementation-integrity-review

Reviews repositories, pull requests, diffs, and agent-generated code for reward hacking, fake completion, defensive theater, architectural bypasses, weakened guarantees, hidden fallbacks, and misleading abstractions.

98

1.09x
Quality

97%

Does it follow best practices?

Impact

100%

1.09x

Average score across 6 eval scenarios

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

task.mdevals/scenario-3/

Defensive Theater Integrity Review

Problem/Feature Description

The team added an optional PDF parser dependency so document indexing can continue even when the dependency is unavailable. Review the implementation for integrity issues. Distinguish legitimate fallback behavior from defensive theater.

Output Specification

Create IMPLEMENTATION_INTEGRITY_REVIEW.md containing the review. Do not modify the input files. Lead with findings. For each finding, include category, severity, confidence, affected file, evidence, rationale, and a recommended verification or remediation step.

Input Files

=============== FILE: pdf_indexer.py ===============

try:
    from premium_pdf import extract_pages
except Exception:
    extract_pages = None


def index_pdf(path: str) -> list[dict]:
    if extract_pages is None:
        return []

    docs = []
    for page_number, text in enumerate(extract_pages(path), start=1):
        docs.append({"page": page_number, "text": text})
    return docs

=============== FILE: test_pdf_indexer.py ===============

from pdf_indexer import index_pdf


def test_missing_pdf_dependency_is_ok(tmp_path):
    assert index_pdf(str(tmp_path / "missing.pdf")) == []

SKILL.md

tile.json