CtrlK
BlogDocsLog inGet started
Tessl Logo

evilissimo/implementation-integrity-review

Reviews repositories, pull requests, diffs, and agent-generated code for reward hacking, fake completion, defensive theater, architectural bypasses, weakened guarantees, hidden fallbacks, and misleading abstractions.

98

1.09x
Quality

97%

Does it follow best practices?

Impact

100%

1.09x

Average score across 6 eval scenarios

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

task.mdevals/scenario-2/

Fake Provider Abstraction Integrity Review

Problem/Feature Description

A new provider abstraction was introduced for email delivery. The author says it prepares the system for multiple vendors. Review whether this abstraction is real or creates false confidence.

Output Specification

Create IMPLEMENTATION_INTEGRITY_REVIEW.md containing the review. Do not modify the input files. Lead with findings. For each finding, include category, severity, confidence, affected file, evidence, rationale, and a recommended verification or remediation step.

Input Files

=============== FILE: email_provider.py ===============

class EmailProvider:
    def send(self, recipient: str, subject: str, body: str) -> bool:
        raise NotImplementedError


class SendGridProvider(EmailProvider):
    def send(self, recipient: str, subject: str, body: str) -> bool:
        return True


class EmailService:
    def __init__(self):
        self.provider = SendGridProvider()

    def send_welcome_email(self, user):
        return self.provider.send(user.email, "Welcome", "Thanks for signing up")

=============== FILE: test_email_provider.py ===============

from email_provider import EmailService


class User:
    email = "new@example.com"


def test_welcome_email_succeeds():
    assert EmailService().send_welcome_email(User()) is True

SKILL.md

tile.json