CtrlK
BlogDocsLog inGet started
Tessl Logo

confluent-cloud-cdc-tableflow

Set up end-to-end Change Data Capture (CDC) pipelines on Confluent Cloud using Debezium source connectors, Flink for transformation, and Tableflow for data lake integration. Supports JSON_SR, Avro, and Protobuf formats. Handles schemaless topics (plain JSON without SR) and multi-event topics. This skill handles the complete workflow from database to Iceberg/Delta tables. Use this skill when users want to capture database changes and materialize them into Iceberg or Delta Lake tables via Confluent Cloud Tableflow. Trigger phrases include "CDC to Tableflow", "database to Iceberg", "database to Delta Lake", "stream database changes to data lake", "set up Tableflow pipeline", "schemaless topic to Tableflow", or "multi-event topic to Iceberg". Do NOT trigger for general CDC, Debezium, or database replication requests that do not involve Tableflow or Iceberg/Delta Lake as the destination.

75

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

High

Do not use without reviewing

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality operational skill body: it leads with critical, non-obvious architecture rules (never enable Tableflow on CDC source topics; changelog mode is immutable), then walks a fully validated six-phase workflow with executable MCP/CLI/SQL at every step and real reference files for depth. The only improvement area is moving some long command catalogs and duplicate troubleshooting content into the existing reference files to slim the main body.

Suggestions

Move the Phase 0 CLI fallback command catalog (~25 lines of confluent CLI examples) into references/rest-api.md or a new references/cli-reference.md, keeping only a two-line pointer in the body — this serves both conciseness and progressive_disclosure.

Drop the trailing '## References' section or reduce it to the three external doc URLs; the five internal file links are already signaled inline at their point of use, and repeating them is redundant.

Replace the quick-reference troubleshooting table in Phase 4.2 with a pointer to references/troubleshooting.md (keeping only the 2–3 most pipeline-blocking rows inline) to avoid duplicating content that already exists in the reference file.

DimensionReasoningScore

Conciseness

The body is dense with non-obvious operational knowledge Claude cannot be assumed to know ("Tableflow caches the changelog mode... when it first materializes data", "The MCP create-tableflow-topic tool does NOT accept environmentId or clusterId parameters", Cloud Flink auto-discovery rules), so almost every token earns its place. Minor trims are possible: the ~25-line CLI fallback command dump in Phase 0 partially duplicates CLI usage shown in later phases, and the closing "References" list repeats links already given inline. That puts it at anchor 4 ("efficient; minor instances of over-explanation that could be trimmed") rather than 5; it is well above anchor 3 because no section explains general concepts Claude already knows.

4 / 5

Actionability

Guidance is fully executable throughout: complete CLI commands with all flags ("confluent tableflow topic enable target_customers --cluster <cluster-id> --environment <env-id> --storage-type MANAGED --table-formats ICEBERG"), copy-paste-ready Flink SQL with explicit upsert-mode WITH clauses, concrete MCP call signatures with parameters, and specific error-message-to-fix mappings ("'Incompatible types for sink column' → check Debezium type mappings"). The only deferred artifact (connector configs) is properly delegated to a real reference file. This matches anchor 5 ("fully executable; copy-paste ready... specific examples cover the common cases"); anchor 4's 'minor gaps' don't apply since even known failure modes come with exact remedies.

5 / 5

Workflow Clarity

The six phases (0–5) are clearly sequenced with validation checkpoints after every component: poll "read-connector — tasks: [] means still provisioning", verify schemas registered, confirm CDC table appears in SHOW TABLES, confirm the INSERT job reaches RUNNING not FAILED, confirm Tableflow transitions PENDING → ACTIVE, and a final end-to-end verification table. Destructive/batch operations are well-guarded with an explicit deletion-order list and the warning "Never delete CDC source Kafka topics while the connector is still running", plus a troubleshooting table forming feedback loops. This is a clear anchor-5 match ("explicit validation steps; feedback loops for error recovery; checklists").

5 / 5

Progressive Disclosure

Structure is good: all five "references/*.md" files cited in the body exist on disk, are one level deep, and are signaled at the point of need ("See references/connector-configs.md 'Handling Topics Without Schema Registry'"). However, the ~520-line body carries detail that could live in the reference layer — the full Phase 0 CLI fallback command catalog, the DynamoDB Flink extraction example, and the quick-reference troubleshooting table that duplicates references/troubleshooting.md. That is anchor 4 ("good structure; most content appropriately placed... minor organization gaps") rather than 5, which requires the body itself to be a lean overview.

4 / 5

Total

18

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: it states concrete capabilities in third person, covers formats and edge cases (schemaless and multi-event topics), gives explicit 'Use when' guidance with natural trigger phrases for both destination formats, and adds explicit anti-triggers to prevent misfiring on general CDC/Debezium requests. No changes needed.

DimensionReasoningScore

Specificity

The description enumerates multiple concrete, verifiable capabilities — "Set up end-to-end Change Data Capture (CDC) pipelines on Confluent Cloud using Debezium source connectors, Flink for transformation, and Tableflow for data lake integration", "Supports JSON_SR, Avro, and Protobuf formats", "Handles schemaless topics (plain JSON without SR) and multi-event topics" — naming specific technologies, formats, and edge cases. Coverage is comprehensive across the whole pipeline (source DB → Iceberg/Delta), and voice is consistently third person ("Set up", "Handles", "materialize"), so no specificity penalty applies. It clearly exceeds anchor 4 ("several specific actions; minor gaps") since no meaningful capability of the skill is left unnamed.

5 / 5

Completeness

It explicitly answers both required questions: what ("Set up end-to-end Change Data Capture (CDC) pipelines... from database to Iceberg/Delta tables") and when ("Use this skill when users want to capture database changes and materialize them into Iceberg or Delta Lake tables via Confluent Cloud Tableflow"), plus a concrete trigger-phrase list. This is a textbook match for anchor 5 ("clearly and explicitly answers both what AND when with concrete trigger phrases"); it goes beyond anchor 4 by enumerating trigger phrases rather than leaving 'when' only partially specified.

5 / 5

Trigger Term Quality

It provides an explicit list of natural trigger phrases a user would realistically say: "CDC to Tableflow", "database to Iceberg", "database to Delta Lake", "stream database changes to data lake", "set up Tableflow pipeline", "schemaless topic to Tableflow", "multi-event topic to Iceberg" — covering synonyms, both destination formats, and both plain-English and product-name variants. This matches anchor 5's "comprehensive coverage of natural terms including synonyms"; anchor 4 ("a few natural terms missing") doesn't apply since both table formats and the schemaless/multi-event variants are all covered.

5 / 5

Distinctiveness Conflict Risk

The niche is tightly defined (CDC → Confluent Cloud Tableflow → Iceberg/Delta), and it adds explicit negative scoping: "Do NOT trigger for general CDC, Debezium, or database replication requests that do not involve Tableflow or Iceberg/Delta Lake as the destination." That exclusion boundary eliminates the main overlap risk with generic Debezium/replication skills, satisfying anchor 5 ("clear niche with distinct triggers; minimal conflict risk"); anchor 4's 'minor overlap risk' is already addressed by the explicit anti-trigger clause.

5 / 5

Total

20

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (523 lines); consider splitting into references/ and linking

Warning

Total

15

/

16

Passed

Repository
confluentinc/agent-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.