spark-sql-optimizer

Spark Sql Optimizer - Auto-activating skill for Data Pipelines. Triggers on: spark sql optimizer, spark sql optimizer Part of the Data Pipelines skill category.

1.02x

Quality

Does it follow best practices?

Impact

88%

1.02x

Average score across 3 eval scenarios

Securityby

Passed

No known issues

Optimize this skill with Tessl

npx tessl skill review --optimize ./planned-skills/generated/11-data-pipelines/spark-sql-optimizer/SKILL.md

Evaluation results

84%

-2%

Slow Customer Order Report

Join optimization and production-ready Spark code

Criteria

Without context

With context

Broadcast join hint

100%

Partition pruning filter

100%

SparkSession configuration

100%

Production-ready script

100%

Step-by-step documentation

100%

Rationale per step

100%

Avoid unnecessary shuffle

100%

80%

Validation approach

Customers join strategy

63%

Without context: $0.3260 · 1m 44s · 17 turns · 18 in / 5,322 out tokens

With context: $0.3839 · 1m 49s · 20 turns · 358 in / 5,421 out tokens

81%

Sales Aggregation ETL Refactor

ETL pipeline partition and aggregation optimization

Criteria

Without context

With context

Partition predicate pushdown

100%

Output partitioning strategy

100%

Output file format justification

100%

SparkSession configuration

100%

Production-ready script

100%

Step-by-step design notes

100%

Rationale for each step

100%

Data skew or coalesce consideration

50%

Validation or correctness check

Without context: $0.2100 · 1m 14s · 12 turns · 15 in / 3,907 out tokens

With context: $0.4603 · 1m 55s · 25 turns · 281 in / 6,094 out tokens

100%

Real-Time IoT Sensor Aggregation Pipeline

Streaming pipeline optimization and configuration

Criteria

Without context

With context

Watermark applied

100%

Window aggregation

100%

Checkpoint location set

100%

Trigger interval configured

100%

Kafka consumer tuning

100%

SparkSession streaming config

100%

Complete runnable script

100%

Step-by-step streaming design

100%

Watermark strategy explained

100%

Trigger choice explained

62%

100%

Without context: $0.2718 · 1m 37s · 12 turns · 15 in / 5,037 out tokens

With context: $0.4900 · 2m 51s · 24 turns · 24 in / 7,293 out tokens

Repository: jeremylongshore/claude-code-plugins-plus-skills
Commit: 0c08951

Evaluated: 17 days ago
Agent: Claude Code
Model: Claude Sonnet 4.6

Table of Contents

Slow Customer Order Report Sales Aggregation ETL Refactor Real-Time IoT Sensor Aggregation Pipeline

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.