setup-dev

Set up and manage the Sentry development environment using devenv. Handles fresh setup, updating existing environments, starting dev services, and troubleshooting. Use when asked to "set up sentry", "setup dev environment", "get sentry running", "start dev server", "devenv setup", "devservices not working", "sentry won't start", or any development environment issue.

1.43x

Quality

88%

Does it follow best practices?

Impact

93%

1.43x

Average score across 3 eval scenarios

Securityby

Risky

Do not use without reviewing

Evaluation results

80%

-10%

Fix Docker Runtime Detection in Sentry Dev Tools

OrbStack devservices.py socket fix

Criteria

Without context

With context

_find_docker_socket function

100%

Colima socket path included

100%

OrbStack socket path included

100%

Default docker.sock included

100%

Correct socket check order

100%

check_docker_daemon_running updated

100%

Error message mentions all runtimes

100%

os.path.exists used for detection

100%

Platform-specific path list

No Docker Desktop conflict warning removed

100%

41%

Write a Sentry Dev Environment Setup Script

Fresh dev environment setup guide

Criteria

Without context

With context

OS detection command

100%

devenv presence check

100%

devenv version check

100%

Docker runtime detection

25%

100%

direnv check

100%

Repo readiness check

50%

100%

Skip completed steps

100%

Direct devenv path for fresh sync

33%

100%

First-sync time warning

100%

devservices up time warning

100%

Dev server URL communicated

50%

100%

Cookie Sync extension mentioned

100%

52%

Sentry First-Time Startup Troubleshooting Runbook

First-time startup troubleshooting guide

Criteria

Without context

With context

sentry upgrade command

66%

100%

django migrate warning

100%

upgrade creates default data

25%

100%

createuser command

100%

Cookie Sync extension required

100%

Cookie Sync install link or name

100%

Kafka warnings are normal

100%

Kafka self-resolves timeframe

62%

100%

Dev server URL

100%

Verification steps

90%

100%

Repository: getsentry/sentry
Commit: 552fb5c

Evaluated: 2 days ago
Agent: Claude Code
Model: Claude Sonnet 4.6

Table of Contents

Fix Docker Runtime Detection in Sentry Dev Tools Write a Sentry Dev Environment Setup Script Sentry First-Time Startup Troubleshooting Runbook

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.