Lexica-AR Skill

This skill provides context and instructions for the Lexica-AR project, an Android AR application that overlays videos on PDF markers.

Project Architecture

• Frontend (Unity): Uses AR Foundation and ARCore for image tracking.
• Backend (Firebase): Manages marker-to-video mappings and authentication.
• Support Scripts (Python): Located in the backend/ directory for data processing.

Development Workflows

1. Unity AR Development

When working on the Unity client (located in unity-assets/):

• Ensure AR Foundation and ARCore XR Plugin are up to date.
• Manage ReferenceImageLibrary for adding new scan targets.
• The core logic for video overlays is usually in scripts attached to the AR Tracked Image Manager.

2. Firebase Mapping Management

To update video associations:

• Locate the Firebase Realtime Database configuration.
• Add or update the mapping: Marker_ID -> Video_URL.
• Ensure the Video URL is a direct link from Firebase Cloud Storage or a supported streaming provider.

3. Backend Scripts

The backend/ directory contains Python components.

• Use npm run dev or equivalent if a local dev server is present.
• Refer to backend/requirements.txt for dependencies.

Key Files

• PRD.md: Full product requirement details.
• implementation_plan.md: Technical strategy for the current phase.
• walkthrough.md: Record of completed and verified features.

Troubleshooting

• AR Tracking Jitter: Ensure the physical marker has high contrast and is not reflective.
• Video Playback Failure: Check if the URL is accessible and the format is supported by Unity's Video Player.