feat: add audit for content fragment 404s

[holtvogt]

This PR introduces two new audits to monitor and analyze content fragment 404s on AEM. See SITES-35769.

What's New

• CDN Content Fragment 404 Audit (cdn-content-fragment-404): Monitors CDN logs hourly to identify content fragment requests that return 404 errors, using Athena queries to aggregate and export the data to S3 for further analysis and reporting.
• Content Fragment 404 Audit (content-fragment-404): Analyzes broken content fragment paths discovered in CDN logs on a daily basis, and intelligently suggests repair actions through a multi-step workflow that applies various strategies like republishing, locale fallbacks, and similar path matching.

Use Case

Health monitoring for Content Fragments on AEM Sites: Automatically detect broken content fragment requests across AEM Sites by monitoring CDN traffic patterns, identifying 404 errors, and providing actionable repair suggestions to maintain content availability and user experience.

Related

• Depends on
  • feat: add content fragment 404 audit type spacecat-shared#1049
  • feat: add AEM client package spacecat-shared#1249
  • https://git.corp.adobe.com/experience-platform/mystique/pull/1096

[github-actions]

This PR will trigger no release when merged.

[Copilot]

Pull Request Overview

This PR adds comprehensive audit functionality for detecting and suggesting fixes for broken content fragments in AEM environments. The implementation provides a robust system that analyzes CDN 404 logs and suggests content fixes through various strategies.

• CDN 404 analysis audit to process Fastly logs and identify broken content paths
• Broken content path audit system with multiple rule-based suggestion strategies (publish, locale fallback, similarity detection)
• Integration with AEM Author instances to verify content availability and suggest fixes

Reviewed Changes

Copilot reviewed 41 out of 41 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
src/index.js	Adds broken-content-path and cdn-404-analysis audit handlers to the main handlers registry
src/cdn-404-analysis/handler.js	Main handler for CDN 404 analysis with Athena integration for processing Fastly logs
src/broken-content-path/handler.js	Multi-step audit handler orchestrating content path analysis and suggestion generation
Multiple SQL files	Database and table creation scripts plus queries for Athena-based log analysis
Multiple domain classes	Content path, locale, language tree, path index, and suggestion domain models
Client and analysis classes	AEM Author client for content verification and analysis strategy for suggestion generation
Rule implementations	Three specialized rules for publish, locale fallback, and path similarity detection
Utility classes	Path manipulation, Levenshtein distance calculation, and other helper functions
Comprehensive test files	Full test coverage for all new functionality with integration scenarios

Comments suppressed due to low confidence (1)

src/broken-content-path/utils/path-utils.js:1

• The removeDoubleSlashes method incorrectly removes one slash from protocol URLs. The regex ^([^:]+:\/)\/+ should be ^([^:]+:\/)\/? to preserve the double slash in protocols while removing extras.

/*

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[Copilot]

Pull Request Overview

Copilot reviewed 41 out of 41 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

src/content-fragment-broken-links/utils/path-utils.js:1

• The removeDoubleSlashes function incorrectly removes one slash from protocol schemes. The expected result should preserve the protocol format 'http://example.com/path' rather than converting to 'http:/example.com/path'.

/*

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!