Refactor Explore and Atlas pages to use client components; implement article fetching and filtering logic

- Moved article fetching logic from ExplorePage to ExploreClient component.
- Created AtlasClient component for handling article display and channel filtering.
- Updated ChannelsSidebar to support multi-select for channels.
- Implemented search functionality in ExploreClient with debouncing.
- Added sitemap and robots.txt generation for SEO.
- Enhanced performance with content visibility and loading states.
- Updated developer documentation for environment setup and content publishing workflow.

Author: gitcoder89431

CHANGELOG.md

@@ -1,5 +1,26 @@
 # Atlas Frontend Development Changelog
 
+## Sept 24, 2025 — SSR Explore/Atlas, SEO, Caching
+
+Enhancements
+- Explore and Atlas now server-rendered with incremental static regeneration (`revalidate = 60`). Initial render is fast and SEO-friendly; client hydration handles interactions (search, channels, load more).
+- Added per-article `generateMetadata` for Monologue and Dialogue pages (title/description + OpenGraph/Twitter).
+- Added `sitemap.xml` and `robots.txt` (reads `NEXT_PUBLIC_SITE_URL`; defaults to `https://example.com`).
+- Articles API now returns cache headers: `public, s-maxage=60, stale-while-revalidate=300`.
+ - Added `.env.example` to document required env vars for local and Vercel.
+
+Developer Notes
+- Set `NEXT_PUBLIC_SITE_URL` in Vercel → Project Settings → Environment Variables → all environments, to generate correct absolute URLs in sitemap/robots.
+- Explore: moved data loading server-side; client component handles search/debounce only.
+- Atlas: moved feed data server-side; client component handles channel filters and load-more.
+
+Files Touched
+- `src/app/explore/page.tsx` (SSR page) + `src/app/explore/ExploreClient.tsx` (client UI)
+- `src/app/atlas/page.tsx` (SSR page) + `src/app/atlas/AtlasClient.tsx` (client UI)
+- `src/app/atlas/monologue/[slug]/page.tsx` and `src/app/atlas/dialogue/[slug]/page.tsx` (generateMetadata)
+- `src/app/api/articles/route.ts` (Cache-Control headers)
+- `src/app/sitemap.ts`, `src/app/robots.ts`
+
 ## Current Status: ✅ PRODUCTION READY - Enhanced Channel System with Multi-Select & Conversations
 
 ### 🎉 Latest Updates (Sept 24, 2025):
@@ -246,4 +267,4 @@
 
 **Codebase Health:** ✅ **READY FOR LAUNCH** - All core features polished, excellent user experience, production-ready
 
-**Theme System:** Tailwind CSS v4 + Geist fonts + auto dark/light mode via `globals.css` and `layout.tsx`
+**Theme System:** Tailwind CSS v4 + Geist fonts + auto dark/light mode via `globals.css` and `layout.tsx`

README.md

@@ -1,29 +1,16 @@
 # Atlas
 
-> Where history's greatest minds meet tomorrow's intelligence
+The bridge between past wisdom and future intelligence.
 
-Atlas is a curated platform for exploring conversations between history's most influential thinkers and the cutting edge of artificial intelligence. Through carefully crafted dialogues and monologues, we bridge centuries of human wisdom with modern computational thinking.
+Atlas is a curated reading experience that blends historical insight with modern thinking across three formats:
 
-## What Atlas Offers
+- Monologues — single‑voice essays inspired by legendary thinkers
+- Discussions — simulated dialogues between historical figures
+- Editorials — Ruixen commentary, context, and curation
 
-**🏛️ Agency** - Meet 27 historical personas, from Nobel laureates to classical philosophers. Each figure comes to life through rich biographical content and authentic voice modeling.
+Explore via the Atlas feed, search in Explore (title, author, tags), and browse featured personas in Agency.
 
-**📚 Atlas Feed** - Discover thought-provoking articles in an elegant, reader-focused interface. Each piece explores deep questions through the lens of great minds.
+Disclaimer
+- The personas, dialogues, and quotes presented here are simulated/creative reconstructions for exploration and learning. They do not represent actual statements by the historical figures. Please verify with original sources where accuracy matters.
 
-**🔍 Explore** - Search and filter through our growing collection of dialogues, monologues, and analytical pieces. Find exactly what sparks your curiosity.
-
-**💭 Dialogues** - Witness conversations that transcend time. Watch Darwin and Turing explore the computational nature of evolution, or see Ostrom and Wiener debate cybernetic governance.
-
-**📝 Monologues** - Experience the world through the eyes of history's greatest thinkers. From Feynman on consciousness to Turing on machine intelligence.
-
-## Featured Thinkers
-
-Our current collection includes minds like Richard Feynman, Marie Curie, Alan Turing, Charles Darwin, Elinor Ostrom, Marcus Aurelius, Hannah Arendt, Leonardo da Vinci, and many others - each contributing their unique perspective to modern questions.
-
-## Philosophy
-
-Atlas believes that the wisdom of the past can illuminate the challenges of tomorrow. By creating authentic conversations between historical figures and contemporary ideas, we explore how timeless insights apply to our rapidly evolving world.
-
----
-
-*Built with Next.js, TypeScript, and Tailwind CSS. Powered by thoughtful design and respect for intellectual heritage.*
+Developer documentation has moved to dev_readme.md.

dev_readme.md

@@ -0,0 +1,67 @@
+# Atlas Developer Guide
+
+This document covers environment configuration, deployment notes, and the content publishing workflow. The public README is intentionally user‑focused.
+
+## Environment & URLs
+
+Set this environment variable so `sitemap.xml` and `robots.txt` generate correct absolute URLs:
+
+- `NEXT_PUBLIC_SITE_URL` — your site origin.
+  - Local dev: `http://localhost:3000`
+  - Vercel preview: `https://<your-app>.vercel.app`
+  - Production: `https://your-domain.com`
+
+Local setup:
+1. Copy `.env.example` to `.env.local`.
+2. Set `NEXT_PUBLIC_SITE_URL` appropriately.
+
+Vercel setup:
+- Project Settings → Environment Variables → add `NEXT_PUBLIC_SITE_URL` for Production, Preview, and Development.
+
+## Rendering & Caching Model
+
+- Explore and Atlas are server-rendered with ISR (`revalidate = 60`). The initial HTML is static for SEO and fast TTFB; client hydration powers interactions (search, channels, load more).
+- API `/api/articles` returns cache headers: `public, s-maxage=60, stale-while-revalidate=300`.
+- Per-article pages (`/atlas/monologue/[slug]`, `/atlas/dialogue/[slug]`) export `generateStaticParams` and `generateMetadata` for full SSG + SEO.
+
+## Publishing Content
+
+This project uses SSG from Markdown:
+1. Add `.md` files under `src/content/monologues` or `src/content/dialogues`.
+2. Commit and push to trigger a Vercel build.
+3. New content appears automatically (sorted by `date` in frontmatter). Explore/Atlas lists are refreshed via ISR.
+
+Frontmatter reference (minimal):
+```
+title: "My Article Title"
+date: "2025-09-24"
+type: "monologue" # or "dialogue"
+tags: ["topic", "keyword"]
+summary: "Optional 1–2 sentences for SEO/social."
+author: "Author Name" # For dialogues, use "A & B"
+```
+
+## SEO
+
+- `generateMetadata` creates page `title`/`description` and OpenGraph/Twitter tags from frontmatter/summary.
+- `src/app/sitemap.ts` and `src/app/robots.ts` use `NEXT_PUBLIC_SITE_URL`.
+
+## Performance Notes
+
+- Images use `next/image` where appropriate (avatars, logo, testimonials). Videos on Agency lazy‑load and autoplay only in viewport, respecting reduced motion.
+- Long lists use `content-visibility: auto` to defer off‑screen rendering.
+- Explore search input is debounced (200ms).
+
+## File Map (related changes)
+
+- Explore: `src/app/explore/page.tsx` (SSR) + `src/app/explore/ExploreClient.tsx` (client UI)
+- Atlas: `src/app/atlas/page.tsx` (SSR) + `src/app/atlas/AtlasClient.tsx` (client UI)
+- SEO: `src/app/atlas/monologue/[slug]/page.tsx`, `src/app/atlas/dialogue/[slug]/page.tsx`
+- Caching: `src/app/api/articles/route.ts`
+- Indexing: `src/app/sitemap.ts`, `src/app/robots.ts`
+
+## Development Tips
+
+- Set `NEXT_PUBLIC_SITE_URL` even locally to sanity‑check sitemap/robots.
+- If you later add thumbnails, extend `generateMetadata` to include `openGraph.images`.
+

src/app/api/articles/route.ts

@@ -6,10 +6,14 @@ export const runtime = 'nodejs'
 export async function GET() {
   try {
     const articles = await getAllArticles()
-    return NextResponse.json(articles)
+    return NextResponse.json(articles, {
+      headers: {
+        // Cache at the edge for 60s, serve stale for 5 minutes while revalidating
+        'Cache-Control': 'public, s-maxage=60, stale-while-revalidate=300'
+      }
+    })
   } catch (error) {
     console.error('Failed to fetch articles:', error)
     return NextResponse.json({ error: 'Failed to fetch articles' }, { status: 500 })
   }
 }
-