docs: add the docs for intake and experiments

[jeremysilva1098]

Summary by CodeRabbit

• Documentation
  • Added comprehensive guidance for observing AI agents, including telemetry ingestion, trace review, annotations, evaluator results, experiments, and troubleshooting.
  • Added documentation for comparing evaluation runs using metrics such as cost, latency, and evaluator scores.
  • Added navigation links to the new Agents observability and Experiments guides.

[github-actions]

🌿 Preview your docs: https://nvidia-preview-pr-1048-intake-exp-docs-jesilva.docs.buildwithfern.com/nemo-platform

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 41660915-51c4-400a-9698-615a0971c7af

📥 Commits

Reviewing files that changed from the base of the PR and between e31dedd and 1d6adfb.

📒 Files selected for processing (5)

• docs/agents/index.mdx
• docs/agents/observability.mdx
• docs/evaluator/experiments.mdx
• docs/evaluator/index.mdx
• docs/fern/versions/latest.yml

---

📝 Walkthrough

Walkthrough

Adds documentation and navigation for NeMo Intake agent observability and NeMo Experiments, including telemetry workflows, evaluation comparisons, leaderboard management, operational limits, and troubleshooting.

Changes

Observability and Experiments

Layer / File(s)	Summary
Agent observability guide docs/agents/observability.mdx, docs/agents/index.mdx, docs/fern/versions/latest.yml	Documents telemetry ingestion, trace analysis, annotations, evaluator results, access control, retention, and service limits. Adds the Observe Agents navigation entry.
Experiments setup and workflow docs/evaluator/experiments.mdx, docs/evaluator/index.mdx, docs/fern/versions/latest.yml	Documents the Experiments model, telemetry-derived metrics, setup, and evaluation workflow. Adds the Experiments navigation entry.
Experiments management and operations docs/evaluator/experiments.mdx	Documents evaluation membership, leaderboard controls, Pareto configuration, pinning, deletion, integrations, limits, retention, and troubleshooting.

Possibly related PRs

• NVIDIA-NeMo/nemo-platform#694: Documents related Experiments ingestion, endpoints, telemetry formats, and evaluator results.
• NVIDIA-NeMo/nemo-platform#896: Documents related telemetry ingestion, trace analysis, evaluator results, and experiment workflows.

Suggested reviewers: arpitsardhana, aleckhoury, briannewsom

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title clearly summarizes the main changes: adding documentation for NeMo Intake and Experiments.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch intake-exp-docs/jesilva

---

_{Comment @coderabbitai help to get the list of available commands.}

[github-actions]

Suite	Lines Covered	Line Rate	Branch Rate
Unit Tests	30234/38242	79.1%	63.7%
Integration Tests	17880/36911	48.4%	20.9%