Skip to content

[MLOB-983] Add LLM Observability and Serverless Compatibility Documentation#24000

Merged
alai97 merged 10 commits into
masterfrom
sambrenner/llmobs-serverless
Jul 24, 2024
Merged

[MLOB-983] Add LLM Observability and Serverless Compatibility Documentation#24000
alai97 merged 10 commits into
masterfrom
sambrenner/llmobs-serverless

Conversation

@sabrenner
Copy link
Copy Markdown
Contributor

@sabrenner sabrenner commented Jul 3, 2024

What does this PR do? What is the motivation?

Adds documentation for using LLM Observability in serverless environments. This is following a change in our datadog-lambda-python layer to handle enabling LLM Observability, and providing out-of-the-box force flushing by default, we want users to be able to take advantage of these changes for an easier serverless onboarding experience.

Merge instructions

  • Please merge after reviewing

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jul 3, 2024

@sabrenner sabrenner changed the title [MLOB-983] [MLOB-983] Add LLM Observability and Serverless Compatibility Documentation Jul 3, 2024
@sabrenner sabrenner added the WORK IN PROGRESS No review needed, it's a wip ;) label Jul 3, 2024
@sabrenner sabrenner marked this pull request as ready for review July 9, 2024 19:42
@sabrenner sabrenner requested a review from a team as a code owner July 9, 2024 19:42
@sabrenner sabrenner removed the WORK IN PROGRESS No review needed, it's a wip ;) label Jul 9, 2024
@sabrenner sabrenner marked this pull request as draft July 9, 2024 19:42
Comment thread content/en/llm_observability/sdk.md Outdated
Comment thread content/en/llm_observability/sdk.md Outdated
Comment thread content/en/llm_observability/sdk.md Outdated
Comment thread content/en/llm_observability/sdk.md Outdated
Comment thread content/en/llm_observability/sdk.md Outdated
@sabrenner sabrenner marked this pull request as ready for review July 24, 2024 14:55
Copy link
Copy Markdown
Contributor

@alai97 alai97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, some small suggestions!

Comment thread content/en/llm_observability/sdk.md Outdated
Comment thread content/en/llm_observability/sdk.md Outdated
Comment thread content/en/llm_observability/trace_an_llm_application.md Outdated
sabrenner and others added 3 commits July 24, 2024 14:32
Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
@alai97 alai97 added the editorial review Waiting on a more in-depth review label Jul 24, 2024
Copy link
Copy Markdown
Contributor

@alai97 alai97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@alai97 alai97 merged commit 2e5503e into master Jul 24, 2024
@alai97 alai97 deleted the sambrenner/llmobs-serverless branch July 24, 2024 19:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

editorial review Waiting on a more in-depth review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants