Skip to content

Feat: Add MultimodalChatWithTools and MultimodalContextAgentInteraction#61963

Open
lukasdotcom wants to merge 1 commit into
masterfrom
feat/multimodal-provider
Open

Feat: Add MultimodalChatWithTools and MultimodalContextAgentInteraction#61963
lukasdotcom wants to merge 1 commit into
masterfrom
feat/multimodal-provider

Conversation

@lukasdotcom

@lukasdotcom lukasdotcom commented Jul 9, 2026

Copy link
Copy Markdown
Member
  • Resolves: #

Summary

Adds Multimodal providers for ChatWithTools and Agent. Look at nextcloud/assistant#602 to see all other relevant pr's for this

TODO

  • Documentation
  • All the other pr's in the relevant apps

Checklist

AI (if applicable)

  • The content of this PR was partly or fully generated using AI

@lukasdotcom lukasdotcom added the pending documentation This pull request needs an associated documentation update label Jul 14, 2026
@lukasdotcom lukasdotcom force-pushed the feat/multimodal-provider branch from fc6b6ed to 7f065df Compare July 14, 2026 16:52
@lukasdotcom lukasdotcom marked this pull request as ready for review July 15, 2026 20:07
@lukasdotcom lukasdotcom requested a review from a team as a code owner July 15, 2026 20:07
@lukasdotcom lukasdotcom requested review from ArtificialOwl, CarlSchwan, julien-nc, leftybournes, marcelklehr and salmart-dev and removed request for a team July 15, 2026 20:07
Signed-off-by: Lukas Schaefer <lukas@lschaefer.xyz>
@lukasdotcom lukasdotcom force-pushed the feat/multimodal-provider branch from 7f065df to d134e90 Compare July 15, 2026 20:08
Comment thread lib/public/TaskProcessing/TaskTypes/MultimodalChatWithTools.php
Comment thread lib/public/TaskProcessing/TaskTypes/MultimodalChatWithTools.php
$this->l->t('Conversation token'),
$this->l->t('A token representing the conversation.'),
EShapeType::Text
),

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how about adding memories here directly?

$this->l->t('Actions that the agent would like to carry out in JSON format.'),
EShapeType::Text
),
];

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about adding sources here directly?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature: TaskProcessing pending documentation This pull request needs an associated documentation update

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants