[CAI-834] Add action to refresh structured documents#2116
Merged
marcobottaro merged 207 commits intomainfrom Mar 12, 2026
Merged
[CAI-834] Add action to refresh structured documents#2116marcobottaro merged 207 commits intomainfrom
marcobottaro merged 207 commits intomainfrom
Conversation
* save query and evaluate functions refactoring * dynamodb query put * presidio * changeset * Update chatbot app queries * Update chatbot-monitor scripts * Update chatbot-monitor scripts * Update chatbot queries.py --------- Co-authored-by: mdciri <marco.cirillo@uqido.com> Co-authored-by: Marco Domenico Cirillo <59966344+mdciri@users.noreply.github.com>
* save query and evaluate functions refactoring * dynamodb query put * presidio * changeset * Update chatbot app queries * Update chatbot-evaluator modules * Update poetry files * Update lambda function * Update chatbot monitor scripts * Update chatbot-evaluate scripts * Update chatbot-evaluate lamda function * Update chatbot-monitor lambda function * Add changeset * Update chatbot-monitor monitor.py * Update chatbot-monitor monitor.py * Align to CAI-629 * Update lambda function to consider only unique records * Update lambda function in chatbot-monitor * Update chatbot-evaluate lambda function * Update chatbot-evaluate tests * Update loggers in chatbot monitor, index, and evaluate * Update loggers in chatbot, monitor, index, and evaluate * Update dockerfile for tests * Add new changeset * fix: logger param * fix: comment langfuse add score. We will use SQS queue in another pr * comment calls to presidio. In a future pr we will use SQS for them --------- Co-authored-by: batdevis <devis.battisti@uqido.com>
* Update chatbot settings * Update chatbot Dockerfiles * Update chatbot modules * Update chatbot-monitor to get release app version * Add changeset * Update version as tag product * Update changeset
* fix double entry * event test payload * docker compose test * pytest * pytest * docker compose test and volumes * aws motoserver file * move feedback update to chatbot-monitor * remove spacy download * fix test json file * changeset * remove duplicate test files * gitignore autoflake report files * remove unused imports * fix log level param * fix database envs for docker compose * chore: remove unused env var on .env.example * sqs local listener * docker compose * feat: clean workflow * docs * docker compose ports * chore: Dockerfiles refactor * Fix loop in the langfuse trace creation * Update spaces and indentation * remove logs * Update crate_langfuse_trace() method to respect API * Update crate_langfuse_trace() method to respect API * Removed recursive method in process_span() * Removed timestamp * Fix unique records to be processed * Removed timestamp to logger * fix bug in monitor.py * defence from NoneType values * Update poetry downgrading ragas * Evaluation accepts mock test * Update lambda function to wrtie mock scores * [CAI-729] ecoding decoding AWS SQS payload (#1984) * Update API to write in SQS monitor * Add compression and decompression scripts to chatbot, chatbot-evaluate and chatbot-monitor * Update scripts to compress and decompress payload from/to SQS * Add changeset * Update .changeset/pink-kings-enter.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix float number error on scores * fix compose * docker files cleanup * Update return type of process_span() method --------- Co-authored-by: mdciri <marco.cirillo@uqido.com> Co-authored-by: Marco Domenico Cirillo <59966344+mdciri@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Add package.json to parser app * Add changeset, update package-lock * Update apps/parser/package.json Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Add package.json to parser app * Add changeset, update package-lock * Update apps/parser/package.json Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Add puppeteer dependency in parser app * Add changeset * Update .changeset/three-cups-change.md Co-authored-by: marcobottaro <39835990+marcobottaro@users.noreply.github.com> * Update apps/parser/package.json Co-authored-by: marcobottaro <39835990+marcobottaro@users.noreply.github.com> --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: marcobottaro <39835990+marcobottaro@users.noreply.github.com>
Contributor
Branch is not up to date with base branch@marcobottaro it seems this Pull Request is not updated with base branch. |
…agopa/developer-portal into CAI-834-action-refresh-structured-docs
MarBert
approved these changes
Mar 12, 2026
marcobottaro
approved these changes
Mar 12, 2026
Contributor
Jira Pull Request LinkThis Pull Request refers to the following Jira issue CAI-834 |
marcobottaro
approved these changes
Mar 12, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
List of Changes
Add GitHub action to refresh structured documents
Motivation and Context
in this way the new Manage knowledge base workflow can update the vector index without re-creating it from scratch
How Has This Been Tested?
Screenshots (if appropriate):
Types of changes
Checklist: