[Obs AI Assistant] Add ELSER in EIS model option to the Knowledge Base

[viduni94]

Closes https://github.com/elastic/obs-ai-assistant-team/issues/314

Summary

The multilingual Knowledge Base (KB) currently has 2 model options

• ELSER on ML node
• e5-small on ML node

This PR adds ELSER in EIS to the list of models available for the Knowledge Base. Only one ELSER model will be shown to the user based on whether they have access to EIS.

How it works

New users of the KB

• For users who haven't installed the KB AND has access to EIS
  • The 2 model options would be ELSER in EIS and e5-small on ML node
• For users who haven't installed the KB AND does not have access to EIS (No change)
  • The 2 model options would be ELSER on ML node and e5-small on ML node

Existing users of the KB

• For users who have already installed the KB AND has access to EIS
  • They will be able to continue using ELSER on ML node
  • If they want to use ELSER in EIS, they have to switch the KB model to e5-small and switch again to ELSER via AI Assistant Settings to use ELSER in EIS
• For users who have already installed the KB AND does not have access to EIS (No change)

Screenshots

ELSER in EIS model option for user

From a UI perspective, we don't distinguish between ELSER on EIS and ELSER on ML node

KB index mapping

Scenarios tested

• When ELSER in EIS is available

  • Install KB with ELSER in EIS
  • Recall entries
  • Update KB model to e5-small via settings
  • Recall entries

• When ELSER in EIS is not available

  • Install KB with ELSER on ML node
  • Recall entries
  • Update KB model to e5-small via settings
  • Recall entries

Checklist

• Any text added follows EUI's writing guidelines, uses sentence case text and includes i18n support
• Unit or functional tests were updated or added to match the most common scenarios
• The PR description includes the appropriate Release Notes section, and the correct release_note:* label is applied per the guidelines
• Review the backport guidelines and apply applicable backport:* labels.

Release Note

Adds ELSER in EIS as a model option for the Observability and Search AI Assistant Knowledge Base

[elasticmachine]

Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant)

[github-actions]

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

• /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
• run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

[viduni94]

/oblt-deploy

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: 94683cc
• Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-243298-94683cc134d0

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
observabilityAIAssistant	486	484	-2

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
observabilityAIAssistantApp	258.9KB	259.1KB	+187.0B
observabilityAiAssistantManagement	102.7KB	103.2KB	+516.0B
searchAssistant	108.0KB	108.2KB	+187.0B
total			+890.0B

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
observabilityAIAssistant	46.8KB	46.7KB	-84.0B

Unknown metric groups

API count

id	before	after	diff
observabilityAIAssistant	488	486	-2

History

• 💛 Build #369285 was flaky 85ccc7c
• 💛 Build #368667 was flaky 1394356
• 💛 Build #366718 was flaky 9cbc7bb
• 💛 Build #364533 was flaky 5517bc1
• 💚 Build #364406 succeeded 795a9ae

cc @viduni94