Add connector and scope information to Obs AI Assistant EBT events

[arturoliduena]

Closes #232546

Summary

Add connector and scope information to Obs AI Assistant EBT events

Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

• Any text added follows EUI's writing guidelines, uses sentence case text and includes i18n support
• Documentation was added for features that require explanation or tutorials
• Unit or functional tests were updated or added to match the most common scenarios
• If a plugin configuration key changed, check if it needs to be allowlisted in the cloud and added to the docker list
• This was checked for breaking HTTP API changes, and any breaking changes have been approved by the breaking-change committee. The release_note:breaking label should be applied in these situations.
• Flaky Test Runner was used on any tests changed
• The PR description includes the appropriate Release Notes section, and the correct release_note:* label is applied per the guidelines
• Review the backport guidelines and apply applicable backport:* labels.

Identify risks

Does this PR introduce any risks? For example, consider risks like hard to test bugs, performance regression, potential of data loss.

Describe the risk, its severity, and mitigation for each identified risk. Invite stakeholders and evaluate how to proceed before merging.

• See some risk examples
• ...

[elasticmachine]

Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant)

[github-actions]

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

• /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
• run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

[viduni94]

Thanks for adding these info to the EBT events @arturoliduena

We have another EBT event - observability_ai_assistant_recall_ranking
Would you be able to add the scope and connector information to that too?

[arturoliduena]

@viduni94, thanks for the review
I added observability_ai_assistant_recall_rankingEBT event in commit a35e056

[viduni94]

LGTM. Tested locally and attached the payloads for future reference.

Left a few comments.

Once the CI passes and a serverless deployment is up, hope you could test with the Elastic Managed LLM as well.

// observability_ai_assistant_recall_ranking
{
  "scoredDocuments": [
    {
      "esScore": 27.047709,
      "llmScore": 7,
      "scopes": ["observability"],
      "connector": {
        "connectorId": "bedrock-sonnet-37",
        "name": "sonnet-3.7-preconfigured",
        "type": ".bedrock",
        "family": "Claude",
        "provider": "Anthropic",
        "modelId": "us.anthropic.claude-3-7-sonnet-20250219-v1:0"
      }
    }
  ]
}

// observability_ai_assistant_chat_feedback
{
  "type": "observability_ai_assistant_chat_feedback",
  "payload": {
    "feedback": "positive",
    "conversation": {
      "@timestamp": "2025-09-11T21:43:00.463Z",
      "user": { "id": "u_mGBROF_q5bmFCATbLXAcCwKa0k8JvONAwSruelyKA5E_0", "name": "elastic" },
      "labels": {},
      "numeric_labels": {},
      "namespace": "default",
      "public": false,
      "archived": false,
      "conversation": { "id": "758fe465-02d5-4fce-81ba-e390da6bf39f", "last_updated": "2025-09-11T21:46:57.665Z" }
    },
    "connector": {
      "connectorId": "bedrock-sonnet-37",
      "name": "sonnet-3.7-preconfigured",
      "type": ".bedrock",
      "family": "Claude",
      "provider": "Anthropic",
      "modelId": "us.anthropic.claude-3-7-sonnet-20250219-v1:0"
    },
    "scopes": ["observability"]
  }
}

// observability_ai_assistant_user_sent_prompt_in_chat
{
  "type": "observability_ai_assistant_user_sent_prompt_in_chat",
  "payload": {
    "scopes": ["observability"],
    "connector": {
      "connectorId": "bedrock-sonnet-37",
      "name": "sonnet-3.7-preconfigured",
      "type": ".bedrock",
      "family": "Claude",
      "provider": "Anthropic",
      "modelId": "us.anthropic.claude-3-7-sonnet-20250219-v1:0"
    }
  }
}

// observability_ai_assistant_insight_response
{
  "type": "observability_ai_assistant_insight_response",
  "payload": {
    "@timestamp": "2025-09-11T21:52:35.698Z",
    "connector": {
      "connectorId": "gemini-25-pro",
      "name": "gemini-2.5-pro-preconfigured",
      "type": ".gemini",
      "family": "Gemini",
      "provider": "Google",
      "modelId": "gemini-2.5-pro"
    },
    "scopes": ["observability"]
  }
}

// observability_ai_assistant_insight_feedback
{
  "type": "observability_ai_assistant_insight_feedback",
  "payload": {
    "feedback": "positive",
    "connector": {
      "connectorId": "gemini-25-pro",
      "name": "gemini-2.5-pro-preconfigured",
      "type": ".gemini",
      "family": "Gemini",
      "provider": "Google",
      "modelId": "gemini-2.5-pro"
    },
    "scopes": ["observability"]
  }
}

[arturoliduena]

/oblt-deploy

[arturoliduena]

Tests Obs AI Assistant EBT Events with Elastic Managed LLM

// observability_ai_assistant_chat_feedback
{
  "event_type": "observability_ai_assistant_chat_feedback",
  "properties": {
    "feedback": "positive",
    "conversation": {
      "@timestamp": "2025-09-15T13:33:59.603Z",
      "user": { "id": "u_elastic_found", "name": "elastic" },
      "labels": {},
      "numeric_labels": {},
      "namespace": "default",
      "public": false,
      "archived": false,
      "conversation": {
        "id": "2f9eb61c-e6fe-45f0-b853-d29389e6ea45",
        "last_updated": "2025-09-15T13:33:59.603Z"
      }
    },
    "connector": {
      "connectorId": "Elastic-Managed-LLM",
      "name": "Elastic Managed LLM",
      "type": ".inference",
      "modelFamily": "Claude",
      "modelProvider": "Elastic",
      "modelId": "rainbow-sprinkles"
    },
    "scopes": ["observability"]
  },
  "trace": { "id": "89228e5b161c107000493125ee444cf7" }
}

// observability_ai_assistant_user_sent_prompt_in_chat
{
    "event_type": "observability_ai_assistant_user_sent_prompt_in_chat",
    "properties": {
        "scopes": [
            "observability"
        ],
        "connector": {
            "connectorId": "Elastic-Managed-LLM",
            "name": "Elastic Managed LLM",
            "type": ".inference",
            "modelFamily": "Claude",
            "modelProvider": "Elastic",
            "modelId": "rainbow-sprinkles"
        }
    }
}

// observability_ai_assistant_insight_response
{
  "timestamp": "2025-09-15T13:39:28.050Z",
  "event_type": "observability_ai_assistant_insight_response",
  "properties": {
    "@timestamp": "2025-09-15T13:39:27.934Z",
    "connector": {
      "connectorId": "Elastic-Managed-LLM",
      "name": "Elastic Managed LLM",
      "type": ".inference",
      "modelFamily": "Claude",
      "modelProvider": "Elastic",
      "modelId": "rainbow-sprinkles"
    },
    "scopes": ["observability"]
  }
}

// observability_ai_assistant_insight_feedback
{
  "event_type": "observability_ai_assistant_insight_feedback",
  "properties": {
    "feedback": "positive",
    "connector": {
      "connectorId": "Elastic-Managed-LLM",
      "name": "Elastic Managed LLM",
      "type": ".inference",
      "modelFamily": "Claude",
      "modelProvider": "Elastic",
      "modelId": "rainbow-sprinkles"
    },
    "scopes": ["observability"]
  }
}

[elasticmachine]

💛 Build succeeded, but was flaky

• Buildkite Build
• Commit: 3ff3f92
• Storybooks Preview
• Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-234550-3ff3f929855b

Failed CI Steps

• FTR Configs #8

Test Failures

• [job] [logs] FTR Configs #8 / input controls input control options updateFiltersOnChange is false should replace existing filter pill(s) when new item is selected

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id	before	after	diff
observabilityAIAssistant	108	145	+37

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
actions	338	347	+9

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
observabilityAIAssistant	20.7KB	20.9KB	+162.0B
observabilityAIAssistantApp	177.7KB	177.8KB	+146.0B
searchAssistant	104.3KB	104.5KB	+146.0B
total			+454.0B

Public APIs missing exports

Total count of every type that is part of your API that should be exported but is not. This will cause broken links in the API documentation system. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats exports for more detailed information.

id	before	after	diff
actions	37	36	-1

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
observabilityAIAssistant	41.8KB	46.7KB	+4.9KB

Unknown metric groups

API count

id	before	after	diff
actions	344	353	+9

History

• 💛 Build #339057 was flaky e6b008c
• 💔 Build #338862 failed fce31d6
• 💔 Build #338597 failed 600e4eb
• 💔 Build #338490 failed 6789f8f
• 💔 Build #338348 failed a35e056

[kibanamachine]

Starting backport for target branches: 8.18, 8.19, 9.0, 9.1

https://github.com/elastic/kibana/actions/runs/17822757554

[kibanamachine]

Starting backport for target branches: 8.18, 8.19, 9.0, 9.1

https://github.com/elastic/kibana/actions/runs/17822757645

[kibanamachine]

💔 All backports failed

Status	Branch	Result
❌	8.18	Backport failed because of merge conflicts
❌	8.19	Backport failed because of merge conflicts
❌	9.0	Backport failed because of merge conflicts
❌	9.1	Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 234550

Questions ?

Please refer to the Backport tool documentation

[kibanamachine]

💔 All backports failed

Status	Branch	Result
❌	8.18	Backport failed because of merge conflicts
❌	8.19	Backport failed because of merge conflicts
❌	9.0	Backport failed because of merge conflicts
❌	9.1	Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 234550

Questions ?

Please refer to the Backport tool documentation

[arturoliduena]

💚 All backports created successfully

Status	Branch	Result
✅	9.1
✅	9.0
✅	8.19
✅	8.18

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

[kibanamachine]

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @arturoliduena

[kibanamachine]

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @arturoliduena

[kibanamachine]

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @arturoliduena

[kibanamachine]

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @arturoliduena

[kibanamachine]

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @arturoliduena

[kibanamachine]

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @arturoliduena

[kibanamachine]

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @arturoliduena