[8.19](backport #47265) Add support for inputs.[input_type].pipelines in beatreceivers

[mergify]

Proposed commit message

This PR adds support for input.[input_type].pipelines parameter in beatreceivers. This can be set as custom YAML in integrations such as filestream-integration. This PR ensures we support this behavior in beat receivers

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in ./changelog/fragments using the changelog tool.

Disruptive User Impact

None

Author's Checklist

• [ ]

How to test this PR locally

1. Create two pipeline on elasticsearch. Can be done via Kibana's dev tools

PUT _ingest/pipeline/error_pipeline
{
  "description": "Add timestamp and remove unwanted fields",
  "processors": [
    {
      "set": {
        "field": "error_key",
        "value": "this is error value"
      }
    }
  ]
}

1. Start filebeat otel with following config file

filebeat.inputs:
  - type: filestream
    id: filestream-input-id
    enabled: true
    file_identity.native: ~
    prospector.scanner.fingerprint.enabled: false    
    paths:
      - ./test.json

output:
  elasticsearch:
    hosts: ["http://localhost:9200"]
    username: admin
    password: testing

and you can observer the final events have an extra field error_key: error value

Related issues

• Relates [Beats receivers] Add exporter translation support for all currently unsupported Elasticsearch output features #46749

---

This is an automatic backport of pull request #47265 done by [Mergify](https://mergify.com).

[mergify]

Cherry-pick of e0b9332 has failed:

On branch mergify/bp/8.19/pr-47265
Your branch is up to date with 'origin/8.19'.

You are currently cherry-picking commit e0b93322d.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	modified:   libbeat/otelbeat/beatconverter/beatconverter_test.go
	modified:   libbeat/otelbeat/oteltranslate/outputs/elasticsearch/config_otel.go
	modified:   libbeat/otelbeat/oteltranslate/outputs/elasticsearch/config_otel_test.go
	modified:   x-pack/libbeat/outputs/otelconsumer/otelconsumer_test.go

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   x-pack/filebeat/tests/integration/otel_test.go
	both modified:   x-pack/libbeat/outputs/otelconsumer/otelconsumer.go
	both modified:   x-pack/metricbeat/tests/integration/otel_test.go

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

[elasticmachine]

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

[khushijain21]

Requires #47412