[8.16](backport #6030) [CI] Buildkite integration tests: Windows ess retry script

[mergify]

What does this PR do?

Adds ess.ps1 script that controls ess deployments for windows tests. If a test retried, it will spin up a new ESS deployment for the retried test group for better reproducibility.

Improves log integration tests log messages

Build examples:

Retried test on Windows(simulated test failure)

• On the 1st run it uses the shared ESS deployment
• On the 2nd run it created its own deployment and destroyed it in the end

Positive scenario without retries and simulated test failures
Logs structure is refactored

Why is it important?

That allows to retry Windows tests in an isolated environment

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in ./changelog/fragments using the changelog tool
• I have added an integration test or an E2E test

Disruptive User Impact

How to test this PR locally

Related issues

• Closes https://github.com/elastic/ingest-dev/issues/4464

Questions to ask yourself

• How are we going to support this in production?
• How are we going to measure its adoption?
• How are we going to debug this?
• What are the metrics I should take care of?
• ...

---

This is an automatic backport of pull request #6030 done by [Mergify](https://mergify.com).

[mergify]

Cherry-pick of 0c4e7a9 has failed:

On branch mergify/bp/8.16/pr-6030
Your branch is up to date with 'origin/8.16'.

You are currently cherry-picking commit 0c4e7a904a.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	new file:   .buildkite/scripts/steps/ess.ps1

Unmerged paths:
  (use "git add/rm <file>..." as appropriate to mark resolution)
	deleted by us:   .buildkite/scripts/integration-tests.ps1

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

[oakrizan]

Waiting for https://buildkite.com/elastic/elastic-agent-extended-testing-bk/builds/344 to complete successfully before merging.

[mergify]

This pull request has not been merged yet. Could you please review and merge it @oakrizan? 🙏

[mergify]

This pull request has not been merged yet. Could you please review and merge it @oakrizan? 🙏

[mergify]

This pull request has not been merged yet. Could you please review and merge it @oakrizan? 🙏

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube