ci: added action to generate llms.txt

[chartotu19]

This PR adds an open-source action to generate necessary llms files to the docs as per the standard.

• Added demodrive-ai/llms-txt-action@v1 action
• Added --dirty flag in gh-deploy to keep the generated files.

Issue resolved by this Pull Request:
Resolves #699

Checklist:

• Documentation has been updated, if necessary.
• Examples have been added, if necessary.
• Tests have been added, if necessary.

[mergify]

Merge Protections

Your pull request matches the following merge protections and will not be merged until they are valid.

🟢 Enforce conventional commit

Wonderful, this rule succeeded.

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

• title ~= ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert)(?:\(.+\))?(!)?:

[dolfim-ibm]

@chartotu19 it looks interesting, thanks for adding your action. Before enabling it, could you please pin the exact release sha1?

[chartotu19]

@chartotu19 it looks interesting, thanks for adding your action. Before enabling it, could you please pin the exact release sha1?

@dolfim-ibm Thanks for the responding! I am not sure exactly what you mean?

In the action releases, v1 points to v1.0.2 which points ad72069

should I use

demodrive-ai/llm-txt-action@ad720693843126e6a73910a667d0eba37c1dea4b

instead of

demodrive-ai/llm-txt-action@v1

[dolfim-ibm]

yes, this is what I meant

[chartotu19]

@dolfim-ibm anything else I should on this PR to get it merged?