Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor: Hyperparameters [sub-topic] (Prompt Engineering): 1 current -> 4 new nodes #7584

Open
iPoetDev opened this issue Oct 25, 2024 · 1 comment
Labels
topic-change Missing or deprecated topics in roadmap

Comments

@iPoetDev
Copy link
Contributor

Roadmap URL

https://draw.roadmap.sh/6716b80e791f57dd60650121

Suggestions

Context Copy editing in Q4 2024 to update/refresh entire Prompt Engineering roadmap (1st/last edit: May 2023)

Issue: Under LLM Settings, sub topic Hyperparameters is blank, null, with no content/links.
Constraint: Current guidelines seek a concise single paragraph.

Backstory: In refreshing and researching LLM settings / hyperparameters, it was found / is obvious that Temperature and Top P are not the only ones. There are more, as follows:

  1. Top K (similar, not as available) Top P
  2. Stop Sequences
  3. Frequency Penalty
  4. Presence Penalty.

These are mostly available in OpenAI and or Google AI Studio, and less so on Anthropic, though by consensus, these are the other hyperparameters that could be exposed by direct API parameters (to be verified), when they may not be so readily available via Playground/Console UIs.

Condensing all of these into one paragraph (if inserted into one node only) will mean a loss of fidelity and meaning of their relative importance and usefulness to beginners. I.e. too compressed, and overly summarised.

Request:

  • Remove current node Hyperparameters under LLM settings
  • Add four nodes as above.
  • Content copy of each of these can be provided on request (single concise paragraphs, with links), after creation.
  • Links

Rational: Spliting a larger collective node / content into smaller discrete nodes / content improve readability, access and usefulness.

@iPoetDev iPoetDev added the topic-change Missing or deprecated topics in roadmap label Oct 25, 2024
@iPoetDev
Copy link
Contributor Author

Was closed without review, unclear as to why. Reached out in other channels.

@dansholds dansholds reopened this Oct 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
topic-change Missing or deprecated topics in roadmap
Projects
None yet
Development

No branches or pull requests

2 participants