Tag: genai

Prompt Engineering Notes

Prompt Engineering Notes Prompt engineering is the process of designing high-quality prompts to guide LLMs to produce accurate outputs. This involves refining length, structure, tone, and clarity. Model-Specific Setup Choose Your LLM and Configure: Model-specific prompts and capabilities Sampling parameters: Output Length More tokens = more compute cost. Reducing length just truncates output. ReAct model warning: Emits irrelevant tokens post-response. Sampling Controls Parameter Effect Temperature Low = deterministic; High = creative/random Top-K Limit prediction to top K likely tokens Top-P Nucleus sampling = choose from top cumulative probability P Num Tokens Max output length Practical Guidelines: Temperature = 0. Read more...