From 6213a9b24549aea3504e901df0be1b7b80337ce2 Mon Sep 17 00:00:00 2001 From: medusa Date: Sat, 18 Nov 2023 12:43:42 +0000 Subject: [PATCH] Update docs/llm/llm_master_class.md --- docs/llm/llm_master_class.md | 64 +++++++++++++++++++++++++++++++++++- 1 file changed, 63 insertions(+), 1 deletion(-) diff --git a/docs/llm/llm_master_class.md b/docs/llm/llm_master_class.md index bfed646..1ad5677 100644 --- a/docs/llm/llm_master_class.md +++ b/docs/llm/llm_master_class.md @@ -298,4 +298,66 @@ By mastering these technical components, users can fine-tune LLMs to perform a w % Repeat the structure for other slides \end{document} -``` \ No newline at end of file +``` + +--- + +# Hallucination = Creativity +Hallucination is equated with creativity, with the distinction being the recognition of its fictitious nature. +- Recognition: Acknowledging the fictitious element is key. +- Cognitive Behavior: Both entail similar idea-generating mental processes. +- Fictitious vs Real: Perception or utilization of the output differs. +- Creative Applications: Hallucinations can inspire artistic or innovative efforts. +- Context-Dependent: Value or risk varies by context. + +# Reductive Operations +Transforming a large text into a smaller output implies that the input exceeds the output size. +- Summarization: Condensing information into fewer words. +- Distillation: Isolating core principles or facts. +- Extraction: Obtaining specific information types. +- Characterizing: Describing text content. +- Analyzing: Identifying patterns or framework evaluations. +- Evaluation: Assessing content via measuring or grading. +- Critiquing: Offering context-specific feedback. + +# Transformation Operations +Altering input into a different format while maintaining size or meaning. +- Reformatting: Modifying only the presentation. +- Refactoring: Enhancing efficiency without altering results. +- Language Change: Converting between languages. +- Restructuring: Improving logical structure. +- Modification: Adapting copy for a different intent. +- Clarification: Enhancing comprehensibility. + +# Generative Operations +Generating extensive text from concise instructions, with the input being smaller than the output. +- Drafting: Creating initial document versions. +- Planning: Developing plans based on parameters. +- Brainstorming: Generating ideas or possibilities. +- Amplification: Expanding on an existing concept. + +# Bloom’s Taxonomy +A framework to categorize educational objectives by complexity and specificity. +- Remembering: Recalling information. +- Understanding: Explaining concepts. +- Applying: Utilizing knowledge in new scenarios. +- Analyzing: Interconnecting ideas. +- Evaluating: Rationalizing decisions. +- Creating: Producing novel work. + +# Latent Content +Embedded knowledge in a model that activates through proper prompting. +- Training Data: Derives solely from training material. +- World Knowledge: General understanding of the world. +- Scientific Information: Facts on scientific principles. +- Cultural Knowledge: Insights on cultural norms. +- Historical Knowledge: Information on past events. +- Languages: Structural and lexical components. + +# Emergent Capabilities +Models develop "emergent" skills not directly taught in training data. +- Theory of Mind: Grasping mental content. +- Implied Cognition: Contextual thinking ability. +- Logical Reasoning: Deductive and inductive logic. +- In-Context Learning: Integrating novel information swiftly. +--- \ No newline at end of file