LLM

LLM

Creator

Creator

Alan Jo

Created

Created

2023 Feb 21 15:33

Editor

Editor

Alan Jo

Edited

Edited

2024 Jul 4 13:18

Refs

Refs

Transformer Model

Large Language Model

Commodity infrastructure for service implementation

Industry challenges

AI Hallucination

LM Context Extending

Multimodality

AI Optimization

AI Alignment

LLM Notion

LLM Leaderboard

LLM Usages

Prompt Engineering

LLM Development

The limits of my language mean the limits of my world. -
Wittgenstein

Industry challenges

Open challenges in LLM research

Never before in my life had I seen so many smart people working on the same goal: making LLMs better. After talking to many people working in both industry and academia, I noticed the 10 major research directions that emerged. The first two directions, hallucinations and context learning, are probably the most talked about today. I’m the most excited about numbers 3 (multimodality), 5 (new architecture), and 6 (GPU alternatives).

Open challenges in LLM research

https://huyenchip.com/2023/08/16/llm-research-open-challenges.html

Open challenges in LLM research

Emergent

Emergent Abilities of Large Language Models

Emergence can be defined as the sudden appearance of novel behavior. Large Language Models apparently display emergence by suddenly gaining new abilities as they grow. Why does this happen, and what does this mean?

Emergent Abilities of Large Language Models

https://www.assemblyai.com/blog/emergent-abilities-of-large-language-models

Emergent Abilities of Large Language Models

Catching up on the weird world of LLMs

I gave a talk on Sunday at North Bay Python where I attempted to summarize the last few years of development in the space of LLMs—Large Language Models, the technology …

Catching up on the weird world of LLMs

https://simonwillison.net/2023/Aug/3/weird-world-of-llms

Catching up on the weird world of LLMs

Recommendations

///////