LLM

LLM

Creator

Creator

Seonglae Cho

Created

Created

2023 Feb 21 15:33

Editor

Editor

Seonglae Cho

Edited

Edited

2025 Jun 2 11:48

Refs

Refs

Transformer Model

Generative Model

Deep double descent

Large Language Models (Brown et al., 2020; OpenAI, 2023)

Commodity infrastructure for service implementation

Industry challenges

AI Hallucination

LM Context Extending

Multimodal AI

AI Optimization

AI Alignment

AI Service

https://arxiv.org/pdf/2307.06435

Industry challenges

Open challenges in LLM research

Never before in my life had I seen so many smart people working on the same goal: making LLMs better. After talking to many people working in both industry and academia, I noticed the 10 major research directions that emerged. The first two directions, hallucinations and context learning, are probably the most talked about today. I’m the most excited about numbers 3 (multimodality), 5 (new architecture), and 6 (GPU alternatives).

https://huyenchip.com/2023/08/16/llm-research-open-challenges.html

Open challenges in LLM research

Emergent ability

Emergent Abilities of Large Language Models

Emergence can be defined as the sudden appearance of novel behavior. Large Language Models apparently display emergence by suddenly gaining new abilities as they grow. Why does this happen, and what does this mean?

Emergent Abilities of Large Language Models

https://www.assemblyai.com/blog/emergent-abilities-of-large-language-models

Emergent Abilities of Large Language Models

Catching up on the weird world of LLMs

I gave a talk on Sunday at North Bay Python where I attempted to summarize the last few years of development in the space of LLMs—Large Language Models, the technology …

https://simonwillison.net/2023/Aug/3/weird-world-of-llms

Catching up on the weird world of LLMs

Backlinks

AI Modeling Darwin Gödel Machine Prompt Engineering Tool Search

Recommendations

///////