Scalability
- What kinds of scalability?
- Parameter
- Dataset (diversity on task, number etc.)
- Number of tokens
- Why do we need scalability?
- Larger model have abilities that smaller model doesn't posess.
- Towards generalization, Emergent behavior (Explore를 위한 "착즙"이라 판단)
'Brainstorm' 카테고리의 다른 글
| Semantic Task Planning Domain (0) | 2022.07.26 |
|---|