?????????? RWKV ?????? Transformer ??| S9E25

?? ChatGPT ????????????????????? Transformer?? Transformer ???????????? AI ????????? Transformer ?????????????????????????????????????????????????????????????Transformer ???????????????????——???RNN???????? ?????????????????????? COO ?????????????????????????????????? RWKV?RWKV ????? Transformer ????????????????????????????????????????????????????????????????? RWKV ?????? ???????????????? AI ??????? ???? ????????????? COO Yaxian?????????? ???? [03:30] ??????Scaling law ????????Transformer ??????????? [08:15] ????????????????RWKV ? Transformer ???????? [13:24] ?? RNN ? Attention ??????????????????????? [17:07] ?????????? RWKV ???????? 70B ???? [23:47] ?????????????RWKV ???????? [26:24] ?? 80% ? AI ??????????????????????????? [32:35] ??????????????????? [38:20] RWKV ? ?ChatGPT?????????? AGI ??????? ???? RNN?Recurrent Neural Network? ???????????????????????????????????????????????????????????????????????????? RNN ???????????????? RNN ???????/???????????????????????????RWKV ????? RNN ? Transformer ?????????? Mamba ?? ??????????????????????????????????????State Space Model, SSM????? RNN ???????????? RNN ???? Transformer ??? LSTM?Long Short-Term Memory? ??????? RNN ?????? ???????????????“??????”?????????????????????? RNN ??????????????? MoE ?? MoE?Mixture of Experts?????????????????????????????????????????????????????????????????????????????????? XR?Extended Reality? ????????????VR???????AR???????MR???????????????????????? ???? ???Yaxian ????? ???George ????? ???? ??????????????????????????????? business@shengfm.cn ????? ??Knock Knock ?????????? ????????????? AI ???????????????????????????????????????????????????????????????????? ? ????????? Apple Podcast ?????? ?????? ????????????????????????????????????????? BD ?????????????? ?????? ???????????????????????????????? ???????????????????????????????????