Skip to content
All tags

#state-space-model

2 posts
aiguideReading CMU 10-423 Generative AI

Long Context and SSMs: Different Ways to Retain History | CMU 10-423 Topic Guide

Long-context evaluation asks whether a model can process, retrieve, and use distant information. An SSM specifies sequence processing through state updates. SSM efficiency does not establish reliable document retrieval, and a large attention window does not guarantee relevant evidence is used.

#cmu-10423#ai-course#cmu#long-context#attention#state-space-model#mamba#flashattention
aideep-diveReading AI Top Conferences

A Guide to the Top AI Conferences of 2023: Machine Learning

In 2023, LLMs took over the machine-learning conference agenda. NeurIPS received more than 12,000 submissions; both Outstanding Papers addressed large models, while runner-up DPO became a practical alternative to RLHF within two years. DreamFusion opened the text-to-3D field, ICML spotlighted LLM watermarking and learning-rate adaptation, and the Mamba preprint emerged as the first serious architectural challenger to the Transformer.

#ai-conference#neurips#icml#iclr#aaai#ijcai#2023#machine-learning#dpo#llm#state-space-model