Weekly Digest #143
Articles
Open challenges in LLM research
1. Reduce and measure hallucinations
2. Optimize context length and context construction
3. Incorporate other data modalities
4. Make LLMs faster and cheaper
5. Design a new model architecture
6. Develop GPU alternatives
7. Make agents usable
8. Improve learning from human preference
9. Improve the efficiency of the chat interface
10. Build LLMs for non-English languages
20 Things I’ve Learned in my 20 Years as a Software Engineer
REFORMS: Reporting Standards for ML-based Science
Study design — Computational reproducibility — Data quality — Data preprocessing — Modeling — Data leakage — Metrics and uncertainty quantification — Generalizability
Tutorials
Retrieval-Augmented Generation: How to Use Your Data to Guide LLMs
Tools
scrscp, Display and control your Android device
youki, A container runtime written in Rust
Off-topic
Plastic Recycling Doesn’t Work and Will Never Work
