Weekly Digest #49
Articles
How to Train Really Large Models on Many GPUs?
Training Parallelism
- Data Parallelism
- Model Parallelism
- Pipeline Parallelism
- Tensor Parallelism
Mixture-of-Experts (MoE)
Other Memory Saving Designs
- CPU Offloading
- Activation Recomputation
- Mixed Precision Training
- Compression
- Memory Efficient Optimizer
An A/B test starts with an idea — some change we can make to the UI, the personalization systems that help members find content, the signup flow for new members, or any other part of the Netflix experience that we believe will produce a positive result for our members. Some ideas we test are incremental innovations, like ways to improve the text copy that appears in the Netflix product; some are more ambitious, like the test that led to “Top 10” lists that Netflix now shows in the UI.
How Many People Can Someone Lead?
generally, 5–7 people but depending on
leadership scope (time allocation)
- People and team
- Process
- Technical
leadership roles
- single team leader
- leadership in specific areas
experience level of the leader
experience level of the team
level of organisational bureaucracy
Tutorials
Convert SVF to png (10.06MB -> 78KB)
- Two Layers: SVG (SVGOMG), AVIF/WebP/PNG (Squoosh)
Tools
Open source home automation that puts local control and privacy first.
Off-topic
A 3D printed vaccine patch offers vaccination without a shot
Hit the sleep ‘sweet spot’ to keep brain sharp
With 100 participants with a mean age of 75, this experiment shows cognitive scores declined for the groups that slept less than 4.5 or more than 6.5 hours per night
