I think that one of the core problems here is to reduce this to power requirements... But, if we are going to do that, we should try make sure that we are right. Let's see! On the human side, a 2000 kcal diet translates to an average of a bit less than 100W. Kids are going to be less than that, maybe about half. An Nvidia A100 draws a max of 500W so it's got a max power draw equivalent to the average draw of about 10 kids. Nvidia doesn't seem to have released the number of A100's that they have produced, but it seems to be between 100K and 1M.
So, a kid uses 50*24*365*20 = 8760000 watt hours over the course of childhood. Spread that evenly among all 1M A100's running at max 500W capacity, convert to minutes and we get 1.0512 minutes. Which is remarkably close to what you said!
No need to wonder if he thinks human cognition and awareness is anything special.
"be4 u get smrt!" I bet if you added up all the calories it takes for 20 years of life it wouldn't power 20 seconds of LLM training.
I think that one of the core problems here is to reduce this to power requirements... But, if we are going to do that, we should try make sure that we are right. Let's see! On the human side, a 2000 kcal diet translates to an average of a bit less than 100W. Kids are going to be less than that, maybe about half. An Nvidia A100 draws a max of 500W so it's got a max power draw equivalent to the average draw of about 10 kids. Nvidia doesn't seem to have released the number of A100's that they have produced, but it seems to be between 100K and 1M.
So, a kid uses 50*24*365*20 = 8760000 watt hours over the course of childhood. Spread that evenly among all 1M A100's running at max 500W capacity, convert to minutes and we get 1.0512 minutes. Which is remarkably close to what you said!
# ....very slow, snack-powered neural networks.
.
Well, that basically describes any critter from flatworms on up...and I thought *I* was a grumpy bastard.
I would just like to point out that when Altman dies, I will compare it to how many LLMs can now be trained on how to not be like Sam Altman .
Raising a child does not require the entire water supply of a mid-size city.