Me: I need some new hardware to run my transformers on
Mom: We have transformers at home
The transformers at home:
Joking aside, I think you’re right, using discrete floating point math to simulate a transformer architecture will never be able to approach the efficiency of a “native” analog system like actual brains. I think eventually we’ll see someone come up with a hardware transformer that doesn’t require full synchronized clock signals.
We might need some new tech instead of shrinking existing tech.
Me: I need some new hardware to run my transformers on
Mom: We have transformers at home
The transformers at home:
Joking aside, I think you’re right, using discrete floating point math to simulate a transformer architecture will never be able to approach the efficiency of a “native” analog system like actual brains. I think eventually we’ll see someone come up with a hardware transformer that doesn’t require full synchronized clock signals.