Could an AI trained only on knowledge available before 2017 independently discover the Transformer architecture?
Read the original at old.reddit.com→If you took today’s most capable reasoning model, but trained it only on knowledge available before 2017—before Attention Is All You Need—could it independently discover the Transformer architecture? submitted by ...
Original headline: "Could an AI with a knowledge cutoff before Attention Is All You Need independently invent the Transformer architecture?"
Coverage timeline
- Aug 13, 14:51 UTC r/LocalLLaMA lead source Could an AI with a knowledge cutoff before Attention Is All You Need independently invent the Transformer architecture?