We've been negotiating a $2M contract to get AMD on MLPerf, but one of the sticking points has been confidentiality. Perhaps posting the deliverables on X will help legal to get in the spirit of open source!
Contract is signed! No confidentiality, AMD has leadership that's capable of acting. Let's make this training run happen, we work in public on our Discord.
@__tinygrad__ Curious what timeframe do you estimate for this project?
@ggerganov About a year, pretty much full time for the team. This is the cutting edge of training with all the tricks. Flash attention, optimizer sharding, gradient accumulation, overlapped communication, multi node support, etc...
@__tinygrad__ GitHub for contracts would be great!
@real_deep_ml You don't love a 30 deep email chain of docx files with various incomplete highlights? You clearly aren't cut out for professional legal work!
@__tinygrad__ Bold move! Hopefully AMD puts down the foot gun…
@KnotGrigori The real problem is that it's a lot cheaper for them to waste your time than it is for you to waste there's. And even worse, they are aware of this so they use it as a negotiating tactic. If you play their game you lose.
@__tinygrad__ If you get AMD on MLPerf, wouldn't they want as many people as possible to know about it? And wouldn't they love getting lots of help to get there from open source contributors? What is confidentiality getting them?!?
@__tinygrad__ How it’s going ☝️ How it started;
@__tinygrad__ I would be more impressed if you posted the full contract of this and the one for your two boxes.
@__tinygrad__ @AMD come thru
@__tinygrad__ Bro lol
@__tinygrad__ what kind of AMD hardware would you try to run this on?
@__tinygrad__ vibes, forever
@__tinygrad__ Im missing 400k somewhere 😅
@__tinygrad__ AMD does not understand how much a little more support of open source would help its AI GPU division. They just don't get it. People will keep saying that it's because AMD doesn't have money to spend, but that's not the issue at all.
@__tinygrad__ you should just reply to them with this gif
@__tinygrad__ I don’t get why AMD is trying so hard not to compete with Nvidia in AI
@__tinygrad__ Liking and posting to raise attention to this. AMD has got to move materially forward if we are going to have anything other than a single provider world.
@__tinygrad__ What does confidentiality mean in this context? Isn’t the point that OSS is awesome and will fix everything?
@__tinygrad__ Isn't this idiotically cheap?!
@__tinygrad__ Lots of devs don't know much about contract negotiations.
@__tinygrad__ mf goes hard
@__tinygrad__ Would you accept more money for the confidentiality? Say 5 times that?
@__tinygrad__ Based
@__tinygrad__ 🔓 With this one weird trick, you too can make AMD open up their MLPerf playbook: http://unlockgpu.com
@__tinygrad__ lol 😂
@__tinygrad__ Those amounts are missing two zeroes
@__tinygrad__ All that the lawyers hear is IP leak.
@__tinygrad__ This are "only" 1,6 Mio 🤔
@__tinygrad__ As $amd shareholder, you should give them a discount.


