• 0 Posts
  • 12 Comments
Joined 1 year ago
cake
Cake day: June 30th, 2023

help-circle
  • While anything that gets people off Twitter is good, I’m sorely unimpressed by those artists who “had to” to patronize the racist transphobic neo-Nazi hellhole “because my audience is there”… until Musk’s policies happened to offend their own personal interests, by requiring training for their AI. Countless models trained on all public images already exist, jumping ship won’t prevent their work from being scraped elsewhere, and frankly, any one image or even portfolio will contribute virtually nothing to the result, so quitting in protest is largely symbolic. But so many peoples drew the line at that, and not at Musk making “cis” a slur, or protecting child pornographers, or boosting white supremacist supremacy theories. It’s really disappointing to see.












  • IIRC based on the source paper the “verbatim” text is common stuff like legal boilerplate, shared code snippets, book jacket blurbs, alphabetical lists of countries, and other text repeated countless times across the web. It’s the text equivalent of DALL-E “memorizing” a meme template or a stock image – it doesn’t mean all or even most of the training data is stored within the model, just that certain pieces of highly duplicated data have ascended to the level of concept and can be reproduced under unusual circumstances.