• 3 Posts
  • 395 Comments
Joined 3 years ago
cake
Cake day: June 11th, 2023

help-circle









  • They weren’t going to let people have it that cheap for very long. The plan was to offer it on subscription plans for a couple weeks, then move to usage-based billing, which is much more expensive for a usage pattern that comes anywhere near the subscription limits.

    Keeping a single instance of Fable busy for a full day would probably cost a thousand dollars at standard API rates, and some agentic coding workflows run many agents in parallel. Companies have just recently started to figure out that rewarding employees for how many tokens they use may be a waste of money, but Anthropic is hoping to cash in before they all do.










  • It seems very unlikely to me that the model itself has a list of banned words, and much more likely that a purported list is hallucinated.

    If they did want to have a simple list like that, it would probably go in the harness rather than the model, and the model wouldn’t have been trained on it, nor would a reasonably designed harness provide it to the model. Legitimate use cases, such as asking the model for a list of abusive words for use as a first pass in a filtering system could get tripped up.

    As a test, I asked Perplexity to generate such a list. It did a bad job, including such words as abuse, hate, and threat which are far more likely to be innocuous than abusive. It did also include some highly offensive slurs that one would expect on any banned words list.