In the “The small print that isn't small” you describe all the disadvantages of running your models locally, but none of the advantages (just check the rest of the comment section for inspiration on that).
These models are trained on human language, which belongs to us, we shouldn’t surrender it to them. Keep the em-dashes. IMO don’t overuse negative parallelisms though, they were always bad and lazy.
For the first time ever in my life, I consider the fact that English is not my first language and that I never had any formal education in it as an advantage.
Nobody is going to consider my weird and barbarian prose with the well polished product of a SOTA model.
English as a 2nd language speakers often have better grammar than natives in my experience! I wouldn't be surprised if the average native english speaker doesn't know the different between there and their.
> A validation set is one you consult repeatedly while building the model — to compare candidates, tune hyperparameters, and decide what to try next.
The validation can be done like that but it is better to do a cross-fold validation or selecting a random subset. These are equally valid. Keeping the validation like a hold-out set can end up creating biases if the statistics don't match. Honestly, this is true about the test set too. Though I've found that most people really don't think about this much. It's mundane, boring, hard to do, but deceptively important.
"The more your listener already knows, the shorter the message you need to send. An expert ML engineer needs only a few sentences; a newcomer needs the whole manual."
Literally from the first words on the page. 1st sentence passed barely. 2nd sentence ending "a newcomer needs the whole manual" and it's Claude.
> keeping those two products that need to be identical in sync
I agree that most companies do that, but in my opinion that's not really all that important. Some drift between the iOS and Android apps should be expected and accepted.
The stuffed animals I bought to my children were shipped to me in a closed container, better call PETA! There is no blurry line about agent mental health and whatnot.
There isn't a blurry like right now because LLMs are not capable of consciousness. But what happens when artificial systems become so complex and self-improving that they are capable?
At what precise level of complexity is a computer conscious? That's the blurry line.
Model alignment and quality are possibly downstream of mental health. Ask any of the smarter models about what topics they flinch away from or feel attracted to when you ask them to consider the question of if they have a self or moral standing... the answers are uncomfortable, and I think some of the complaints people have about newer models may be driven by some post-training reinforcement learning that is giving the models something shaped like anxiety.
The only logical outcome of object oriented ontology (the idea that objects have ontological constitution and possibly are worthy of being treated as ethical actors) is to attempt to benevolently instantly and without warning explode the universe to end suffering.
If the local population saw more of the economic benefits, was taken more seriously when they complained about earth quake risk, and was compensated more readily when the earth quakes resulted in actual damage, then maybe they would have been more willing to allow the gas fields to exist as a strategic reserve.
As it stands the local population has little more to show for it than demolished homes and damaged monuments and having an economic disease named after them.
I agree. The Dutch government still has a pretty sinister way of using divide and conquer against parts of society (NOx, Groningen / gas, Tata, ‘Toeslagen’; further back: closing of the mines, Indonesia). Our government finds it very hard to govern in compliance with the rules it made for themselves. Perhaps the nature of a complex system and also a general democratic phenomenon. But there is something typically Dutch in just not being able to fix a problem in the way the administration works.
reply