Yes! This is probably the one thing I want to think about but it requires detecting thise constructs. I think spacy was able to annotate each word with a function, so it should be able to validate known constructs but I need some model to perform unbiased discovery.
Sadly pretty uninteresting, you can probably just launch Claude code on the repo to see by yourself. One cluster is french and spanish, another is about design, another about frontend, etc...
Author here! Grateful for the kind words, human communities like HN really hit differently when you spend the whole day chatting with sycophantic and bullshitting agents (including to make this page).
I'm currently adding a search bar as well as increasing the data to 1000 PR per day.
A nice thing that is not obvious on the main page is that the dataset and analysis are updated daily using Github Actions (at least when they don't suffer from an outage ^^). I find it pretty cool to be able to build such apps without a "backend"!
Nice work. I would suggest rewriting your README with Gemini, the most human of them, so it doesn't read exactly like the thing you are pointing at: https://github.com/louisabraham/load-bearing
Agree with rewriting with Gemini, but I'd characterize its output as very "neutral" and "encyclopedic", rather than "human" (contra Claude which is as of recent models "trying-too-hard-to-be-human"-sounding).
I added the search bar, increased the data to 1000 PR a day (more than 50M words total) and added a feature to explore the other clusters as well. I hope the page is not getting cluttered.
The design is really impressive. Beautiful and dense, yet very understandable.
How did you come up with this particular design? It's really nice and everything fits, the colors, the layout, all of it.
Were you inspired by anything in particular? I feel like this reminds me of something, but I don't remember what exactly.
I agree with you, I really like OP's design choices, even more so amidst the flood of Claude-Generic these days. Although Claude just can't resist those little muted-toned ui-monospace small-caps...
It reminds me of Neue Grafik/Swiss Style, and Vignelli:
I asked Claude for a few original designs, then iterated a lot for the UI. It called this design "Rasterfeld", which is a word that means "field of grids", a term used in swiss design https://docs.mew.design/blog/swiss-design-style/ as @alwa said.
The 3 primary colors refer more to pop art and Bauhaus.
I'm really eager for a nice book about "design" that would document all those styles, if someone has a recommendation.
Very cool! I'm trying to understand the graph, so the bottom-most section seems to be the cluster identifying Claude written PRs. What are the other 7, any reason there are 8 in total?
I've been scraping instagram posts recently to identify AI misinformation accounts that all repost each other's carousels and get hundreds of thousands of likes in engagement. Thinking of ways to present it and your dashboard looks very helpful. Did you experiment with any other types of visualizations before deciding on a stacked area chart for the clusters?
Author here, thank you so much! I really tried to make it nice to use, beyond the (quite original) modelling.
A prototype I did tried to detect some grammatical constructions, eg "it's not ..., it's ...", but I am not sure how to systematize that.
Also just a disclaimer: I am NOT tracking Claude tics, I am merely finding that a particular cluster of vocabulary increases. Tracking Claude requires labelled data IMO. I tried using model release dates in a structural model to constraint the clusters but the result was not compelling, so I ended up simplifying the model a lot!
I love this. I think you should be clearer about that - it's obvious to people who have experience doing this kind of data analysis, but a lot of people I've shown this were confused, as in "huh, load-bearing and genuinely makes sense but how'd he pick all these other words!?"
I think it should be made clear that the sorting is sort of Texas Sharpshooter-ish - the ones on top are on top because they sort that way.
The fact that load-bearing ends up on top is the proof that this works because we all know a priori that load-bearing is a Claudism.
I'm not even sure a PhD helps. It just overuses jargon that has NO meaning. Sometimes, it actually hand waves too much as well while trying to dumb down stuff for you.
I am not sure whether it's a consequence of learning to reason from its traces or some RLHF that trips it into using weird terms to sound smarter to the humans who rate it.
My intuition is that Claude is trained to communicate to itself while coding. You see this in how bizarrely granular it is when explanation prior work, you also see this in the comments it leaves behinds.
It's me, it's the reams of sessions I share back with a five star rating that are just Claude Code talking to itself about debugging its own generated code in jargon that has slowly diverged from anything a human would understand.
I have a PhD and can confirm. Oftentimes, the stuff which comes out of Claude is just impenetrable because it invents jargon on the fly, and uses verbs in the most atrocious ways.
"The fibred side folded its capstone into the existing name, so the kinds are asymmetric."
What on earth does it mean to fold a capstone into a name‽
Is that an actual Claude output or hyperbole? It feels like I'm trying to parse an equation in a new math class which makes me want to take a stab at it regardless.
So there's a "fibred side".. the most likely candidate seems to be "fibred categories" which I hadn't heard of before, and it's talking about one side of some mapping between two sets such that if f is the primary function and f(x)=y then there exists an inverse function g(y)=x? Was it something that converted some data bidirectionally with a different algorithm on both sides?
The capstone of the inverse function would be the most important thing about it maybe?
My best guess is "In the process of working on the inverse function, the existing name (of the inverse function itself maybe?) was made to reflect the operation of the inverse function, so now the name does not follow the same naming convention as the name of the primary function (which does not contain its 'capstone')."
Its original wording is certainly dense and harder to follow for us, but it's fascinating how the model finds this the best fit for what it's trying to express IMO. Like it arrives at its own ways of overloading words/concepts, and things we would refer to in different ways in different contexts all get compressed to the same more-useful/complete idea.
Codex has never said anything nearly so alien as the Claude examples I've seen floating around, interestingly. I wonder if it just has a better training on choosing its words to present to the user or if it inherently arrived at a somewhat different mapping that favors 'plain language' more.
I am not really sure what Claude meant, but you are not too far off, from what I understand.
I have several similar folders with variants of a construction, but taking differently structured input. They are named “plain”, “fibred” and “indexed”. So the fibred variant is clear enough.
The Claude speak I struggle with is “the capstone” and what name it could be talking about. And what folding means here. I think it just means:
“I changed an important result of the construction in the fibred variant, but kept the name. so the fibred variant is now different from the others.”