Why don't they monitor average prompt and response token length(both cached and uncached) per interaction. Seems this could have solved all their previous unnoticed degradation.
Also bit surprised they don't have any automated quality check. They can run something like swe bench before each release. Both of these seem like a basic thing even for startup, let alone some product generating billions in revenue.
The site that he bought the crypto from to make a bet could trace it back to him, and many, if not all, crypto trading sites have shady ties with some governemnts around the world.
> I suspect that when things get really big, Google's systems will always be more cost-efficient.
In fact I am opposite of this hypothesis for two reasons. Google has artificially limited production. And because TSMC favours whoever could pay for the most capacity(as incremental capacity is very cheap for them). So Nvidia gets first slot for new process.
Also the second reason is that GCP's operating margin is very high compared to say Hetzner or lambdalabs and you can get GPUs much cheaper there compared to GCP. So students/small researchers are stuck on GPU.
Author took the most simple application and managed to make it so complex beyond belief. If he needed all this for 1 modal, I don't even want to imagine what would he had done if he had 10 different types of modal with 10 different rules as any half complex application has.
Funny I have modals on my mind this afternoon and boy does it drive me up the wall that mainstream React frameworks still aren't using the <dialog> element and without that you will fail WCAG because all the other schemes that are supposed to hide the rest of the page don't.
It isn't even that hard, like I've been able to update the parts of MUI and reactstrap that my applications use even to calculate coordinates for portalized flyovers correctly. I could send but I just don't want to do the 5x work to do all the other components I don't use and then face the politics of a community that probably doesn't care if disabled people can use their products or even if they can check the boxes and pass WCAG. <dialog> is easy to use with HTMX and just a touch awkward with React because React insists on being level-triggered in edge-triggered situations but once you have it coded up <DialogsThatReallyWork/> just work.
I tried to use <dialog> and found it to be a pain.
I wanted to close it when clicking outside, but Safari doesn't support closedBy.
Some Safari versions on iOS broke when trying to style my backdrop with tailwind.
The tailwind CSS reset didn't include <dialog>.
I get the allure of just using a position: fixed;
WCAG is lot lot more than just using <dialog> and unless you do a thorough review with a professional in this field, <dialog> won't solve anything. Do you know how many other WCAG guidelines your app or your site misses. No one knows that.
We do pretty good on Siteimprove and similar checkers although these are frequently wrong and in some cases I think think the specs are actually wrong or miss important things for political reasons. We have customers who send us bug reports and we fix them, we catch others preemptively ourselves.
It is a problem that the experiences of disabled people are erased by the current regime, I haven't once seen an organization actually ask a disabled person if they can use the site or how it can be better.
Also I think accessibility tools are trash. If I start NVDA on my dev machine I have to power cycle it to get control back. Microsoft Narrator sorta works but the more you use landmarks and other aria-markup the more it starts blurting out things like "LANDMARK NAVIGATION LANDMARK!" in the middle of reading something even thought Siteimprove thinks it is all peachy. Is it a fail? Or did the tool fail? My tester or myself can look at an application as a sighted user and test it in Firefox/Chrome/Safari and say "it works" but it is not clear at all what the "definition is done" for testing with screen readers.
I hear JAWS is better than the others but it costs about as much as a car. In the meantime though I know when we don't use <dialog> we fail and I've seen a lot of third party modals that don't use <dialog> that all fail.
It's just plain easy. It boggles my mind that nobody uses it.
But then again it boggles my mind that you can pass WCAG with those "is this a motorcycle?" things or that stupid anime girl you see on Linux pages or a GDPR popup and you can. People will say "what if you have to support WCAG and GDPR?" and I say "sometimes you have to make a choice", I mean a11y work is damned if you damned and damned if you don't, just damned all the time and personally the EU screws up my life a lot more than Iran ever did.
> We are only just now getting a taste of the “true cost” of these tokens
Why do you believe that? Better metric would be price per token of open models served by third party. Last I was tracking the price for similar level model was decreasing by more than 10x year on year, and they are 10-100x cheaper than top properietery models.
Sure you can say that you can't compare them but for sure you can compare the top properietery model of 6 months back to current open models and the gap in time seems to be constant.
No it is not. Yes it could be for your average everyday developer but if someone can run site with millions of active users alone, there is no difference in salary based on where the developer stays. Does Mistral pays $100k salary to researchers?
People working in non profits typically earn less, yes. In general, salary is not a function of how praiseworthy or important or even hard the work is. People who work for non profits have pay cut, because basically they are willing to be paid less in exchange of doing something they see as meaningful.
(Excluding purely "money washing for local mafia and politicians" non profits.)
Dude, Lichess is entirely funded by donations. There's only so much money to go around.
And Thibault iirc is the kind of person that's not terribly interested in earning lots of money. Of he wanted to, I'm sure he could make bajillions elsewhere in tech, because he's that good. But he apparently prefers to only work for a "measly" upper middle class salary and doing something he's really passionate about. And I thank him for it, because lichess is awesome.
Also power is not at all a limited resource as many top voted post on HN thinks it to be. Increased demand decreases the price of power not increases it in the long term.
And in any case ban doesn't make any sense. Instead they could charge different for grid electricity usage, and make the datacenter pay for grid expansion when they start building it.
> The average rank and file employee at any BigTech company knows only a minuscule more than the general public.
They know the clients, the contracts, hiring, cost cutting way before the general public does. The problem is that many BigTech is sum of many units which might not be correlated, but for say Nvidia or Apple I would assume the employees would be a good people to take the stock advice from.
And this is again an obviously naive assumption. Your average developer at Apple has no idea how many iPhones Apple sold in China. Nor do Nvidia employees they know how many GPUs NVidia sold. Your random Amazon developer didn’t know Jassy was going to announce at the earnings call that Amazon was going to announce that they were going to spend more this year on Capex for AI related hardware than they’d free cash flow tanking their stock.
Again, I worked at AWS and we had no insider knowledge
> Your average developer at Apple has no idea how many iPhones Apple sold in China.
But if anyone is connected to few friends across team, they would know they are hiring for China sales team(or dependent team like internal tooling for sales etc.) aggressively or firing them.
As large as any big tech company is and as a silo’d few employees have friends across teams. Besides that, at every tech company, all information like that is a need to know and isn’t shared with “friends” - especially information that can move markets.
I don't know if you ever worked on big tech? Everyone knows this through gossips, referrals, friends of friends etc. The hard part is to figure out how actionable this information is.
> information that can move markets.
That's the hardest part to figure out. Stocks aren't very correlated with anything. Slight changes in this quarter's iPhone sales in China doesn't move the share price very much if it is within range of expectation.
I have worked at Amazon. I can guarantee you that no one on the Amazon Retail side had any clue what went on at AWS or vice versa.
Do you think that any of the rank and file knew that Jassy was going to announce mass layoffs or that Amazon was going to spend so much on Capex for AI that the stock would go down?
> but for say Nvidia or Apple I would assume the employees would be a good people to take the stock advice from
Isn't Apple pretty famously secretive even internally around stuff like product launches? I would expect a company that runs a tight ship to have rank-and-file employees who would have less potentially actionable info than ones at companies that don't control information as well.
In a tiny company this is true. In any medium (much less large) company you don't know much more than anyone else on the street - and the independent analysts who just watch public information closely usually know more than you do about all that. (it is their job to read the data from China and figure out what that means for the companies involved).
Also bit surprised they don't have any automated quality check. They can run something like swe bench before each release. Both of these seem like a basic thing even for startup, let alone some product generating billions in revenue.
reply