A Chinese university trained GLM
A startup spun out by a university (z.ai). Their business model is similar to what everybody else does, they host their models and sell access while trying to undercut each other. And like others they raised billions in funding from investors to be able to do this.
But also they are just tuning and packaging a publicly available model, not creating their own.
So they can be profitable because the cost of creating that model isn’t factored in, and if people stop throwing money at LLMs and stop releasing models for free, there goes their business model. So this is not really sustainable either.
Die Art Erklärung kommt ja jetzt öfter, aber ich finde das ist etwas zu schnell geschossen. Also, natürlich nicht falsch, aber zu sehr auf einen Aspekt eingeschossen.
Erstens, der Carnot-Wirkungsgrad gilt wie üblich in der Physik für stark idealisierte Systeme die überhaupt nichts anderes tun. Also keine Interaktion mit der Umgebung etc. Da wären dann auch 80%-90% denkbar, aber in der Realität ist eine Kuh kein masseloser Punkt im Vakuum und reale Motoren haben entsprechend ca. 40%. Die sind also nicht von Zweiten Hauptsatz der Thermodynamik begrenzt sondern vorher noch erstmal von ganz anderen Dingen.
Zweitens weiß ich nicht, wieso wir bei “effizient” überhaupt zuerst an den Wirkungsgrad des Motors denken. Klar kann man Autos effizienter, billiger und umweltfreundlicher machen indem man den Wirkungsgrad erhöht und dadurch mit weniger Treibstoff die gleiche Arbeit verrichtet. In der Realität haben wir Autos aber zu einem großen Teil mit besserer Aerodynamik effizienter gemacht. Und die hat mit dem Wirkungsgrad des Motors nichts zu tun. Oder mit der Art des Motors ansich.
Auch energiedichtere Treibstoffe wären denkbar, oder leichtere Materialien, usw. In der Realität hat sich das halt nicht rechtzeitig ergeben bevor die Elektroautos überholt haben, aber am Wirkungsgrad des Motors alleine hing das auf jeden Fall nicht.
Wenn der Wirkungsgrad des Motors alles entscheiden würde, könnten wir ja bei den Elektroautos jetzt aufgeben. Da ist der Wirkungsgrad ja schon hoch und mehr als 100% geht nicht, dementsprechend ist da eh nicht mehr viel zu holen. Das ist aber natürlich Quatsch, weil der Wirkungsgrad in der Realität eben nur einer von vielen Faktoren ist und nicht mal wirklich der wichtigste.
Wo der Wirkungsgrad dagegen wirklich ein Totschlagargument ist, sind die E-Fuels. Da haben wir einen direkten Vergleich was ein Elektroauto mit X Menge umweltfreundlich erzeugten Strom an Arbeit leistet, vs den Verbrenner mit Treibstoff der mit der selben Menge Strom hergestellt wurde. Weil da nicht nur der Wirkungsgrad vom Motor schlecht ist, sondern auch bei der Produktion des Treibstoffs der Wirkungsgrad schlecht ist, fällt der Vergleich natürlich katastrophal aus zu Ungunsten der E-Fuels.
I had some video glasses ages ago that could do that too. Like 15 years ago. I can’t recall a single game without problems. UI was the biggest issue. Often UI elements were at nonsensical 3D positions, and while you wouldn’t notice this on a normal screen, the glasses tried to render them in the center of my brain…
And before that I had an nVidia graphics card in the late 90ies that came with shutter glasses. The driver could do stereo for “everything” too, however for me “everything” was one game where I could get it to work.
It’s popular because it appears in the opening of the anime Slam Dunk, which plays in the Shonan area.
No I haven’t watched the anime, I found out about it a couple years back when I was confused why there were so many people there.
The design was selected after the city government invited public submissions to promote Kamakura.
…
“We decided on the suspension because some residents thought the design helped attract visitors and found this unpleasant,” a member of the city’s tax division said.
I want to post the surprised pikachu meme but I actually have severe doubts that this is what’s attracting the tourists taking pictures at the crossing…
We need to start posting this everywhere else too.
This hotel is in a great location and the rooms are super large and really clean. And the best part is, if you sudo rm -rf / you can get a free drink at the bar. Five stars.
I don’t really see a problem with it either. I pay more in some other countries too as a tourist. Here it’s framed as making tourists pay more, but it could also be framed as keeping the museum accessible for your population which does not necessarily have the same budget for museums as an international tourist on the trip of their life.
But: Tourists absolutely do pay taxes. There are accommodation taxes on hotel stays (in France this can be up to ~15 Euro per person per night), they pay consumption taxes like VAT, and there are arrival and departure taxes or airport taxes.
I agree that “Ist es heute sonnig?” is the most normal way to say it, but obviously the verb is not in the second position because yes/no questions do not use V2 order.
How do they mess this up so bad?
They made their devs use copilot.
Polyphallophiles, if that’s a word that exists
I don’t understand how a Japanese brand thinks that people need this. Based on my typical experience walking around in Tokyo I estimate these would be empty approximately 120% of the time
They had iPod socks like 20 years ago
In principle, yes, but isolated unvaccinated communities can still have major incidents just from one contact. E.g. Germany is at around 97% and a couple weeks ago there was a small outbreak involving a bunch of unvaccinated children.
If they were smarter they’d just detect AI agents and quote them higher prices.
It does include the fifth password Louvre4, but actually they only can’t re-use the previous 6 passwords so it went through.
I don’t understand how people can look at the insane progress gpt has made in the last 3 years and just arbitrarily decide that this is its maximum capability.
So this is not entirely arbitrary, and probably part of it is also that they’re not just looking at the progress, but also at systemic issues.
For example we know that larger models with more training material are more powerful. That’s probably the biggest contributing factor to the insane pace at which they’ve developed. But we’re also at a point where AI companies are saying they are running out of data. The models we have now are already trained on basically the entire open internet and a lot of non-public data too. Therefore we can’t expect their capabilities to scale with more data unless we find ways to get humans to generate more data. At the same time the quality of data on the open internet decreases because more of it is generated by AI.
On the other hand, making them larger also has physical requirements, most of all power. We are already at a point where AI companies are buying nuclear power plants for their data centers. So scaling in this way is close to the limit too. Building new nuclear power plants takes ages.
Another different thing is that LLMs can’t learn. They don’t have to be able to learn to be useful, obviously we can use the current ones just fine at least for some tasks. But nonetheless this is something that limits the progress that’s possible for them.
And then there is the entire AI bubble thing. The economical side of things, where we have an entire circular economy based on the idea that companies like OpenAI can spend billions on data centers. But they are losing money. Pretty much none of the AI companies are profitable other than the ones that only provide the infrastructure. Right now investors are scared enough to miss out on AGI to continue investing but if they stopped, it would be over.
And all this is super fragile. The current big players are all using the same approach. If one company makes that next step and finds a better approach than transformer LLMs, the others are toast. Or if some Chinese company makes a breakthrough with energy usage again. Or if there is a hardware breakthrough and the incentive to pay for hosted LLMs goes away. Basically even progress can pop the bubble because if we can all run AI that does a good enough job at home then the AI companies will never hit their revenue targets. And then the investment stops and companies that bleed billions every quarter without investors backing them can die very quickly.
Personally I don’t think they will stop becoming better right now. Even if they do stop, I’m not convinced we understand them well enough to be unable to improve the ways in which we use them a bit more. But when people say that this is the peak, they’re looking at the bigger picture. They say that LLMs can’t get closer to human intelligence because fundamentally, we don’t have a way to make them learn, they say that the development model is not sustainable, and other reasons like that.
Just ask if you can shake her hand or something
I started learning when I was 9. I think to some extent it was easier back then in the 80ies because computers were relatively simple machines. On the other hand I also had to learn English at the same time to be able to read manuals and programming books etc. So I think it must be possible because even if I saw the word “syntax” I doubt I had a full grasp of what it means.
Da war ja mal wieder die geballte Kompetenz am Werk.