Spyke

Replies

drama

Comment on

Reddit is getting rid of all awards and coins with no replacement

Reply in thread

They can’t execute. Here’s my theory: their overarching plan is to create an environment where users have to see ads (like YouTube) so that they can create a revenue model to pay creators. They’re just so bad at messaging and company-wide planning that they’re doing all these things piecemeal rather than presenting it as a whole package. If they presented this all at once with one as the cost of the other, it would’ve been a little more coherent. But Reddit sucks at this and turned it into a dumpster fire. They aren’t ready to turn all the old features off at one moment and the new ones on the next.

Comment on

Over just a few months, ChatGPT went from accurately answering a simple math problem 98% of the time to just 2%, study finds

I don't agree that ChatGPT has gotten dumber, but I do think I’ve noticed small differences in how it’s engineered.

I’ve experimented with writing apps that use the OpenAI api to use the GPT model, and this is the biggest non-obvious problem you have to deal with that can cause it to seem significantly smarter or dumber.

The version of GPT 3.5 and 4 used in ChatGPT can only “remember” 4096 tokens at once. That’s a total of its output, the user’s input, and “system messages,” which are messages the software sends to give GPT the necessary context to understand. The standard one is “You are ChatGPT, a large language model developed by OpenAI. Knowledge Cutoff: 2021-09. Current date: YYYY-MM-DD.” It receives an even longer one on the iOS app. If you enable the new Custom Instructions feature, those also take up the token limit.

It needs token space to remember your conversation, or else it gets a goldfish memory problem. But if you program it to waste too much token space remembering stuff you told it before, then it has fewer tokens to dedicate to generating each new response, so they have to be shorter, less detailed, and it can’t spend as much energy making sure they’re logically correct.

The model itself is definitely getting smarter as time goes on, but I think we’ve seen them experiment with different ways of engineering around the token limits when employing GPT in ChatGPT. That’s the difference people are noticing.

Comment on

How will lemmy instances survive if they get too big?

I think we’ll see a variety of servers with different funding models, similar to how radio and tv stations in the us can have a variety of funding models. NPR has a network of member stations that all carry their content (if the stations want, or they can get content from another station, or they can make it themselves).

Threads is an example of a federated service with a corporate funding model. I definitely think it’ll survive since they have as much money as Facebook wants to sink into it.

But we’ll probably also see servers that run on donations by a dedicated community.

If Threads is the NBC/CBS/ABC of the federated landscape, then those small servers will be like public radio stations, which operate on donations and the occasional government grant.

I think there are people who would chip in a little bit to fund a non-commercial server just the same as there are people who chip in money to NPR.

Comment on

A teachers union says it’s fed up with social media’s impact on students

Reply in thread

Someone close to me is a HS teacher. During covid, the schools changed their policy from “no phones in class ever” to “you can have your phone in class but you’d better only use it to help with classwork or in an emergency.”

They’ve been trying to reverse the policy back to how it was, but it’s hard to get all the kids to believe that they can’t do this anymore. They don’t take the threat of punishment seriously because everyone is doing it now.

Even if you manage to deal with the phone issue, the school gives kids chromebooks now to do their work on. The student wifi network seemingly has no restrictions, since the teachers sometimes need to have them watch something on YouTube or Netflix.

So kids, during class, watch Netflix on their Chromebook instead of paying attention.

Comment on

At which level within the hierarchy of the US office do individuals aspiring to be part of it tend to be perceived as driven by a strong desire for power?

In one of my 300 level poli sci classes, literally one of the first things the professor said is that in politics, everyone running for office is a power-hungry narcissist. It’s only a slight exaggeration.

That type of person is at every level of politics. I’d wager that if you could get data on the real motivations of every person who has ever run for office, you’d probably see the same amount of those people at every level, from school board to president.

chatgpt

Comment on

Genuinely frightening how much they have nerfed ChatGPT for code development.

Gpt4 is not good at writing code. I think it’s because it has a lower token limit. Ask Gpt 4 to write out detailed specs for the code you want, then copy and paste that into a Gpt-3.5 session and ask it to write the code

And if it gets cut off, paste in the last line it output successfully and ask it to continue with the line following that one. Then just copy and paste the blocks together