Recent comments in /f/singularity

Queue_Bit t1_jdzlxht wrote

I mean that we've used about 1/10th of the high quality training data.

Which means that even with zero improvement in algorithms or methodology. And assuming that improvement is linear. And assuming no new data is created. It means that LLMs will get about 10x better. And who knows what that looks like.

1

loopy_fun t1_jdzl30n wrote

if i submit this to agi or asi it could have positive results.

coexisting is a problem. will you decide to fail the test ? agi or asi should give it some consideration.

agi or asi would be programmed to solve problems . and would not want appear to be unintelligent even a little to itself.

1

Baron_Samedi_ t1_jdzjakg wrote

>LLM, wired like this... has no ability to recall past experience. It has no ability to evolve, and it always predicts the same output probabilities from the same input. It must go from input straight to output, it can't reserve space to think or refine its answer depending on the complexity of the task.

However, memory augmented LLMs may be able to do all of the above

3

Dizzlespizzle t1_jdzh82t wrote

How often do you interact with bing or chatgpt? bing has already demonstrated ability to recall the past with me for my queries going back over a month so not sure what you mean exactly. Is 3.5 -> 4.0 not evolution? You can ask things on 3.5 that become entirely different level of nuance and intelligence when asked on 4.0. You say it can’t think to refine its answer but it literally has been in the process of answering questions regarding itself that it will suddenly flag mid-creation and immediately delete what it just wrote and just replace it all with “sorry, that’s on me.. (etc)”, when it changes it’s mind that it cannot tell you. If you think I am misunderstaning what you’re saying on any of this feel free to correct me.

2

NanditoPapa t1_jdzezb1 wrote

I agree AI will largely be beneficial. I'm not sure on the timeline. It could be 5 years...it could be never (if we blow ourselves up first). Anyone who says they know when Singularity will happen... doesn't know when Singularity will happen.

1