welcome to long field of view— where I perused the news of the week and stripped it down to the nitty-gritty.let’s work out what is really important.
This week is a conundrum. Researchers, on the other hand, say ChatGPT has lost its way. On the other hand, I’ve heard AI will replace outsourced coding jobs in India.
1. ChatGPT seems to be getting a lot worse
First article of the week: Researchers say OpenAI’s LLM is doing much worse than it was months ago. It should be noted that code with bug.
Analysis: I have my doubts, but here’s what’s important: I do not understand
Study reviewers have noted methodological problems with the study.But the bigger problem may be “Open” AI is never.
Benji Edwards: Research Claims ChatGPT Is Losing Functionality
“Left stumbled in the dark”
Researchers at Stanford University and University of California, Berkeley [uploaded a preprint] A paper claiming to show changes in the output of GPT-4. Using API access, I tested the March 2023 and his June 2023 versions of these models with tasks such as code generation.
…
[It] This fuels the popular but unproven belief that AI language model coding and composition tasks have gotten worse over the past few months. … popular theories as to why include “distilling” his OpenAI model to reduce computational overhead, … training to reduce harmful outputs, [and] There are conspiracy theories, such as that more people will pay for GitHub Copilot because OpenAI cuts the coding capabilities of GPT-4.
…
Meanwhile, OpenAI has consistently denied claims that GPT-4’s capabilities have been compromised. [But] Closed black-box models like GPT-4 leave researchers open to the possibility that the system may contain additional unknown components, such as safety filters or eight recently rumored “mixed-expert” models. You’ll be stumbling in the dark trying to define the properties of I work at a concert.
Katiana Quatch: LLMs are getting stupid
“be careful”
The team examined both models’ coding abilities based on a list of 50 simple programming challenges drawn from the LeetCode set. Responses containing bug-free code that gives the correct answer are considered directly executable code. The number of directly executable scripts generated by GPT-4 decreased from 52% to 10% over the same period.
…
[They’re] We warn developers to regularly test the behavior of their models in case any tweaks or changes have ripple effects elsewhere in the application or service that relies on them. …companies that rely on software such as OpenAI’s technology to power their products and services …should be vigilant about how their behavior may change over time. .
Coding is definitely getting worse, r3trohack3r thinks.
In early access program [I gave] programming task [to] GPT-4 regularly. [But] The GPT-4 I’m using now feels like a shadow of the GPT-4 I used before [then]. His GPT-4 at the time ported dirbuster to POSIX compliant multithreaded C in name only. I wanted three prompts.
…
Most of the programming tasks I threw at it could be done with a little guidance. …well, beyond a trivial issue, it’s basically worthless to help with the programming effort.
Whether or not the GPT is succumbing to conspiracy, Simon Willison points to the bigger problem.
Let’s be honest, the release notes and lack of transparency might be the biggest topic here. How can you build reliable software on a platform that changes every few months in mysterious, completely undocumented ways?
Don’t believe the “natural language processing” hype, says Matthew Sulaiman.
OpenAI/ChatGPT is just one of many AI NLP systems. Their products are good, but better systems exist. Broaden your horizons! These systems have been in development for about 10 years (from about 70 years of prior research). Progress is getting faster and faster.
…
With every few generations of technology, new capabilities will appear in AI/ML systems. Otherwise, progress will increase incrementally. We have just witnessed this kind of gradual change in NLP. The last time there was a big “gradual change” was 10 years ago. [But] Where did the self-driving cars we promised go?
…
No, ChatGPT won’t make 90% of your jobs obsolete within 6-12 months. … Most of the AI/ML experts and “thought leaders” touting their services on social media are charlatans.
Wait, do you still think OpenAI actually has real AI models? NinjaNerd56 can’t be fooled:
A room full of interns obsessed with Red Bull and high-THC cannabis.
So is this Anonymous Coward.
The Mechanical Turks are fed up and starting to turn down gigs, and the next bunch to pick up vacancies have other specialties. What, did you believe ******** about LLM?
2. India’s development jobs will be gone in two years, says PHB
Speaking of alleged charlatans, Stability AI’s spiky-haired boss is making headlines with yet another outlandish claim. This time he talks about the most outsourced development jobs in India. Cheers.
Analysis: garbage inflow, garbage outflow
CEO Emad Mostaque’s reasoning is that LLM can code as well, if not better. This hilarious, dimwitted PHB-PoV of his just shows his lack of understanding. LLM and Coding.
Ryan Brown: Most outsourced coders in India will die within 2 years due to AI
“Under threat from advanced AI influences”
Mostak said most Indian programmers would lose their jobs. … in a conference call with UBS analysts, [he] …“It is now possible to develop software with far fewer people. …“These models are like really talented graduates.”
…
“Why should we write code when a computer could write it better? ,” said Mostak.
…
Over 5 million software programmers live in India, and they are most threatened by the impact of advanced AI tools like ChatGPT. … Her second-largest country in Asia is a prime location for companies to outsource back-office jobs and other roles offshore.
furry_wookie doesn’t seem like a long term solution.
this will be fun. AI only copies and reformats other people’s work, it does not “create” it. When AI takes over and no one codes… AI will never copy or steal new things. No new works, no new inventions, no new programming languages, no new databases, no new platforms and frameworks, no progress, the whole world will come to a standstill.
However, Anonymous Coward expects developer jobs to collapse in India for a variety of reasons.
One smart engineer using Terraform and AWS can do the work manually done by 100 warm bodies outsourced by companies like this one. Their business model is outdated.
The moral of this story:
It takes 20 years to build a reputation, but 5 minutes to ruin it
– Warren Buffett
you are reading long field of view By Rich Jennings. You can contact him at: @RiCHi@richij or tlv@richi.uk.
Image: NEOM (via Unsplash, leveled and cropped)
