"I used to say that AI research seemed to have an odd blind spot towards the automation of programming work, and I suspected a subconscious self-preservation bias. The recent, almost accidental, discovery that GPT-3 can sort of write code does generate a slight shiver."
He was referring to the recently unveiled Generative Pretrained Transformer 3—GPT-3 for short—that, like MISIM, has successfully created code in multiple programming languages. The artificial intelligence laboratory OpenAI has been making significant inroads with machine learning models such as GPT-3. It was trained with a repository of 175 billion parameters and is capable of generating code from simple non-technical instructions. Instructed to design "a button that looks like a watermelon," for example, GPT-3 generated HTML code for a web page presentation, complete with an interactive watermelon prompt.
The team behind MISIM includes researchers from Intel, the Massachusetts Institute of Technology and the Georgia Institute of Technology.
MISIM is not the first system to compare code snippets, but its creators say its accuracy rate was up to 40 times that of its nearest competitors.
Veselin Raychev, CTO at the Swiss-based company DeepCode, said that machine learning poses an exciting step forward in streamlining tremendously time-consuming bug-detection processes. DeepCode specializes in advanced bug-detection software. But, Raychev says, machine learning generates too many false positives.
"Practically they're not there yet," he said, "by a very big margin."
One reason for false positives is that AI is not good at spotting bugs unless they have been defined as such. But the MISIM system does not rely on such definitions. Instead, by comparing a new program with code previously established as correct, it can raise a flag when significant differences, which could be errors, are detected.
As MISIM matures and broadens its ability to translate plain English instructions into programming code, Gottschlich says, everyone will be able to design their own programs.
"Building little apps for your phone, or things like that that will help your everyday life—I think those are not too far off," Gottschlich said. "I would like to see 8 billion people create software in whatever way is most natural for them."
0 Comments