1. 5
  1. 3

    Acceptance rate (for suggestions visible for >750ms) 34%

    This is the most interesting number to me. 1/3 of all suggestions by the AI are accepted by the user! Even with how primitive these things are, they’re already generating good code. My quick sprint with GitHub Copilot showed me how it useful these things can be - it was autocompleting a lot of complex Kotlin code for me.

    1. 3

      they’re already generating good code.

      Because this test is on Google developers, I’ll grant that it is likely generating “good” code, but the statistic here is actually “accepted” code, which I might term “good enough.” There’s a key difference in those terms, especially when the minimum time for the suggestion to be on the screen is less than a second.

      As I consider what changes will happen to different professions as AI gets bigger (thinking as a tool to be used, not “the robots will take our jobs!”), I can’t help but think that the quality that is accepted will go down over time as the speed at which you can work goes up. People could become as used to programming suggestions as they are on GPS nowadays, leading to a decrease in people’s map reading ability.

      I wouldn’t be surprised where, in content creation specifically after reading the DALL-E threads here, or in programming, you’ll eventually see people advertising “hand crafted” content. “This Youtube channel is produced without ANY AI (woah, wow!)”. “This code was entirely generated by a real human, support your local programmer.” This could become the same sort of niche as buying a vase that wasn’t produced in a factory, with higher charges associated.

      I’m not against AI-based tools, the threads here the past few weeks have convinced me of a few really good ways they can be used. But much like air travel was glamorous and now is a cattle car with wings, I think the ability to accept things quickly and move on, letting you do more in the same amount of time, is going to lead to significant change for a few industries. Change isn’t bad.