Thanks for posting that article, John. Interesting results.
One comment:
... with freelance interpreters more likely to report an upward trend compared to freelance translators.
Last Saturday, I gave a talk about AI trends to a group of interpreters in Tokyo. Those I spoke with confirmed what I had guessed: that AI interpreting is not yet at a level where human interpreters’ jobs are threatened. One interpreter (who is on this list) told me that he has heard no reports yet of interpreters losing work to AI.
I think that will probably change in the coming months and years as better and faster AI voice interpretation becomes available, especially AI with large context windows and with visual input for recognizing gestures, facial expressions, etc. My guess, though, is that there will continue to be demand for human interpreters in situations where the interpreter’s physical presence and identity and feelings as a real person are valued.
I have been waiting eagerly for months to try out OpenAI’s Advanced Voice feature to see how well it can interpret spoken conversations, but they are rolling it out very slowly.
Another comment:
One complaint I have seen about AI-generated texts and images, and which I agree with, is that, at least with simple prompting, the output tends towards a homogenous mediocrity. Texts lack an individual voice, and faces—though superficially diverse—have a similar level of symmetricity and attractiveness. One explanation is that the models are just producing high-level averages of the data they were trained on, so they tend to converge on similar midpoints. Thus the blandness of so much AI-generated slop.
As I continue to use LLMs to help me with my translation work, though, I am coming to realize that such blandness can actually be helpful in translation. I have mainly done writer-driven work that, ideally, should not seem like it was translated from Japanese, but it has always been hard for me to scrub the Japanese-ness completely from my translations. Now, if I am unhappy about how a translation I have produced sounds, I will give a couple of LLMs the original Japanese and my draft translation and ask them to rewrite my English so that it reads more smoothly and naturally without departing significantly from the meaning of the Japanese. I don’t accept all of their suggestions, of course, but often their output is better than what I could have produced on my own. They have been trained on vastly more English than I have been exposed to in my entire life, and their “sense” of what is the most natural, commonplace English is better than mine.
And one more:
A few days ago I did a translation job for which, as I usually do now, I started with the translations produced by the latest versions of several LLMs. This time I used ChatGPT 4o, Claude 3.5 Sonnet, Gemini 1.5 Pro Experimental 0827, Mistral Large 2, and Llama 3.1 405B. It might have been due to how I prompted them and the nature of the text, but, to my surprise, for the first time Gemini produced the best draft, followed by Claude and ChatGPT. Mistral and Llama were obviously inferior, and I ended up not using anything from their drafts.
Tom Gally