On 16/01/2024 00:52, Jon Ribbens wrote:
> On 2024-01-16, Simon Parker <
simonpa...@gmail.com> wrote:
>> On 10/01/2024 16:32, Pamela wrote:
>>> What score is required to pass the Bar Exam?
>>
>> It varies. The Uniform Bar Exam (UBE) has a maximum score of 400. In
>> some states a UBE score of 266 would be considered a pass whilst in
>> other states it needs to be 280 or above.
>>
>>> In some professions, such as accountancy, the pass mark is 50% to 55%
>>> depending on which paper you are. That leaves a lot of room for
>>> ignorance.
>>
>> GPT-4 didn't just "pass" the UBE, it was in the 90th percentile.
>>
>> However, it must be borne in mind that ChatGPT uses the GPT-3.5 series
>> model which failed the UBE.
>
> Of course, answering a series of questions which are highly likely to
> have been asked and answered many times in the past, i.e. an exam, is
> exactly the sort of thing that can be answered by anyone or anything
> with excellent recall and little to no intelligence.
Well, GPT3.5 (currently in use in ChatGPT) didn't just fail the UBE but
was in the bottom 10th percentile.
I can't help but wonder if specific very targetted work was done between
the series 3.5 and 4 models to assist GPT-4 in passing the UBE thus
enabling this to be announced to much fanfare.
> By chance I happen to have earlier today asked Google's and Microsoft's
> AI implementations some questions regarding a trivia question which
> I suspect has been seldom asked before: "what English football team has
> the name with the largest number of words?".
>
> They both said that the answer was "AFC Bournemouth" - Google because
> that's 4 words, and Microsoft because that's 3 words. Other teams such
> as "Arsenal Football Club" and "Blackburn Rovers Football Club" are out
> because clearly they have only 2 words each in their respective names.
Pedantically, both AIs are correct but they don't know why and so cannot
provide context or explain their answer which leaves you none the wiser.
In 1923 Boscombe Football Club was renamed to "Bournemouth & Boscombe
Athletic Football Club" which is 7 words and therefore the English
Football team with the largest number of words in its name.
However, in 1971 it adopted the name "AFC Bournemouth" so the answer was
correct only between 1923 and 1971, but as you didn't ask "which
*current* English football team..." I will propose that as a good
candidate for the correct answer.
If considering only current club names, thereby excluding historic ones,
I would suggest that the answer is "Brighton & Hove Albion Football
Club" with six words.
Tangentially, Arsenal is an interesting club name as it is only one of
two professional clubs in England not named after a specific area. A
bonus point if you know the other. :-)
> After I pointed out to Microsoft's AI that its answer was nonsense,
> it apologised and said the correct answer was "AFC Wimbledon", because
> that is obviously longer than "AFC Bournemouth".
Oh dear!
Regards
S.P.