Results Table

[Ethan Heavey]

Morning folks,

I threw this results table together for the Task paper, feel free to use/modify as you see fit. Baselines from the Task website are in grey text.

\begin{table*}[bt!]
\centering\medium
\begin{tabular}{lcccccccccccc} \toprule
& \multicolumn{6}{c}{Sentence Puzzle} & \multicolumn{6}{c}{Word Puzzle} \\ \cmidrule(lr){2-7}\cmidrule(lr){8-13}
{\bf Test set} & \rotatebox{90}{\bf Original} & \rotatebox{90}{\bf Semantic} & \rotatebox{90}{\bf Context} & \rotatebox{90}{\bf Orig. + Sem.} & \rotatebox{90}{\bf Orig. + Sem. + Con.} & \rotatebox{90}{\bf Overall} & \rotatebox{90}{\bf Original} & \rotatebox{90}{\bf Semantic} & \rotatebox{90}{\bf Context} & \rotatebox{90}{\bf Orig. + Sem.} & \rotatebox{90}{\bf Orig. + Sem. + Con.} & \rotatebox{90}{\bf Overall} \\
\midrule
\textcolor{gray}{Human} & \textcolor{gray}{.907} & \textcolor{gray}{.907} & \textcolor{gray}{944} & \textcolor{gray}{.907} & \textcolor{gray}{.889} & \textcolor{gray}{.920} & \textcolor{gray}{.917} & \textcolor{gray}{.917} & \textcolor{gray}{.917} & \textcolor{gray}{.917} & \textcolor{gray}{.900} & \textcolor{gray}{.917} \\
\textcolor{gray}{ChatGPT} & \textcolor{gray}{.608} & \textcolor{gray}{.593} & \textcolor{gray}{.679} & \textcolor{gray}{.507} & \textcolor{gray}{.397} & \textcolor{gray}{.627} & \textcolor{gray}{.561} & \textcolor{gray}{.524} & \textcolor{gray}{.518} & \textcolor{gray}{.439} & \textcolor{gray}{.292} & \textcolor{gray}{.535} \\
\textcolor{gray}{RoBERTa-L} & \textcolor{gray}{.435} & \textcolor{gray}{.402} & \textcolor{gray}{.464} & \textcolor{gray}{.330} & \textcolor{gray}{.201} & \textcolor{gray}{.434} & \textcolor{gray}{.195} & \textcolor{gray}{.195} & \textcolor{gray}{.232} & \textcolor{gray}{.146} & \textcolor{gray}{.061} & \textcolor{gray}{.207} \\
model 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 \\
model 2 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 \\
model 3 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 & 1 \\

\bottomrule
\end{tabular}
\caption{SemEval2024 Task 9: BRAINTEASER results table}
\label{tab:results}
\end{table*}

Happy paper writing :D

[yifan jiang]

Thank you for sharing that.

Yifan Jiang