I've never encountered an issue with file sizes. Try doing this without the drag & drop approach:
Press Command + 1 to add a new (blank) audio cue.
Highlight the cue and press Command +T (or click the arrow icon in the "Target" column)
From the resulting browser window, select your audio file. See if this allows you to add the audio file to the cue.
- brendan patrick hogan