I think I just found a way for this kind of duplicates, e.g. all made at once do to an import. A problem with it is that it also deletes non-dupes introduced by the import.
(0) Go to the properties of the dupes and note the exact created date of the newer one. This is under Properties -> Task Statistics -> Created:
(1) Go to To-Do tab -> Outline -> All tasks
(2) Go to Edit > Text filter...
(3) Expand "Advanced", then click the "Add advanced" checkbox
(4) Click "Setup..." button
(5) Click "Add rule"
(6) Make a rule with "CreatedDateTime" you found in (0)
(7) Run the rule, then select and delete all the results.
Would still be nice to know if there is a better way.