Why OpenRefine loses rows of TSV when one is imported

16 views
Skip to first unread message

Trevor Stratton

unread,
Aug 1, 2022, 6:14:18 PM8/1/22
to OpenRefine
When I upload a TSV with 4200 rows it becomes about 2600 when I open it in OpenRefine? Does anyone know why this is?

Vladimir Alexiev

unread,
Aug 2, 2022, 1:07:54 AM8/2/22
to openr...@googlegroups.com
Most likely non matching pairs of quotes, eg Toys'R"Us.
- try playing with import options
- try opening on excel
- try "csvtk brows -t". You'll find this program on github
- can you post the file?


On Tue, Aug 2, 2022, 01:14 Trevor Stratton <trevors...@gmail.com> wrote:
When I upload a TSV with 4200 rows it becomes about 2600 when I open it in OpenRefine? Does anyone know why this is?

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/0d9c770c-9acc-4a6f-8169-89efbeb70a6cn%40googlegroups.com.

Trevor Stratton

unread,
Aug 2, 2022, 11:19:22 AM8/2/22
to OpenRefine
Yes, here is the file. If you were to import it into OpenRefine (at least in the same way I did), it will go from 4800 to 2600 rows. Please let me know if you know how to solve this issue.

Thank you!

Motley Collection (1) - Motley+Collection+of+Theatre+and+Costume+Design-20220801111055 (6).tsv

Thad Guidry

unread,
Aug 2, 2022, 11:27:02 AM8/2/22
to openr...@googlegroups.com
You likely have some quote issue within some lines as Vladimir suggested.
Your best bet is to use the Line-based importer instead...and double-check things. 
Then you can manually create and Add new column based on... patterns that you need to extract from each long line string.

The other thing that might be happening is that you are automatically put into Records mode and not Rows mode, you can switch that at any time along the top of the data grid.


Reply all
Reply to author
Forward
0 new messages