Programmatically delete columns

[mj.ke...@gmail.com]

I would like to be able to do something in a script (grel or Jython, doesnt matter) - that I can specify a list of column names, and if any of the columns that exist in the "current" table do not match one in the list I provide, I want to delete that column.

Does anyone have any suggestions for this kind of operation?

Thanks

[Thad Guidry]

You could do this in Python itself, outside of OpenRefine ... by using Paul Makepeace's Python Client to perform that remove column action against your OpenRefine Project based on a dictionary list provided in your Python script.

https://github.com/OpenRefine/refine-client-py

-Thad

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Ettore Rizza]

Hi,

If you do not know Python, you can use this hackish script in OpenRefine to create a json that you can then use in Undo/Redo. 

my_list = ["name1"]

col_to_delete = []

result = []

for el in row['columnNames']:

    if el not in my_list:

        col_to_delete.append(el)

for el in col_to_delete:

    result.append("""

  {

    "op": "core/column-removal",

    "description": "Remove column %s",

    "columnName": "%s"

  }

""" % (el, el))

return "[" + ",\n".join(result) + "]"

Just replace the elements of "my_list" with your column names. Here is an example of use (screencast) :

Hope this helps,

Ettore

[mj.ke...@gmail.com]

That is awesome,  I had not considered that.  Thank you!  For what I want to do right now, that works.

[Ettore Rizza]

You're welcome. Obviously, the same tick is easier to do if you start from a list of columns that must be deleted (and not kept). In this case, simply put the list of column names in a column of Open Refine and use Templating to reproduce an Undo/Redo Json.

[Felix Lohmeier]

The JSON code of the column-reorder function (All > Edit columns > Re-order / remove columns...) actually contains a list of columns that should be kept.

[
  {
    "op": "core/column-reorder",
    "description": "Reorder columns",
    "columnNames": [
      "friend",
      "address"
    ]
  }
]

You could simply put your list of column names there and use Undo/Redo > Apply...

[Ettore RIZZA]

Ouch, seems right. So Templating could do the job in any case.

--

You received this message because you are subscribed to the Google Groups "OpenRefine" group.

To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+unsubscribe@googlegroups.com.

[mj.ke...@gmail.com]

Holy Canola oil... that's even better.

Thanks!

[MRB]

[MRB]

I actually find this destructive ordering of column reordering a bad thing because while exploring data  may have left off a column or two I need later.  if I want to keep a column I need to edit the script I used to be sure it's not erased ... it seems it would be better to explicitly remove a column so it's in the script - not delete new ones ... Thanks, Mark

On Wednesday, May 9, 2018 at 2:08:22 PM UTC-4, mj.ke...@gmail.com wrote: