Hi,
I need to convert a CSV file into a simpler format.
Step 1:
Open CSV file and clean convert fields from 8-bit ASCII to UTF-8
Step 2:
Convert currency strings to integers or floats, for example "$ 4,555,000"
Step 3:
So some calculations between two fields , eg divide one field (Total Contribution) by another filed Percentage Contribution by Country: "Ghana:30,Mozambique:70%" - these should be turned into individual records in the new csv file or data base, so that while the original CSV file contains perhap 3000 rows, the new CSV files would contain 6000 rows once these percentage devisions are applied.
Step 4:
Save as a new CSV file, or put data in SQLite or Postgres.
It's not hard to write a one off script to do this, but I'd rather write filters, decorators, or plugins, whatever for an existing ETL processor. Can bubbles handle this use case?
Many thanks,
PJ