Correct Data Types - Wrangler

[Anthony Apollis]

Please assist? I would like to correct my data types in the Wrangler tool, data is from Campaign manager. I tried several data types for instance in my first column, which is date. Just don't seem to get it right?

[Baptiste Benet]

Hey Anthony,

What happens if you try and follow something like what's described here? https://cdap.atlassian.net/wiki/spaces/DOCS/pages/1162641663/Converting+Timestamp+types+to+Date+in+Wrangler. Does it work?

Le ven. 10 juin 2022 à 03:14, Anthony Apollis <ant...@tmicollective.com> a écrit :

Please assist? I would like to correct my data types in the Wrangler tool, data is from Campaign manager. I tried several data types for instance in my first column, which is date. Just don't seem to get it right? -- You received this message

ZjQcmQRYFpfptBannerStart

This Message Is From an External Sender

This message came from outside your organization.

 

ZjQcmQRYFpfptBannerEnd

Please assist? I would like to correct my data types in the Wrangler tool, data is from Campaign manager. I tried several data types for instance in my first column, which is date. Just don't seem to get it right?

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/a7135cce-de7d-4328-92c2-6da97ba01b6en%40googlegroups.com.

[Baptiste Benet]

After searching a little more, this is what I found for Wrangler: https://cdap.gitee.io/docs/zh/user-guide/data-preparation/directives/format-unix-timestamp.html, but couldn't get around to using it... I think you should consider doing a Javascript Transform to turn that column into a date.

[Albert Shau]

There is a parse-timestamp directive that can be used to parse a string into a timestamp. 

You can also specify the time unit:

parse-timestamp [column] [seconds | milliseconds | microseconds]

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAEoRv149Js9qDLZ6ouBe%2BLM5iY2kCjW4pckYkTPY6LycwoxZxA%40mail.gmail.com.

[Anthony Apollis]

I am getting this error: 

[Baptiste Benet]

Try and remove the "<" and ">" characters, you shouldn't need them

Le mer. 15 juin 2022 à 06:28, Anthony Apollis <anthony...@gmail.com> a écrit :

I am getting this error: On Friday, June 10, 2022 at 10:46:53 PM UTC+2 baptist...@liveramp.com wrote: Hey Anthony, What happens if you try and follow something like what's described here? https://cdap.atlassian.net/wiki/spaces/DOCS/pages/1162641663/Converting+Timestamp+types+to+Date+in+Wrangler

ZjQcmQRYFpfptBannerStart

This Message Is From an External Sender

This message came from outside your organization.

 

ZjQcmQRYFpfptBannerEnd

I am getting this error: 

On Friday, June 10, 2022 at 10:46:53 PM UTC+2 baptist...@liveramp.com wrote:

Hey Anthony,

What happens if you try and follow something like what's described here? https://cdap.atlassian.net/wiki/spaces/DOCS/pages/1162641663/Converting+Timestamp+types+to+Date+in+Wrangler. Does it work?

Le ven. 10 juin 2022 à 03:14, Anthony Apollis <ant...@tmicollective.com> a écrit :

Please assist? I would like to correct my data types in the Wrangler tool, data is from Campaign manager. I tried several data types for instance in my first column, which is date. Just don't seem to get it right? -- You received this message

ZjQcmQRYFpfptBannerStart

This Message Is From an External Sender

This message came from outside your organization.

 

ZjQcmQRYFpfptBannerEnd

Please assist? I would like to correct my data types in the Wrangler tool, data is from Campaign manager. I tried several data types for instance in my first column, which is date. Just don't seem to get it right?

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/a7135cce-de7d-4328-92c2-6da97ba01b6en%40googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/0383fd01-28c1-4452-a7c2-84ee48d819efn%40googlegroups.com.

[Anthony Apollis]

I did and i am getting the same error:

You received this message because you are subscribed to a topic in the Google Groups "CDAP User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/cdap-user/5QXlxT_Fe04/unsubscribe.
To unsubscribe from this group and all its topics, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAEoRv15uhFWahn4CBrMd9SZa3UguAMwBZ8Qhi31eZTM62s%2B9ug%40mail.gmail.com.

--

Anthony Apollis Data Lead 021 447 3344 | tmicollective.com 3rd Floor, Central Building, Black River Park, 2 Fir Street, Observatory, Cape Town, 7925

The content of this email is confidential and intended for the recipient specified in message only. It is strictly forbidden to share any part of this message with any third party, without a written consent of the sender. If you received this message by mistake, please reply to this message and follow with its deletion, so that we can ensure such a mistake does not occur in the future.

[Anthony Apollis]

Would you please show an example as in my date column?

You received this message because you are subscribed to a topic in the Google Groups "CDAP User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/cdap-user/5QXlxT_Fe04/unsubscribe.
To unsubscribe from this group and all its topics, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAOtBAghzNT7p%2B1W%2BSytY-Q_ukG2doGW%2BL5_OK5X%2B0SwVnrRLnw%40mail.gmail.com.

[Anthony Apollis]

Please explain more?

[Baptiste Benet]

Type this: parse-timestamp :Event_Time microseconds

Le lun. 20 juin 2022 à 04:49, Anthony Apollis <ant...@tmicollective.com> a écrit :

Please explain more? On Tuesday, 14 June 2022 at 18:09:11 UTC+2 Albert Shau wrote: There is a parse-timestamp directive that can be used to parse a string into a timestamp.  You can also specify the time unit: parse-timestamp [column] [seconds

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/008bfdd0-e661-48a9-b746-4de92ba18b49n%40googlegroups.com.

[Anthony Apollis]

im still waiting on this example?

On Tuesday, 14 June 2022 at 18:09:11 UTC+2 Albert Shau wrote:

[Christophe DIEDHIOU]

Hi Anthony, hope you are fine, please try this and let me know 

parse-as-simple-date :  date_field dd/MM/yy

Best regards !

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/a8035dcc-bde3-4af3-af22-3a7d6c33f172n%40googlegroups.com.

[Anthony Apollis]

Thank you, i did solve that problem.

What i am trying to solve now is log time or time duration. Please assist? I tried the Log function in Wrangler, but nothing happens.

You received this message because you are subscribed to a topic in the Google Groups "CDAP User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/cdap-user/5QXlxT_Fe04/unsubscribe.
To unsubscribe from this group and all its topics, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CA%2BWXLUjbvDPvshncrAHAqDeNwSHH5bM2JosXXOrqWiQJL4_0jg%40mail.gmail.com.

[Christophe DIEDHIOU]

Good to know that your problem is solved.

What is the format of your log duration?

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAO8x8_zCB4jun9%2BB4Bu60MA%3D_twCfuLEXC7MrRn0dKf1SnSEWQ%40mail.gmail.com.

[Anthony Apollis]

It should be Minutes n Seconds.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CA%2BWXLUjf6q2cRw_gX1SoFjbYjW00_T7J%2BcV_F3unvKoqTMTMxw%40mail.gmail.com.

[Christophe DIEDHIOU]

Is the actual format is in milliseconds?

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAO8x8_yWyucDTzp-8nAesM8yLcktfmRWgt01WJWR-JA-GPPHrg%40mail.gmail.com.

[Anthony Apollis]

Here is a sample file https://drive.google.com/file/d/13hborc-4nFNQ3m8wLzQiyANFsbqvhEAO/view?usp=drivesdk

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CA%2BWXLUhWfdi1LiOQZYgpxi9VvpGTGDu6B_wi8BhRn3Eri61xBQ%40mail.gmail.com.

[Christophe DIEDHIOU]

I'm not able to open your file. This was my response for correct interaction time.

Hi Antony, change the format of interaction_time to double or float and on the top of the field click on the arrow, choose the custom transform option to do the right calculation for conversion. You can before the custom transform , if you want use fill null or empty cells option to replace null values by 0 The second option is to use python transform before having downloaded python plugin from Hub and there do your conversion.
----
For practice, if your interaction_time is in milliseconds that what I think it is. Change the type to float,Use  fill null or empty cells option to replace null values by 0 and then use custom transform to do this computation interaction_time/60000 because 1 minute=60000 milliseconds

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CAO8x8_ynz_x7Or6h1%3DAEprzJt0NJO2WTt-7JMDg1hS%2B22DO1bg%40mail.gmail.com.

[Anthony Apollis]

I have tried the data type changes for interaction_time and this is what i get, see screenshot.

Floodlight_Configuration would be something similar, I applied the same formula(see screen shot).

More on Floodlight_Configuration: https://support.google.com/campaignmanager/answer/2823351?hl=en and https://support.google.com/campaignmanager/answer/2823400?hl=en.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/CA%2BWXLUgNO5caFouXj0SJzfVToNetYj_bQph0sAH8%2BEcLC6m8Cg%40mail.gmail.com.