email

28 views
Skip to first unread message

Castex, Antoine

unread,
Apr 25, 2018, 4:51:14 PM4/25/18
to Forseti Security Beta Testers
Hello team

i want to enable email output for inventory on my rc2

The only things i have to do is to modfy config file and restart service on server vm ?

modify is only that ?


thanks

because i have done this and nothing receive ...




Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia



--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

Henry Chang

unread,
Apr 25, 2018, 6:11:20 PM4/25/18
to Castex, Antoine, beta-t...@forsetisecurity.org
Hi Anotine,

We still need to merge in PR #1416 to RC2, to enable this feature.  Give us a chance to do some testing, and let's aim for tomorrow for you to try this out.

Thanks!

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.
To view this discussion on the web visit https://groups.google.com/a/forsetisecurity.org/d/msgid/beta-testers/CAKAsqREX8oQ6t0L%2B%2BmcA48%2BXzSpdG6Q1%3DP9i9P5VYN1X-imHqw%40mail.gmail.com.

Henry Chang

unread,
Apr 26, 2018, 12:09:14 AM4/26/18
to Castex, Antoine, beta-t...@forsetisecurity.org
Hi Antoine,

The inventory summary feature is now merged into RC2, which you can try by simply resetting the server VM from the cloud console (see this screenshot).

image.png

There is a new section in the forseti_conf_server.yaml that you will need to enable and update with the gcs path.

image.png

Then, manually run the command cronjob (crontable -l).  At you end, please check the gcs bucket to see if you got the inventory summary output.

Hope you enjoy it, and please let us know how it works for you.

Castex, Antoine

unread,
Apr 26, 2018, 7:47:37 AM4/26/18
to Henry Chang, Forseti Security Beta Testers
Henry

I was thinking that the email feature was still available in rc2 , why do you have remove them ?



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


On Thu, Apr 26, 2018 at 12:11 AM, Henry Chang <hen...@google.com> wrote:
Hi Anotine,

We still need to merge in PR #1416 to RC2, to enable this feature.  Give us a chance to do some testing, and let's aim for tomorrow for you to try this out.

Thanks!

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.

Castex, Antoine

unread,
Apr 26, 2018, 8:02:46 AM4/26/18
to Henry Chang, Forseti Security Beta Testers
Wow amazing fast !

I just dont understand one thing, only reboot the server VM make automatically the update ???



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


On Thu, Apr 26, 2018 at 6:09 AM, Henry Chang <hen...@google.com> wrote:
Hi Antoine,

The inventory summary feature is now merged into RC2, which you can try by simply resetting the server VM from the cloud console (see this screenshot).

image.png

There is a new section in the forseti_conf_server.yaml that you will need to enable and update with the gcs path.

image.png

Then, manually run the command cronjob (crontable -l).  At you end, please check the gcs bucket to see if you got the inventory summary output.

Hope you enjoy it, and please let us know how it works for you.

On Wed, Apr 25, 2018 at 3:11 PM Henry Chang <hen...@google.com> wrote:
Hi Anotine,

We still need to merge in PR #1416 to RC2, to enable this feature.  Give us a chance to do some testing, and let's aim for tomorrow for you to try this out.

Thanks!

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.

Henry Chang

unread,
Apr 26, 2018, 11:23:32 AM4/26/18
to Castex, Antoine, beta-t...@forsetisecurity.org
Yes, there is a startup-script that is bound to the VM.  What it will do, is to pull the updated code from the github branch that you used to install.  You can take a look at the startup-script below.


You can read more about the startup script and how it's used by the VM here.


Please let us know if you have any other questions!

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.
To view this discussion on the web visit https://groups.google.com/a/forsetisecurity.org/d/msgid/beta-testers/CAKAsqRH49PqNTgQzHxDmxWG6LRFpvXhr70HxXESmJ1DcL5CAiQ%40mail.gmail.com.

Castex, Antoine

unread,
Apr 27, 2018, 3:59:38 AM4/27/18
to Henry Chang, Forseti Security Beta Testers
Hello Henry

I have rebooted my vm and today all is broken

antoine_castex_veolia_com@forseti-client-vm-4540:~$ forseti inventory list Traceback (most recent call last): File "/usr/local/bin/forseti", line 6, in <module> from pkg_resources import load_entry_point File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 3088, in <module> @_call_aside File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 3072, in _call_aside f(*args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 3101, in _initialize_master_working_set working_set = WorkingSet._build_master() File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 574, in _build_master ws.require(__requires__) File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 892, in require needed = self.resolve(parse_requirements(requirements)) File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 778, in resolve raise DistributionNotFound(req, requirers) pkg_resources.DistributionNotFound: The 'SQLAlchemy>=1.1.9' distribution was not found and is required by forseti-security


Nothing work ! so i have deleted all  and try to re-install again ...

Now i have an error during the installation :

Traceback (most recent call last):
  File "setup/installer.py", line 23, in <module>
    run_forseti_installer.run()
  File "/home/antoine_castex/forseti-security/setup/gcp/run_forseti_installer.py", line 114, in run
    instructions = forseti_server.run_setup(final_setup=False)
  File "/home/antoine_castex/forseti-security/setup/gcp/installer/forseti_installer.py", line 131, in run_setup
    deployment_tpl_path) = self.create_resource_files()
  File "/home/antoine_castex/forseti-security/setup/gcp/installer/forseti_installer.py", line 160, in create_resource_files
    conf_file_path = self.generate_forseti_conf()
  File "/home/antoine_castex/forseti-security/setup/gcp/installer/forseti_server_installer.py", line 222, in generate_forseti_conf
    ForsetiServerInstaller, self).generate_forseti_conf()
  File "/home/antoine_castex/forseti-security/setup/gcp/installer/forseti_installer.py", line 359, in generate_forseti_conf
    self.config.timestamp)
  File "/home/antoine_castex/forseti-security/setup/gcp/installer/util/files.py", line 107, in generate_forseti_conf
    conf_values):
  File "/home/antoine_castex/forseti-security/setup/gcp/installer/util/files.py", line 150, in generate_file_from_template
    out_contents = tmpl_contents.format(**template_values)
KeyError: 'INV_SUMMARY_BUCKET'



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


On Thu, Apr 26, 2018 at 6:09 AM, Henry Chang <hen...@google.com> wrote:
Hi Antoine,

The inventory summary feature is now merged into RC2, which you can try by simply resetting the server VM from the cloud console (see this screenshot).

image.png

There is a new section in the forseti_conf_server.yaml that you will need to enable and update with the gcs path.

image.png

Then, manually run the command cronjob (crontable -l).  At you end, please check the gcs bucket to see if you got the inventory summary output.

Hope you enjoy it, and please let us know how it works for you.

On Wed, Apr 25, 2018 at 3:11 PM Henry Chang <hen...@google.com> wrote:
Hi Anotine,

We still need to merge in PR #1416 to RC2, to enable this feature.  Give us a chance to do some testing, and let's aim for tomorrow for you to try this out.

Thanks!

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.

Muharem Hrnjadovic

unread,
Apr 27, 2018, 4:18:13 AM4/27/18
to Antoine Castex, Henry Chang, beta-t...@forsetisecurity.org
Antoine,

please replace the '{INV_SUMMARY_BUCKET}' string in 'configs/server/forseti_conf_server.yaml.in' to something static and try again.

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.
To view this discussion on the web visit https://groups.google.com/a/forsetisecurity.org/d/msgid/beta-testers/CAKAsqRFHvKP1wZmWcz49k%2BjcKYmtdh%2BzP%3DCbLMtTMWjt0AjKmw%40mail.gmail.com.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

Castex, Antoine

unread,
Apr 27, 2018, 5:04:03 AM4/27/18
to Muharem Hrnjadovic, Henry Chang, Forseti Security Beta Testers
Muharem

I have done what you say and this is good now,  installation Ok!

You are the best :)

Let's go for testing the output !!!! 😇



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


On Fri, Apr 27, 2018 at 10:17 AM, 'Muharem Hrnjadovic' via Forseti Security Beta Testers <beta-t...@forsetisecurity.org> wrote:
Antoine,

please replace the '{INV_SUMMARY_BUCKET}' string in 'configs/server/forseti_conf_server.yaml.in' to something static and try again.

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.
To view this discussion on the web visit https://groups.google.com/a/forsetisecurity.org/d/msgid/beta-testers/CADSsqCPzrjWGyQMHswaeCF-irG9YmdrfQKM3%3DYn31yH6BOeyXA%40mail.gmail.com.

Muharem Hrnjadovic

unread,
Apr 27, 2018, 5:23:03 AM4/27/18
to Antoine Castex, Henry Chang, beta-t...@forsetisecurity.org
Hey :) Glad it worked for you :)

On Fri, Apr 27, 2018 at 11:04 AM Castex, Antoine <antoine...@veolia.com> wrote:
Muharem

I have done what you say and this is good now,  installation Ok!

You are the best :)

Let's go for testing the output !!!! 😇



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


On Fri, Apr 27, 2018 at 10:17 AM, 'Muharem Hrnjadovic' via Forseti Security Beta Testers <beta-t...@forsetisecurity.org> wrote:
Antoine,

please replace the '{INV_SUMMARY_BUCKET}' string in 'configs/server/forseti_conf_server.yaml.in' to something static and try again.

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

Muharem Hrnjadovic

unread,
Apr 27, 2018, 5:23:54 AM4/27/18
to Antoine Castex, Henry Chang, beta-t...@forsetisecurity.org
BTW, do you mind opening an issue so we can fix this error?

Castex, Antoine

unread,
Apr 27, 2018, 5:27:14 AM4/27/18
to Muharem Hrnjadovic, Henry Chang, Forseti Security Beta Testers



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

Castex, Antoine

unread,
Apr 27, 2018, 5:40:41 AM4/27/18
to Muharem Hrnjadovic, Henry Chang, Forseti Security Beta Testers
After doing an inventory , if there is no output on the bucket how can i troubleshoot the problem ? where are the log for this operation ?

i never have set some IAM roles for this bucket to forseti, normal ?



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


On Fri, Apr 27, 2018 at 11:23 AM, Muharem Hrnjadovic <alt...@google.com> wrote:
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

Muharem Hrnjadovic

unread,
Apr 27, 2018, 5:43:48 AM4/27/18
to Antoine Castex, Henry Chang, beta-t...@forsetisecurity.org
You have to run the notifier explicitly for the inventory summary to be uploaded to GCS. Sonething like

    "forseti --endpoint [::]:50051 notifier run"

should do the trick.

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

Castex, Antoine

unread,
Apr 27, 2018, 6:53:19 AM4/27/18
to Muharem Hrnjadovic, Henry Chang, Forseti Security Beta Testers
I have this 

antoine_castex@forseti-server-vm-2703:~$ forseti --endpoint [::]:50051 notifier run
server_message: "Resource \'policy_violations\' has no violations"

server_message: "Resource \'blacklist_violations\' has no violations"

server_message: "Resource \'bigquery_acl_violations\' has no violations"

server_message: "Resource \'buckets_acl_violations\' has no violations"

server_message: "Resource \'cloudsql_acl_violations\' has no violations"

server_message: "Resource \'firewall_rule_violations\' has no violations"

server_message: "Resource \'forwarding_rule_violations\' has no violations"

server_message: "Resource \'ke_version_violations\' has no violations"

server_message: "Resource \'groups_violations\' has no violations"

server_message: "Resource \'instance_network_interface_violations\' has no violations"

server_message: "Resource \'iap_violations\' has no violations"

server_message: "Notification completed!"




Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

Muharem Hrnjadovic

unread,
Apr 27, 2018, 9:51:20 AM4/27/18
to Antoine Castex, Henry Chang, beta-t...@forsetisecurity.org
I believe you need to add the yaml stanza that turn on the inventory summary notiifcation.
Here's an example:

    inventory:
      summary:
        enabled: true
        data_format: json
        gcs_path: 'gs://fs-opendata/iv'

NOTA BENE: 'inventory ' needs to be on the same level as 'resources'


To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

Muharem Hrnjadovic

unread,
Apr 27, 2018, 9:52:41 AM4/27/18
to Antoine Castex, Henry Chang, beta-t...@forsetisecurity.org
Here's a full notifier config example: https://pastebin.com/KBJkB9yh

Castex, Antoine

unread,
Apr 27, 2018, 10:07:31 AM4/27/18
to Muharem Hrnjadovic, Henry Chang, Forseti Security Beta Testers
dataformat is json ?  not csv ?  (i prefer json if it's possible)

enabled was at false 😂   i will modify and deploy it






Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.

Castex, Antoine

unread,
Apr 27, 2018, 10:21:52 AM4/27/18
to Muharem Hrnjadovic, Henry Chang, Forseti Security Beta Testers
I have enabled and set to json

try to deploy with the documentation 


After doing this step :

5. Download the latest configuration from Cloud Storage

$ forseti-server-XXXX-vm@ubuntu> gsutil cp gs://forseti-server-XXX/configs/server/forseti_server_conf.yaml configs/server/forseti_server_conf.yaml




 I have reset the server and now in the configs/server folder of the server vm there is no .yaml  , this is normal ?   

i can launch an inventory to see if i have an output on gcs ?





Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


On Fri, Apr 27, 2018 at 3:52 PM, Muharem Hrnjadovic <alt...@google.com> wrote:
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.

Muharem Hrnjadovic

unread,
Apr 27, 2018, 10:46:48 AM4/27/18
to Castex, Antoine, Henry Chang, Forseti Security Beta Testers
I don’t think that’s normal . I suggest you take the sample in the server subdirectory and add the stanza I suggested to it. Then run the inventory, build a model and then run the notifier.

** Sent from “smart” phone - typos courtesy of auto-correct **

Henry Chang

unread,
Apr 27, 2018, 11:02:05 AM4/27/18
to Muharem Hrnjadovic, Castex, Antoine, beta-t...@forsetisecurity.org
Hi Antoine,

When the server vm is reset, it will run this specific command to create the forseti_conf_server.yamlfile locally on the server vm.


So, can you verify 2 things:

1: that the yaml file exists on the gcs bucket?

image.png


2: that the local directory exists on the server vm?
/home/ubuntu/forseti-security/configs/server

image.png




To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.
image.png
image.png

Antoine Castex

unread,
Apr 27, 2018, 11:04:30 AM4/27/18
to Henry Chang, Muharem Hrnjadovic, Forseti Security Beta Testers
My file on the bucket is still here yes

And the local folder is here with the 2 files .in and .sample

So everything is fine ?

Henry Chang

unread,
Apr 27, 2018, 11:24:06 AM4/27/18
to Castex, Antoine, Muharem Hrnjadovic, beta-t...@forsetisecurity.org
The forseti_conf_server.yaml file should existi locally on the server VM.

Can you also please verify something else?  Can you lookup the actual startup script, and show me what is the actual gsutil cp command for the forseti_conf_server.yaml file?

Specifically, this line:
# Download server configuration from GCS
gsutil cp gs://forseti-server-2025/configs/server/forseti_conf_server.yaml $USER_HOME/forseti-security/configs/server/forseti_conf_server.yaml

image.png

Castex, Antoine

unread,
Apr 28, 2018, 2:29:53 AM4/28/18
to Henry Chang, Muharem Hrnjadovic, Forseti Security Beta Testers
Hello team !

Hehe it's working !




Thanks for your help ☺



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers+unsubscribe@forsetisecurity.org.
To post to this group, send email to beta-testers@forsetisecurity.org.

Muharem Hrnjadovic

unread,
Apr 28, 2018, 3:40:33 AM4/28/18
to Castex, Antoine, Henry Chang, Forseti Security Beta Testers
Wohoo !! :-)


** Sent from “smart” phone - typos courtesy of auto-correct **

On Apr 28, 2018, at 08:29, Castex, Antoine <antoine...@veolia.com> wrote:

Hello team !

Hehe it's working !

<image.png>


Thanks for your help ☺
<image.png>



Henry Chang

unread,
Apr 30, 2018, 2:16:36 PM4/30/18
to Muharem Hrnjadovic, Castex, Antoine, beta-t...@forsetisecurity.org
Awesome, hope you enjoy it Anotine!  

And thanks to Murahem for implementing this!

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.
image.png
image.png

Antoine Castex

unread,
May 4, 2018, 5:39:30 AM5/4/18
to Muharem Hrnjadovic, Henry Chang, Forseti Security Beta Testers
Hello team

My export is now automatically sent to BigQuery with a Cloud Function that i have developped ....

And with this BigQuery i have now my dashboard :

image.png

If you want i can share with you my CloudFunction

thanks for your help !



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Google Cloud Platform Product Manager & Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia

To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain information that is proprietary, privileged and/or confidential to Veolia Environnement and/or its affiliates and is intended exclusively for the person(s) to whom it is addressed. If you are not the intended recipient, please notify the sender by return e-mail and delete all copies of this e-mail, including all attachments. Unless expressly authorized, any use, disclosure, publication, retransmission or dissemination of this e-mail and/or of its attachments is strictly prohibited. 

Ce message electronique et ses fichiers attaches sont strictement confidentiels et peuvent contenir des elements dont Veolia Environnement et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc destines a l'usage de leurs seuls destinataires. Si vous avez recu ce message par erreur, merci de le retourner a son emetteur et de le detruire ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la publication, la distribution, ou la reproduction non expressement autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.


--
Best regards!


Muharem Hrnjadovic | Strategic Cloud Engineer | alt...@google.com | +41 78 830-7092

--
You received this message because you are subscribed to the Google Groups "Forseti Security Beta Testers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beta-testers...@forsetisecurity.org.
To post to this group, send email to beta-t...@forsetisecurity.org.
image.png
image.png

Henry Chang

unread,
May 4, 2018, 10:52:50 AM5/4/18
to Castex, Antoine, Muharem Hrnjadovic, beta-t...@forsetisecurity.org
Most definitely we would love to see your cloud function!  I'm sure that other users in the community would find super useful...!

Looking forward to it...!!

Antoine Castex

unread,
May 9, 2018, 5:40:09 AM5/9/18
to Henry Chang, Muharem Hrnjadovic, Forseti Security Beta Testers
Hello

Here it is  :

exports.getData = (event) => {
  console.log("--- BEGIN ---")
  const file = event.data;
  const context = event.context;
  const parseJson = require('parse-json');
  const Storage = require('@google-cloud/storage');
  const BigQuery = require('@google-cloud/bigquery');
  const bigquery = new BigQuery({
  projectId: 'big-query-project',
});
  const dataset = bigquery.dataset('report');
  const table = dataset.table('gcp_usage');
  const bucketName = file.bucket;
  const filename = file.name;
  const storage = new Storage({
  projectId: 'gcs-project'
});
  const data = storage.bucket(bucketName).file(filename);
  console.log(data)
  console.log("--- LOAD ---")
  
  data.download( function(err, contents) {
      console.log(JSON.parse(contents));
      var array = JSON.parse(contents)
      for (a in array) {
        console.log(array[a])
        var number = array[a].count
        var resource = array[a].resource_type
        var date = new Date().toISOString().replace(/T/, ' ').replace(/\..+/, '')
        var date2 = new Date().toISOString()
console.log("date is "+date2)
        var jsn = {
  Resource_Name: resource,
            Status: 'SUCCESS',
            Quantity: number,
  Date: new Date().toISOString()}
        console.log("--- JSON Ready ---")
        console.log(jsn)
        table.insert(jsn);
      }
     
    } );
  console.log("--- END ---")
};



and this is the package


{

  "name": "function-from-gcs-to-bq",

  "version": "0.0.1",

  "dependencies": {

    "@google-cloud/bigquery": "1.2.0",

    "@google-cloud/storage": "1.2.1",

    "parse-json": "4.0.0"

  }

}





Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Google Cloud Platform Product Manager & Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia

Joe Cheuk

unread,
May 24, 2018, 6:46:33 PM5/24/18
to Castex, Antoine, Henry Chang, Muharem Hrnjadovic, Forseti Security Beta Testers
Hi Antoine,

Thank you so much for sharing the script! We will be including the script in our next release.

Pull request that contains the script:

We really appreciate you contributing back to the Forseti community!

Best regards,
Joe

Antoine Castex

unread,
May 25, 2018, 3:09:22 AM5/25/18
to Joe Cheuk, Henry Chang, Muharem Hrnjadovic, Forseti Security Beta Testers
👍



Cordialement / Best Regards

jeshie_dribbble_cloud.gif

CASTEX Antoine

Google Cloud Platform Product Manager & Cloud Developer

Technology & Operations - Digital Factory

Group Information Systems & Technology (IS&T)

VEOLIA 30 rue Madeleine Vionnet / 93300 Aubervilliers / France

Bureau : 0 - Ouest - 137F

Direct: +33 1 85 57 70 91

Mobile: +33 6 10 93 63 49

www.veolia.com


  https://www.facebook.com/pages/Veolia/106821786149402 https://www.linkedin.com/company/veolia-environnement https://twitter.com/veolia


Reply all
Reply to author
Forward
0 new messages