Running scripts

41 views
Skip to first unread message

Tre King

unread,
Apr 21, 2015, 9:25:21 AM4/21/15
to fifty-sta...@googlegroups.com
Hello,

I notice there are several scripts for what seem to be utilities located here:


I would like to understand how to invoke these scripts in order to clean up some of the data begin scraped.  Specifically:
  • match_leg_ids.py
  • clean_events.py 
  • potential_duped_legislators.py 
Can someone advise me on this please?

Thanks, 
Tre
 

James Turk

unread,
Apr 21, 2015, 10:30:03 AM4/21/15
to fifty-sta...@googlegroups.com
Hi Tre,

These scripts are one offs used by the core team for individual tasks, generally you won't need to run them as they'll be run as needed in production. 

--
You received this message because you are subscribed to the Google Groups "Open State Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fifty-state-pro...@googlegroups.com.
To post to this group, send email to fifty-sta...@googlegroups.com.
Visit this group at http://groups.google.com/group/fifty-state-project.
For more options, visit https://groups.google.com/d/optout.



--

James Turk
Labs Director | Sunlight Foundation
202-558-8723@JamesTurk

Sunlight Foundation 

Tre King

unread,
Apr 21, 2015, 10:35:21 AM4/21/15
to fifty-sta...@googlegroups.com
James,

Do you mind sharing how I can call these scripts?  I would like my environment to be accurate data and these functions would be helpful for me to use in special cases locally.

Tre

--
You received this message because you are subscribed to a topic in the Google Groups "Open State Project" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fifty-state-project/sz09_Zh1-T0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fifty-state-pro...@googlegroups.com.

To post to this group, send email to fifty-sta...@googlegroups.com.
Visit this group at http://groups.google.com/group/fifty-state-project.
For more options, visit https://groups.google.com/d/optout.

James Turk

unread,
Apr 21, 2015, 10:37:50 AM4/21/15
to fifty-sta...@googlegroups.com
Almost all of them are simple python scripts that can be invoked from the command line as python <scriptname>, but I should really caution you that lots of them were written against specific cases and aren't tested/guaranteed to work with current code.  We don't offer support or anything for those.

Tre King

unread,
Apr 21, 2015, 10:43:03 AM4/21/15
to fifty-sta...@googlegroups.com
James,

My goal here is to fix an issue with naming of legislators being varied slightly in some cases and thus local committee list does not associate the correct (sometimes none) "leg_id" value for a legislator who is a member of the committee.  The result is that I get committee members which return a name but no association is available for these legislator committee members.  Am I explaining this in well?

Respectfully,
Tre

James Turk

unread,
Apr 21, 2015, 11:49:46 AM4/21/15
to fifty-sta...@googlegroups.com
Ah, yes we have a lot of tools for that as part of billy, the best way to get those kinds of resolutions fixed in our data is to submit reports of unmatched legislators.  If you want it fixed locally we'd recommend syncing against our data using the API or data dumps.

Tre King

unread,
Apr 21, 2015, 11:51:36 AM4/21/15
to fifty-sta...@googlegroups.com
Are those tools available for me? I am familiar with the "billy-util" commands now, but I don't think that is what you mean.

James Turk

unread,
Apr 21, 2015, 11:53:37 AM4/21/15
to fifty-sta...@googlegroups.com
Following up off-list.
Reply all
Reply to author
Forward
0 new messages