Duplicated legislators

20 views
Skip to first unread message

Javier Matías-Cabrera

unread,
Mar 22, 2012, 10:20:20 PM3/22/12
to Open State Project
In PR there are several duplicated legislators such as
http://openstates.org/browse/legislators/PRL000019/ and
http://openstates.org/browse/legislators/PRL000100/

I wonder, is this because the first was scraped using one version of
the code and the second using another? I can fix this manually by
modifying my local database, but is there a way to do this
programmatically so that they are merged in your server too?

Thx

James Turk

unread,
Mar 26, 2012, 2:20:07 PM3/26/12
to fifty-sta...@googlegroups.com
Thanks for the report. We can deduplicate them on our end for sure.

I'd be happy to go through and do this, if you have a list handy and
wouldn't mind sending it along that'd speed the process up
considerably.

2012/3/22 Javier Matías-Cabrera <javier....@gmail.com>:

> --
> You received this message because you are subscribed to the Google Groups "Open State Project" group.
> To post to this group, send email to fifty-sta...@googlegroups.com.
> To unsubscribe from this group, send email to fifty-state-pro...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/fifty-state-project?hl=en.
>

Javier Matías-Cabrera

unread,
Mar 26, 2012, 7:31:19 PM3/26/12
to fifty-sta...@googlegroups.com
These are the ones I found. Some of them seem to have the exact same string for the name, others differ in that they don't have the middle initial.

http://openstates.org/browse/legislators/PRL000017/  &   http://openstates.org/browse/legislators/PRL000099/ 

Thanks!


On Monday, March 26, 2012 2:20:07 PM UTC-4, James Turk wrote:
Thanks for the report. We can deduplicate them on our end for sure.

I'd be happy to go through and do this, if you have a list handy and
wouldn't mind sending it along that'd speed the process up
considerably.

2012/3/22 Javier Matías-Cabrera :


> In PR there are several duplicated legislators such as
> http://openstates.org/browse/legislators/PRL000019/  and
> http://openstates.org/browse/legislators/PRL000100/
>
> I wonder, is this because the first was scraped using one version of
> the code and the second using another? I can fix this manually by
> modifying my local database, but is there a way to do this
> programmatically so that they are merged in your server too?
>
> Thx
>
> --
> You received this message because you are subscribed to the Google Groups "Open State Project" group.

> To post to this group, send email to fifty-state-project@googlegroups.com.
> To unsubscribe from this group, send email to fifty-state-project+unsub...@googlegroups.com.

2012/3/22 Javier Matías-Cabrera :


> In PR there are several duplicated legislators such as
> http://openstates.org/browse/legislators/PRL000019/  and
> http://openstates.org/browse/legislators/PRL000100/
>
> I wonder, is this because the first was scraped using one version of
> the code and the second using another? I can fix this manually by
> modifying my local database, but is there a way to do this
> programmatically so that they are merged in your server too?
>
> Thx
>
> --
> You received this message because you are subscribed to the Google Groups "Open State Project" group.

> To post to this group, send email to fifty-state-project@googlegroups.com.
> To unsubscribe from this group, send email to fifty-state-project+unsub...@googlegroups.com.

James Turk

unread,
Mar 28, 2012, 10:23:57 AM3/28/12
to fifty-sta...@googlegroups.com
Thanks for this list (and the name_tools patch!) we'll get these merged today.


2012/3/26 Javier Matías-Cabrera <javier....@gmail.com>:

>> > fifty-sta...@googlegroups.com.


>> > To unsubscribe from this group, send email to

>> > fifty-state-pro...@googlegroups.com.


>> > For more options, visit this group at
>> > http://groups.google.com/group/fifty-state-project?hl=en.
>> >
>
>
> On Monday, March 26, 2012 2:20:07 PM UTC-4, James Turk wrote:
>>
>> Thanks for the report. We can deduplicate them on our end for sure.
>>
>> I'd be happy to go through and do this, if you have a list handy and
>> wouldn't mind sending it along that'd speed the process up
>> considerably.
>>
>> 2012/3/22 Javier Matías-Cabrera :
>>
>>
>> > In PR there are several duplicated legislators such as
>> > http://openstates.org/browse/legislators/PRL000019/  and
>> > http://openstates.org/browse/legislators/PRL000100/
>> >
>> > I wonder, is this because the first was scraped using one version of
>> > the code and the second using another? I can fix this manually by
>> > modifying my local database, but is there a way to do this
>> > programmatically so that they are merged in your server too?
>> >
>> > Thx
>> >
>> > --
>> > You received this message because you are subscribed to the Google
>> > Groups "Open State Project" group.
>> > To post to this group, send email to

>> > fifty-sta...@googlegroups.com.


>> > To unsubscribe from this group, send email to

>> > fifty-state-pro...@googlegroups.com.


>> > For more options, visit this group at
>> > http://groups.google.com/group/fifty-state-project?hl=en.
>> >
>

> --
> You received this message because you are subscribed to the Google Groups
> "Open State Project" group.

> To view this discussion on the web visit
> https://groups.google.com/d/msg/fifty-state-project/-/UP58PDVTLq4J.
>
> To post to this group, send email to fifty-sta...@googlegroups.com.


> To unsubscribe from this group, send email to

> fifty-state-pro...@googlegroups.com.

Javier L. Matias-Cabrera

unread,
Mar 28, 2012, 3:47:30 PM3/28/12
to fifty-sta...@googlegroups.com
You're welcome!
Javier L. Matías-Cabrera
( Forever a )Computer Engineering Student
University of Puerto Rico, Mayaguez Campus
(787) 649-1279

annerajb

unread,
Mar 30, 2012, 11:06:07 AM3/30/12
to fifty-sta...@googlegroups.com
Adding to Javier Duplicate List
Also this one is inactive
since august 2011
You're welcome!


>> > To unsubscribe from this group, send email to

>> > For more options, visit this group at
>> > http://groups.google.com/group/fifty-state-project?hl=en.
>> >
>
>
> On Monday, March 26, 2012 2:20:07 PM UTC-4, James Turk wrote:
>>
>> Thanks for the report. We can deduplicate them on our end for sure.
>>
>> I'd be happy to go through and do this, if you have a list handy and
>> wouldn't mind sending it along that'd speed the process up
>> considerably.
>>
>> 2012/3/22 Javier Matías-Cabrera :
>>
>>
>> > In PR there are several duplicated legislators such as
>> > http://openstates.org/browse/legislators/PRL000019/  and
>> > http://openstates.org/browse/legislators/PRL000100/
>> >
>> > I wonder, is this because the first was scraped using one version of
>> > the code and the second using another? I can fix this manually by
>> > modifying my local database, but is there a way to do this
>> > programmatically so that they are merged in your server too?
>> >
>> > Thx
>> >
>> > --
>> > You received this message because you are subscribed to the Google
>> > Groups "Open State Project" group.
>> > To post to this group, send email to

>> > To unsubscribe from this group, send email to

>> > For more options, visit this group at
>> > http://groups.google.com/group/fifty-state-project?hl=en.
>> >
>
> --
> You received this message because you are subscribed to the Google Groups
> "Open State Project" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/fifty-state-project/-/UP58PDVTLq4J.
>
> To post to this group, send email to fifty-state-project@googlegroups.com.

> To unsubscribe from this group, send email to

> For more options, visit this group at
> http://groups.google.com/group/fifty-state-project?hl=en.

--
You received this message because you are subscribed to the Google Groups "Open State Project" group.
To post to this group, send email to fifty-state-project@googlegroups.com.
To unsubscribe from this group, send email to fifty-state-project+unsub...@googlegroups.com.

For more options, visit this group at http://groups.google.com/group/fifty-state-project?hl=en.

Reply all
Reply to author
Forward
0 new messages