RETS 1.7.2 how to get all properties of first time execution

[Adnan Bashir]

How to get all properties of first time execution

I have build a REST query like :  (ListingRid=0+) ;  But only 49 records has been getting.

[sng]

I think your rets server has limit on the number of data that you can download. Furthermore, if it is like interealty and does not support offset then it could be bit difficult.

Here is what I did:

1) Send a query to get only the sysid. There is no limit on that. Here is my query and optional params (specific to my server)

$optional_params = array('StandardNames'=>0,'Select'=>'sysid','Count'=>1,'Format'=>'COMPACT-DECODED');

$query = "(246=|A),(61=|BROWARD,DADE,OTHER,PALMBCH)";

Count 1->server sends a count of data

246->listing status field A means Active

(Use retsmd.com)

and I need to send location for all the florida counties else get error

2) Store the sysids in a table.

3) Then fetch the data for each sysid one by one.

Note: I use long running background jobs and to do this. It took 2 days to download 30000 records initially.

I understand that this could be very inefficient. I myself will be grateful if someone could post improved scheme.

[Wade Berlin]

Mid-Florida is switching to MATRIX as a provider 

I'm connecting, getting meta data, everything else okay.  But, when I go to make a query I get nothing.  I turned on Debug and looked at the CURL log, and I'm seeing a 404 error (Attached) - I'm pretty stumped, now.  RETS Connector will give me results with that query, RETSMD Connects and gives me the metadata with no problems. I'm using the phrets library from 10 days ago.

* Re-using existing connection! (#0) with host (nil)

* Connected to (nil) (54.83.12.151) port 80 (#0)

* Server auth using Digest with user 'XXX999'

> GET /contact/rets/search?SearchType=Property&Class=Listing&Query=%28Status%3D%7CACT%29%2C%28MatrixModifiedDT%3D2014-05-10T00%3A00%3A00%2B%29&QueryType=DMQL2&Count=1&Format=COMPACT-DECODED&Limit=5000&StandardNames=0 HTTP/1.1

Authorization: Digest username="RETS240", realm="MATRIX", nonce="MjAxNC0wNS0xNSAxODoyMjoyNC40OTk", uri="/contact/rets/search?SearchType=Property&Class=Listing&Query=%28Status%3D%7CACT%29%2C%28MatrixModifiedDT%3D2014-05-10T00%3A00%3A00%2B%29&QueryType=DMQL2&Count=1&Format=COMPACT-DECODED&Limit=5000&StandardNames=0", cnonce="MTk5ODE5", nc=00000008, qop="auth", response="3334e9f8ac97d2f9c57913b58988edaa", opaque="0000000000000000", algorithm="MD5"

Host: rets.mfrmls.com

Accept: */*

Accept-Encoding: gzip

Cookie: JSESSIONID=28B81C678094CDE3CCB635231BA5A4F5; AWSELB=A3B365611C9A0FBBA48FA1B6E4C8401D205DEF7D08CA59D93014200F0246F40E4926D5F77534D4AB9F55E5F29821DB926425C9570958BF7AA66CA1B444D04DCBA9CEFD987D; ASP.NET_SessionId=lspujwxkebxrhv5flkowzlv2

RETS-Version: RETS/1.7.2

User-Agent: RETS/1.7.2

Thank you for your time, 
Wade Berlin, Technical Services
BrokerIDXsites Network - www.brokeridxsites.com
1-800-557-8193 - Sup...@brokerIDXsites.com
Creative and Affordable Technology for the Real Estate Professional

[Ian Cabell]

I've been having problems with Mid-Florida as well.

As far as I know, they are aware of the problem (something on their end) and are working on a solution.

--Ian

[W Bowley]

Based on the latest emails from MFR, everything should be working fine with Matrix.  I know I can download data without an issue using .Net and libRETS (I know that doesn't help you here).  I dug around earlier and noticed that the back ends are different between RETS and Matrix, and I believe it has something to do with the authorization scheme and possibly cookies being used to persist your user information across logins and queries.  Try turning on force basic auth and see if that helps at all.

--
You received this message because you are subscribed to the Google Groups "PHRETS" group.
To unsubscribe from this group and stop receiving emails from it, send an email to phrets+un...@googlegroups.com.
To post to this group, send email to phr...@googlegroups.com.
Visit this group at http://groups.google.com/group/phrets.
For more options, visit https://groups.google.com/d/optout.

[Wade Berlin]

I tried that, Force Basic Auth prevents login, that won't work.  I wonder why I can query other MATRIX feeds with PHRETS, but not this one.  I'm on hold with MidFla now, maybe I can get some insight that way.

Thank you for your time, 
Wade Berlin, Technical Services
BrokerIDXsites Network - www.brokeridxsites.com
1-800-557-8193 - Sup...@brokerIDXsites.com
Creative and Affordable Technology for the Real Estate Professional

[Wade Berlin]

When I limit the query to a few rows, I get returns.

I'm thinking that the report from MyFla is correct.  

It was followed up with an email with the same information as was reported on the phone, with details of additional issues they are also working through.  (See Attached)

Thank you for your time, 
Wade Berlin, Technical Services
BrokerIDXsites Network - www.brokeridxsites.com
1-800-557-8193 - Sup...@brokerIDXsites.com
Creative and Affordable Technology for the Real Estate Professional

These are the current issues:

 

Photo Size Issues in Matrix and Matrix RETS:

Corelogic has been notified about this issue and they are working on it. Sizes are ok in MLX.  However Matrix and Matrix RETS have smaller sizes each

ETA on solution: still being researched.

 

404 Error when “Download all available fields”

Issue with the select all fields options and dealing with custom field selectors.

ETA on solution: Today or Monday

 

Meta Data Cache Keyfield not found

This only occurs when the media is selected for download, but you can still run the query successfully.

ETA on solution: still being researched.

 

Regards,

Roderick Dela Cerna

Data Services                                           

My Florida Regional MLS

On May 16, 2014, at 9:26 am, W Bowley wrote:

Interesting.  I'm testing right now pulling down all fields for the Listings table and have no 404 errors.

On Fri, May 16, 2014 at 9:21 AM, Wade Berlin <phoen...@gmail.com> wrote:

I just got off the phone with MidFlorida.

1. They are aware of the issue, and are working on it.

2. Expected repair by Monday evening.

3. the issue is related to pulling "all fields" if you select specific columns to be retrieved the issue does not occur.

Thank you for your time, 
Wade Berlin, Technical Services
BrokerIDXsites Network - www.brokeridxsites.com
1-800-557-8193 - Sup...@brokerIDXsites.com
Creative and Affordable Technology for the Real Estate Professional

On May 16, 2014, at 9:09 am, W Bowley wrote:

If you're getting data through RETSConnector, chances are you'll be told it's an issue on your side.  I have gone back and forth with them on download issues and found that if my results correspond with what I get through RETSConnector and there is an issue, it's on their side.  If there is a discrepancy between my code and what RETSConnector provides, they'll tell you it's on your side.  For these types of issues, they typically defer to their vendor to determine what might be the problem with 404/500 errors.

Let me know what they say.

[Wade Berlin]

I got an update while I was out of town.  The issue with the 404 is still not fixed.  But, it would appear that a post rather than a get may be a workaround (or, at least I infer that from the remark in the email we received).  Can I actually specify a post in PHRETS?

Thank you for your time, 
Wade Berlin, Technical Services
BrokerIDXsites Network - www.brokeridxsites.com
1-800-557-8193 - Sup...@brokerIDXsites.com
Creative and Affordable Technology for the Real Estate Professional

This is a known error: Error 404

CoreLogic is aware of the issue and still working on it. As soon as I have a resolution or a workaround, I will let you know. For now, can you request a ‘Post’ on the data fields instead of ‘Get’ request in your program? 
I have attached a Matrix FAQ that will help with other concerns in Matrix RETS.

Regards,
Roderick Dela Cerna
Data Services 
My Florida Regional MLS

[Troy Arnold]

On Fri, May 23, 2014 at 11:03:35PM -0400, Wade Berlin wrote:
> I got an update while I was out of town. The issue with the 404 is still
> not fixed. But, it would appear that a post rather than a get may be a
> workaround (or, at least I infer that from the remark in the email we
> received). Can I actually specify a post in PHRETS?

Used to be you had to beat on it a bit to get it to use post, but with the
current version you just need to set
use_post_method to true

So something like:
$phrets->SetParam('use_post_method',true);

I haven't actually used this, I just cloned the latest git and saw the
option in the phrets source.

-troy (not THE troy)

[Wade Berlin]

YES! Thank You, 

That, along with selecting all the available columns, did the trick.

Thank you for your time, 
Wade Berlin, Technical Services
BrokerIDXsites Network - www.brokeridxsites.com
1-800-557-8193 - Sup...@brokerIDXsites.com
Creative and Affordable Technology for the Real Estate Professional