Methods for processing large data amounts from database

[Alexander Obuhovich]

In-Portal nice $this->Application->Conn->Query method, that accepts SQL and returns an array of data to used right away. This proved very useful for small sets of data.

However, when you need to process 2000 or more records, then this method will eat up a lot of memory while transforming sql result into PHP array.

Attached methods contains kDBConnection::QueryRaw and kDBConnection::GetNextRow methods, that basically does the same what mysql_query and mysql_fetch_assoc methods. Also kDBConnection::Destroy method was changed to accept incoming recordset resource, that needs to be destroyed.

Here is usage example:

$rs = $this->Conn->QueryRaw($sql);

while ( $row = $this->Conn->GetNextRow($rs) ) {

echo $row['userid'];

echo $row['fullname'];

echo $row['userstatus'];

}

$this->Conn->Destroy($rs);

Task: http://tracker.in-portal.org/view.php?id=1147

Ready for testing.

--
Best Regards,

http://www.in-portal.com
http://www.alex-time.com

[Dmitry A.]

Thanks for the patch!

Do I test it on 5.1.3 or 5.2.0 (no patch yet)?

DA

[Alexander Obuhovich]

You can apply to 5.2.0 too, there are 2 new methods and a small change for 1 method, that can be applied manually, when auto-apply won't work.