Streaming large result sets to disk? - sequel-talk

The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Message from discussion Streaming large result sets to disk?
Date: Tue, 23 Oct 2012 14:50:39 -0700 (PDT)
From: Jeremy Evans <jeremyeva...@gmail.com>
To: sequel-talk@googlegroups.com
Message-Id: <1bd7e162-c6b0-4ede-a5d2-0deb3444f163@googlegroups.com>
In-Reply-To: <A497E635-7F86-45A7-B7DA-E27A718E22D2@gmail.com>
References: <3D1B3F1B-4F5A-482B-855F-A6E0A2B0D95C@gmail.com> <532c969d-0bfa-44c7-8858-3cd1114e6ba2@googlegroups.com> <2F840E3A-DCB5-4A11-ACC7-2115415EAD6B@gmail.com> <cc0eda31-3522-4cb4-a1a4-bc08bc413290@googlegroups.com>
 <A497E635-7F86-45A7-B7DA-E27A718E22D2@gmail.com>
Subject: Re: Streaming large result sets to disk?
MIME-Version: 1.0
Content-Type: multipart/mixed; 
	boundary="----=_Part_1116_19137686.1351029039447"

------=_Part_1116_19137686.1351029039447
Content-Type: multipart/alternative; 
	boundary="----=_Part_1117_27860920.1351029039447"

------=_Part_1117_27860920.1351029039447
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On Tuesday, October 23, 2012 1:19:58 PM UTC-7, Fran=C3=A7ois Beausoleil wro=
te:
>
> Le 2012-10-23 =C3=A0 12:11, Jeremy Evans a =C3=A9crit :
>
> On Monday, October 22, 2012 8:06:04 PM UTC-7, Fran=C3=A7ois Beausoleil wr=
ote:
>
>> Hmm, this is Database#copy_table, not Dataset#copy_table. I specifically=
=20
>> need a Dataset. I've gone down the system("psql -c 'COPY ( SELECT * FROM=
=20
>> ... ) TO stdout' > /path/to/outfile ...") route, so I'm good for now.
>>
>
> Sorry about that, you are right that it is Database#copy_table, but you=
=20
> can pass a dataset to it, so you don't need to shell out to psql if you=
=20
> don't want to.
>
>
> Oh, interesting! Didn't know about that, since it doesn't appear on=20
> http://sequel.rubyforge.org/rdoc/classes/Sequel/Database.html. Is there a=
=20
> way to make the docs appear for it? I see the method's definition is=20
> guarded with SEQUEL_POSTGRES_USES_PG, which may not be set when the docs=
=20
> are generated.
>

It doesn't show up there, since the method is specific to the postgres=20
adapter.  It shows up at=20
http://sequel.rubyforge.org/rdoc-adapters/classes/Sequel/Postgres/Database.=
html. =20
This is similar to all of the other adapter-specific methods.=20

AFAIK, RDoc doesn't actually use if statements to see if a method=20
definition should be documented, since it doesn't actually execute ruby=20
code (just attempts to parse it).

Thanks,
Jeremy

------=_Part_1117_27860920.1351029039447
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable

On Tuesday, October 23, 2012 1:19:58 PM UTC-7, Fran=C3=A7ois Beausoleil wro=
te:<blockquote class=3D"gmail_quote" style=3D"margin: 0;margin-left: 0.8ex;=
border-left: 1px #ccc solid;padding-left: 1ex;"><div style=3D"word-wrap:bre=
ak-word"><div><div><div>Le 2012-10-23 =C3=A0 12:11, Jeremy Evans a =C3=A9cr=
it :</div><br><blockquote type=3D"cite">On Monday, October 22, 2012 8:06:04=
 PM UTC-7, Fran=C3=A7ois Beausoleil wrote:<br><blockquote class=3D"gmail_qu=
ote" style=3D"margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left=
:0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left=
-style:solid;padding-left:1ex"><div style=3D"word-wrap:break-word"><div>Hmm=
, this is Database#copy_table, not Dataset#copy_table. I specifically need =
a Dataset. I've gone down the system("psql -c 'COPY ( SELECT * FROM ... ) T=
O stdout' &gt; /path/to/outfile ...") route, so I'm good for now.</div></di=
v></blockquote><div><br>Sorry about that, you are right that it is Database=
#copy_table, but you can pass a dataset to it, so you don't need to shell o=
ut to psql if you don't want to.<br></div></blockquote></div><div><br></div=
>Oh, interesting! Didn't know about that, since it doesn't appear on&nbsp;<=
a href=3D"http://sequel.rubyforge.org/rdoc/classes/Sequel/Database.html" ta=
rget=3D"_blank">http://sequel.rubyforge.<wbr>org/rdoc/classes/Sequel/<wbr>D=
atabase.html</a>. Is there a way to make the docs appear for it? I see the =
method's definition is guarded with&nbsp;SEQUEL_POSTGRES_USES_PG, which may=
 not be set when the docs are generated.</div></div></blockquote><div><br>I=
t doesn't show up there, since the method is specific to the postgres adapt=
er.&nbsp; It shows up at http://sequel.rubyforge.org/rdoc-adapters/classes/=
Sequel/Postgres/Database.html.&nbsp; This is similar to all of the other ad=
apter-specific methods. <br><br>AFAIK, RDoc doesn't actually use if stateme=
nts to see if a method definition should be documented, since it doesn't ac=
tually execute ruby code (just attempts to parse it).<br></div><br>Thanks,<=
br>Jeremy<br>
------=_Part_1117_27860920.1351029039447--

------=_Part_1116_19137686.1351029039447--
Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
Account Options
