Geting a file list from a HTTP server.
Np. v/d Spek
I like to get a list of files from a Http server.
Is this posible? So yes, How can i do this.
Thanks
Niels
Hadi Hariri - Team Indy
@bornews.borland.com>:
>Hello,
>I like to get a list of files from a Http server.
>Is this posible? So yes, How can i do this.
>
If the server has directory listings activated then retriving a folder w/o
a default webpage will give you a list of the directories.
--
Hadi Hariri
http://delphi.urusoft.com
Np. v/d Spek
Only the server has a default webpage. Is there a other way to get the list?
I know that Frontpage can import a webspace.
So there must by a other way. but how?
Thanks,
Niels
"Hadi Hariri - Team Indy" <ha...@delphihome.com> schreef in bericht
news:8FE467139...@207.105.83.62...
Christian
"Np. v/d Spek" <ne...@lumensoft.nl> wrote in message
news:8u4o0f$2c...@bornews.borland.com...
> Hello,
> I like to get a list of files from a Http server.
> Is this posible? So yes, How can i do this.
>
> Thanks
> Niels
>
>
Hadi Hariri - Team Indy
>Thanks,
>Only the server has a default webpage. Is there a other way to get the
>list? I know that Frontpage can import a webspace.
>So there must by a other way. but how?
>
You can use FTP. I don't know of any HTTP command that allows this. I think
the way FP works is contacting the FrontPage Extensions on the server. Does
FP still work if FPExtensions aren't installed on the server?
Np. v/d Spek
extentions are
running. So there must by a other way to get the files.I have loking to the
Robot technolgie, but can't find any source example.
M.Schröder
just written such a program. A good starting-point for that is Tspider, a
freeware component written by Gordon Hamm. It has some errors (links like
../../test/test.html may lead into endless loops) and it uses Hyperstr,
which i dont like.
just look for the links - <a href=....> ignore fragments (...#mark) and
typical unique ID's ....?rnd=123 or ?id=123 when necassary.
I can mail some code-fragments which do quiet well for - just ask.
But when you want a good solution - use (and buy ;-) ) programs like
Webspider...
Matthias Schroeder (EDV)
Soft-Impulse
--------------------------------------------------------------
ne...@soft-impulse.de
Tel: +49 - 234 - 941 33 00
Fahrenheitsstrasse 40 * D-44879 Bochum * Germany
"Np. v/d Spek" <ne...@lumensoft.nl> schrieb im Newsbeitrag
news:8u6jcd$ir...@bornews.borland.com...
Arthuro
> Yes, I Know for sure that on my Webserver (Located by my ISP) no FP
> extentions are
> running. So there must by a other way to get the files.I have loking to
the
> Robot technolgie, but can't find any source example.
Frontpage uses FTP to do this, there is nothing in the HTTP protocol that
provides this.
Regards,
Arthuro.
Joachim Breuer
> Frontpage uses FTP to do this, there is nothing in the HTTP protocol that
> provides this.
>
> Regards,
> Arthuro.
It seems that the WinInet-function "InternetFindNextFile" provides a way
even under HTTP. But I was not able to put the pseudo-code provided by MS
into Delphi.
http://support.microsoft.com/support/kb/articles/Q166/9/61.ASP?LN=EN-US&SD=g
n&FR=0
http://msdn.microsoft.com/workshop/networking/wininet/reference/functions/In
ternetFindNextFile.asp
Regards,
Joachim
Arthuro
news:3a09bbe5_1@dnews...
>
> > Frontpage uses FTP to do this, there is nothing in the HTTP protocol
that
> > provides this.
>
> even under HTTP. But I was not able to put the pseudo-code provided by MS
> into Delphi.
>
>
http://support.microsoft.com/support/kb/articles/Q166/9/61.ASP?LN=EN-US&SD=g
> n&FR=0
>
http://msdn.microsoft.com/workshop/networking/wininet/reference/functions/In
> ternetFindNextFile.asp
>
As i read the first article, i see that there is an HTTP GET sent which
contains a FTP request as it's parameter. So what really happens is you're
doing FTP over HTTP, the server on the other side looks at the parameter in
GET, interprets it, sets up a FTP session, sends the result back over HTTP.
In essence you're piggybacking FTP data on a HTTP packet.
WinInet is a Windows API and has nothing to do with HTTP, but it might be
altogether possible that a webserver uses this Windows API to access files
but that doesn't make the API HTTP protocol, it's just a possible means of
implementation.
Regards,
Arthuro..
Joachim Breuer
> contains a FTP request as it's parameter. So what really happens is you're
> doing FTP over HTTP, the server on the other side looks at the parameter
in
> GET, interprets it, sets up a FTP session, sends the result back over
HTTP.
> In essence you're piggybacking FTP data on a HTTP packet.
> WinInet is a Windows API and has nothing to do with HTTP, but it might be
> altogether possible that a webserver uses this Windows API to access files
> but that doesn't make the API HTTP protocol, it's just a possible means of
> implementation.
>
> Regards,
> Arthuro..
>
I am new to WinInet, FTP, HTTP and all those things, so I mixed up some of
them. I only want to get the file date of a file before the actual download
starts and I don`t want to use FTP. I looked for components or API-functions
but the only one I found was InternetFindNextFile mentioned in the article
from MS. I still don't know how to use this function and it seems no one can
help me. But after I had read your news, I did read the MS-article again and
found a solution to my problem which also concerns the topic "Geting a file
list from a HTTP server.".
http://support.microsoft.com/support/kb/articles/Q166/9/61.ASP?LN=EN-US&SD=g
n&FR=0
> If the FTP URL passed in InternetOpenUrl is a URL to a directory on the
FTP server, InternetReadFile retrieves a directory listing of the FTP URL as
a HTML document.
So when I use InternetOpenUrl and InternetReadFile I get the file list from
the specified HTML-directory.
Thank you.
Joachim
Arthuro
[Snip]
> I am new to WinInet, FTP, HTTP and all those things, so I mixed up some of
> them. I only want to get the file date of a file before the actual
download
> starts and I don`t want to use FTP. I looked for components or
API-functions
> but the only one I found was InternetFindNextFile mentioned in the article
> from MS. I still don't know how to use this function and it seems no one
can
> help me. But after I had read your news, I did read the MS-article again
and
> found a solution to my problem which also concerns the topic "Geting a
file
> list from a HTTP server.".
>
>
http://support.microsoft.com/support/kb/articles/Q166/9/61.ASP?LN=EN-US&SD=g
> n&FR=0
> > If the FTP URL passed in InternetOpenUrl is a URL to a directory on the
> FTP server, InternetReadFile retrieves a directory listing of the FTP URL
as
> a HTML document.
>
> So when I use InternetOpenUrl and InternetReadFile I get the file list
from
> the specified HTML-directory.
This does what you want, but not the way you want it. You state that you
don't want to use FTP.
But the article says the following:
'When the connection between the client and the FTP server is direct or via
a TIS FTP proxy, InternetOpenUrl and InternetReadFile are actually
generating FTP traffic rather than HTTP traffic.'
Hope this sheds some light on the case.
Regards,
Arthuro.