Download EQs from any time in the archive ON DEMAND using FDSNWS

394 views
Skip to first unread message

Branden Christensen

unread,
Jul 28, 2017, 10:59:19 AM7/28/17
to RaspberryShake
View this email in your browser
Download earthquakes from any time in the archive ON DEMAND using FDSN Web Services
More Data- At your FINGER TIPS!!

gempa has implemented FDSN dataselect web services, a powerful tool for accessing time series data in miniSEED format. 

The Raspberry Shake experience just keeps getting better! About one month ago we announced that you can now use the new CAPS data source in Swarm to visualize data from any time in the massive Raspberry Shake data archive. All of the data from every Raspberry Shake is now also available for download via FDSN dataselect web services! Allllll the way back to the first data points transmitted by the very first Raspberry Shake users in December, 2016. 

This service is available at no additional charge to all hobbyists and school teachers. 

Enjoy :)

See here for details and examples. 
Links
Get your Raspberry Shake up and running:
Quick Start Guide including some helpful YouTube videos
Complete User manual
Google Group Technical Support Forum
DIY resources including SD card image

Some more useful links:
Website
Shop 
The Original Kickstarter Campaign

Newsletter Archive

Web products
StationView
EQView
FDSNWS

Social Media: @raspishake
Instagram
Twitter
Facebook
Google+: share photos of your Shake, seismograms and pretty much anything else here


Saludos from Panama, 
 


WMXZ

unread,
Jul 29, 2017, 4:23:11 AM7/29/17
to RaspberryShake, branden.c...@osop.com.pa
Could not getting it to work with irisFetch (from Matlab)

irisFetch.Stations('STATION','AM','RDF14','00','SHZ','BASEURL','https://fdsnws.raspberryshakedata.com/fdsnws/station/1/')

throws an error
java.net.ProtocolException: Server redirected too many  times (20)

while the following works fine

irisFetch.Stations('STATION','IV','MSSA','','*','BASEURL','http://webservices.ingv.it/fdsnws/station/1/')

obviously
the equivalent call to https://fdsnws.raspberryshakedata.com/fdsnws/station/1/ did not work either (even after allowing https URLs)
here the verbose message says

Java exception occurred:
java.io.IOException: java.net.ProtocolException: Server redirected too many  times (20)

Any suggestion?







Heinz-Bernd Eggenstein

unread,
Jul 29, 2017, 7:12:18 AM7/29/17
to RaspberryShake, branden.c...@osop.com.pa
Could there be a problem with the certificate when usinh https? When pointing the bwroser to the https url, I get this:

The certificate is only valid for the following names: data.gempa.de, jabber.gempa.de

HB

Branden Christensen

unread,
Jul 29, 2017, 9:23:44 AM7/29/17
to RaspberryShake
Indeed there is!

Thanks HB! We are aware of this issue and will solve it soon!


Yours, 

Branden Christensen
Director, OSOP & Gempa GeoServices
Director, Raspberry Shake project, Social Media: @raspishake

Get your very own personal seismograph on Kickstarter


--
Some useful links:
 
Manual: http://manual.raspberryshake.org/
Do It YourSelf Page: http://raspberryshake.org/do-it-yourself
Shop: https://shop.raspberryshake.org/
Website: http://raspberryshake.org/
 
Instagram: https://www.instagram.com/raspishake/
Facebook: https://www.facebook.com/raspishake/
Twitter: https://twitter.com/raspishake/
Hashtag: #rasperryshake
---
You received this message because you are subscribed to the Google Groups "RaspberryShake" group.
To unsubscribe from this group and stop receiving emails from it, send an email to raspberryshake+unsubscribe@googlegroups.com.
To post to this group, send email to raspberryshake@googlegroups.com.
Visit this group at https://groups.google.com/group/raspberryshake.
To view this discussion on the web visit https://groups.google.com/d/msgid/raspberryshake/4dc8f37e-89f7-458c-8580-da3e5416b92e%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

TideMan

unread,
Jul 30, 2017, 5:18:21 PM7/30/17
to RaspberryShake
I've just tried this out and it's excellent!!

The instructions are for wget, but I used cURL:
curl -k "https://fdsnws.raspberryshakedata.com/fdsnws/dataselect/1/query?net=AM&sta=R00B9&loc=00&cha=SHZ&start=2017-06-20T20:00:00&end=2017-06-20T20:05:00" -o waveform.mseed
where -k does the no-check-certificate for cURL.

No problems reading the .mseed file from Matlab using GISMO:
w=waveform('waveform.mseed','seed');
v=get(w,'data');

I reckon this is a significant advance in the technology.
We can now go back and review what happened elsewhere for an event days, weeks, or months ago.

Branden Christensen

unread,
Jul 31, 2017, 9:35:37 AM7/31/17
to RaspberryShake
TideMan:


Wow! Thank you for your enthusiasm. It makes all of the hard work that went into making FDSNWS possible for the Raspberry Shake Community worth it. 

And thank you for sharing your curl command. 

Enjoy sifting through all of the old data!!!!! There is a LOT to be learned from the already massive archive and all of the many local, regional and teleseismic earthquakes registered there. 


Saludos, 



Branden Christensen
Director, OSOP & Gempa GeoServices
Director, Raspberry Shake project, Social Media: @raspishake

Get your very own personal seismograph on Kickstarter


--
Some useful links:
 
Manual: http://manual.raspberryshake.org/
Do It YourSelf Page: http://raspberryshake.org/do-it-yourself
Shop: https://shop.raspberryshake.org/
Website: http://raspberryshake.org/
 
Instagram: https://www.instagram.com/raspishake/
Facebook: https://www.facebook.com/raspishake/
Twitter: https://twitter.com/raspishake/
Hashtag: #rasperryshake
---
You received this message because you are subscribed to the Google Groups "RaspberryShake" group.
To unsubscribe from this group and stop receiving emails from it, send an email to raspberryshake+unsubscribe@googlegroups.com.
To post to this group, send email to raspberryshake@googlegroups.com.
Visit this group at https://groups.google.com/group/raspberryshake.

Branden Christensen

unread,
Aug 2, 2017, 7:43:21 AM8/2/17
to RaspberryShake
Good morning all. 

The issue with the certificate has been resolved. 


Yours,


Branden Christensen
Director, OSOP & Gempa GeoServices
Director, Raspberry Shake project, Social Media: @raspishake

Get your very own personal seismograph on Kickstarter


On Sun, Jul 30, 2017 at 4:18 PM, TideMan <mul...@gmail.com> wrote:
--

Emily Wolin

unread,
Aug 2, 2017, 11:33:29 AM8/2/17
to RaspberryShake, branden.c...@osop.com.pa
Hi Branden,
Trying to access https://fdsnws.raspberryshakedata.com now results in a 403 Forbidden error.  This still prevents ObsPy from discovering the web services there.

Emily
To unsubscribe from this group and stop receiving emails from it, send an email to raspberryshak...@googlegroups.com.
To post to this group, send email to raspber...@googlegroups.com.

Branden Christensen

unread,
Aug 2, 2017, 11:36:14 AM8/2/17
to RaspberryShake
You forgot the /fdsnws at end ;)

Branden Christensen
Director, OSOP & Gempa GeoServices
Director, Raspberry Shake project, Social Media: @raspishake

Get your very own personal seismograph on Kickstarter


To unsubscribe from this group and stop receiving emails from it, send an email to raspberryshake+unsubscribe@googlegroups.com.
To post to this group, send email to raspberryshake@googlegroups.com.

Emily Wolin

unread,
Aug 2, 2017, 12:12:25 PM8/2/17
to RaspberryShake, branden.c...@osop.com.pa
The client in ObsPy has a url builder that adds /fdsnws (and more) while it's building the query--but I think it needs to be able to see the base website.  

For example, to get GFZ data I'd initialize the client with the url http://geofon.gfz-potsdam.de/ , and then it discovers the dataselect and station services at 

WMXZ

unread,
Aug 2, 2017, 12:19:16 PM8/2/17
to RaspberryShake, branden.c...@osop.com.pa
Does not work with irisFetech.m
Which uses java-ws that seems to be very strict on certificates (or SSL) in general
 
Walter
To unsubscribe from this group and stop receiving emails from it, send an email to raspberryshak...@googlegroups.com.
To post to this group, send email to raspber...@googlegroups.com.

Emily Wolin

unread,
Aug 2, 2017, 2:09:19 PM8/2/17
to raspber...@googlegroups.com, branden.c...@osop.com.pa
Definitely appears to be something going on with SSL still--I can get data if I turn off SSL verification (eek).

Emily

You received this message because you are subscribed to a topic in the Google Groups "RaspberryShake" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/raspberryshake/DNjo9sxiI8Q/unsubscribe.
To unsubscribe from this group and all its topics, send an email to raspberryshake+unsubscribe@googlegroups.com.
To post to this group, send email to raspberryshake@googlegroups.com.

Branden Christensen

unread,
Aug 2, 2017, 2:26:10 PM8/2/17
to Emily Wolin, RaspberryShake
Hi Emily:


This seems to be an ObSpy bug. Would you mind sending a bug report to the ObSpy list? We do not see why the root page should be available- it has nothing to do with the webservices. 


Yours,


Branden Christensen
Director, OSOP & Gempa GeoServices
Director, Raspberry Shake project, Social Media: @raspishake

Get your very own personal seismograph on Kickstarter


Branden Christensen

unread,
Aug 2, 2017, 2:26:42 PM8/2/17
to RaspberryShake
Walter:


Can you send along a (verbose) terminal output?


Yours, 


Branden Christensen
Director, OSOP & Gempa GeoServices
Director, Raspberry Shake project, Social Media: @raspishake

Get your very own personal seismograph on Kickstarter


To unsubscribe from this group and stop receiving emails from it, send an email to raspberryshake+unsubscribe@googlegroups.com.
To post to this group, send email to raspberryshake@googlegroups.com.

WMXZ

unread,
Aug 2, 2017, 2:46:31 PM8/2/17
to RaspberryShake, branden.c...@osop.com.pa
command
st1=irisFetch.Stations('STATION','AM','RDF14','00','SHZ','BASEURL','https://fdsnws.raspberryshakedata.com/fdsnws/station/1/','verbose');

error trace:

java.net.ProtocolException: Server redirected too many  times (20)
 at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source)
 at java.net.HttpURLConnection.getResponseCode(Unknown Source)
 at edu.iris.dmc.service.BaseService.doVersionCheck(BaseService.java:111)
 at edu.iris.dmc.service.BaseService.validateVersion(BaseService.java:63)
 at edu.iris.dmc.service.BaseService.validateVersion(BaseService.java:58)
 at edu.iris.dmc.service.ServiceUtil.getStationService(ServiceUtil.java:91)
Struct contents reference from a non-struct array object.
Error in irisFetch/Networks/fetchTheStations (line 798)
               j_networks = service.fetch(crit, outputLevel);
Error in irisFetch.Networks (line 701)
         fetchTheStations();
Error in irisFetch.Stations (line 627)
         [stationStructure, urlParams] = irisFetch.Networks(detailLevel,varargin{:});
Error in testSeed (line 12)
st1=irisFetch.Stations('STATION','AM','RDF14','00','SHZ','BASEURL','https://fdsnws.raspberryshakedata.com/fdsnws/station/1/','verbose');

I should note that in irisfetch.m I added in    

function opts = getUserOptions(opts, argList)
-----
                           if length(param)>7 && strcmpi(param(1:7),'http://')
                              % set the bases
                              opts.newbase = param;
                           elseif length(param)>8 && strcmpi(param(1:8),'https://')        %added by WMXZ
                              % set the bases                                                                    %added by WMXZ
                              opts.newbase = param;                                                        %added by WMXZ
                           elseif length(param) > 13 && strcmpi(param(1:13),'DATASELECTURL')
                              % expecting 'DATASELECTURL:http://host/path/to/dataselect'
                              opts.dataselectURL = param(15:end)
------

It may be a problem if iris/java  not to accept https
and all other sites in the fdnsw list are using http and not https

Walter

gempa GmbH

unread,
Aug 3, 2017, 7:57:22 AM8/3/17
to raspber...@googlegroups.com, branden.c...@osop.com.pa
We added a landing page to fdsnws.raspberryshakedata.com. Can you be please test fdsnws access from ObsPy again.

gempa GmbH

unread,
Aug 3, 2017, 8:04:03 AM8/3/17
to RaspberryShake, branden.c...@osop.com.pa
The FDSN web service is now also available without SSL. Please try http://fdsnws.raspberryshakedata.com/fdsnws/

Emily Wolin

unread,
Aug 3, 2017, 11:40:41 AM8/3/17
to RaspberryShake, branden.c...@osop.com.pa
I'm happy to report that the web service without SSL at http://fdsnws.raspberryshakedata.com/fdsnws/ works for me with ObsPy.  With HTTPS I still get an error saying that no web services could be discovered.

Thank you!

Emily

WMXZ

unread,
Aug 3, 2017, 12:31:17 PM8/3/17
to RaspberryShake, branden.c...@osop.com.pa
works also from irisFetch
thanks

BTW, what means "  RestrictedStatus: 'CLOSED' " ?

Emily Wolin

unread,
Aug 3, 2017, 12:39:29 PM8/3/17
to RaspberryShake, branden.c...@osop.com.pa
For others who may be interested in getting data with ObsPy, here's a minimal working example:

from obspy.clients.fdsn import Client
from obspy import UTCDateTime
t1 = UTCDateTime('2017-08-02T18:18:07')
t2 = t1 + 500
st = client.get_waveforms('AM', 'RFAD5', '00', 'SHZ', starttime=t1, endtime=t2)
st.plot()

Emily

Juan Antonio

unread,
Aug 3, 2017, 1:48:56 PM8/3/17
to RaspberryShake, branden.c...@osop.com.pa
Thanks Emily. It works perfectly.

Regards
Juan Antonio 
Reply all
Reply to author
Forward
0 new messages