Reading PSWS Data

[Joshua Lee]

Hi all,

We have recently started collecting PSWS data at K3GCC in Western Pennsylvania and are looking to compare data with other nodes in the US.  When looking at the HamSci network data through the Central Control System, many of the files are in the .H5 file format.  What would be the most efficient way to read this type of file? If I wanted to read multiple .H5 files and export them as a .CSV file, would there be an application to read and send the data? I tried HDF viewer, but it only exports and views one file at a time, rather than all of the files at once.

Thanks and 73s,

Joshua

KN6GFZ

[John Gibbons]

Joshua,

You want to be looking at the Grape1 / Grape2 data sets - they are .csv format and can provide you what I think you're looking for.

There is also a plotting routine in the works for Grape2 that will give you this visually (Grape1 does it automatically).

The database for the Grape1/Grape2 is being transferred to the same database at the University of Alabama as we speak...

John N8OBJ

--
HamSCI is an organization that was started by people who are both hams and professional scientists with the goal of bringing both communities together.
 
Please adhere to the following guidelines when using HamSCI: http://hamsci.org/hamsci-community-participation-guidelines
---
You received this message because you are subscribed to the Google Groups "hamsci-psws" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hamsci-psws...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/hamsci-psws/327d6896-cae5-4273-8b01-4e62a3214e23n%40googlegroups.com.

[Joshua Lee]

Sounds good, thank you.  What is the link to the Grape 1/2 datasets? Is it through the HamSci website?

Thank you,

Joshua

[Kristina Collins]

Try this: https://pswsnetwork.eng.ua.edu/observations/observation_list/?instrument=Grape+1+Legacy&instrument=Grape+2&station=&startDate__gte=&endDate__lte=&latitude_min=&latitude_max=&longitude_min=&longitude_max=

Now that UA has implemented an initial API, I'll be working on upgrading the hamsci_psws package to make this type of analysis easier to do through Python. That's still a ways off, though. If anyone's interested in contributing to that project, let me know. :)

73 de KD8OXT

To view this discussion visit https://groups.google.com/d/msgid/hamsci-psws/CAD6%3D%2ByCqjnv8owM%2Bg2GNb2FHD5t7EOx%3DOT5v1ZaKco0eUkXKkg%40mail.gmail.com.

[Joshua Lee]

Awesome, thank you!

[Joshua Lee]

I'm not sure if it is a problem on my end, but when I try to download the .csv files, it gives a "Server Error (500)."  Is there somewhere else I can get the data or something I can fix on my end?

Thanks,

Joshua

KN6GFZ

[Gary Mikitin, AF8A]

Joshua - I don't have any particular expertise (or admin access) to the HamSCI PSWS CCS, but I can pass along comments overheard during the Workshop last weekend:

"The security model for the entire system was upgraded when it was all moved to a new server some months back - and various security issues do pop up from time to time."   We can't blame them for being extra security conscious, given the state of the world we live in.  Bad actors abound.

Point being - you are not alone.  Another user who''s been trying to create a new account has also been receiving the '500 error'.  Your patience is appreciated.  

Also, there is a list of PSWS CCS improvements/enhancements being worked on - security/setup issues are on that list.  We heard that in last weekend's HamSCI Workshop presentation by the U of A team.

PDF Link at the bottom of this page:  https://hamsci.org/publications/personal-space-weather-network-system-and-its-development 

73 de Gary, AF8A

[Joshua Lee]

Sounds good- completely understandable.  Thanks for the response.

73s,

Joshua

KN6GFZ