Meta-Catalogue of gps logs in QGIS?

[David Sidwell]

Firstly, thanks again for your great help over this last year. I really appreciate it.

Now, I've got a stack of old GPS logs in formats like KMZ, KML, GPX and even old Garmin GDB.

I'm wondering if QGIS (or a plugin or tool) can let me create a Visual Catalogue of them all on a Map?   They are all in Australia and the vast bulk in Victoria.

Not necessarily showing me every point, route etc of each file, but (say) the lat and lon of first/middle/end points of each log...with data associated with it like date, folder and file name etc.  So I could quickly find out "When did I do that walk near Mildura?" and then manually load that log.  FYI: I can use GPSbabel to convert such things.  Thanks!

[Andy Tice]

Hi Dave.

I'm thinking a start point would be to amalgamate all files into one location? A geopackage seems like a possibility.

From there you could batch convert all to WKT format to interrogate start and end points.

Going to need quite a bit of tidying up depending on complexity/ if all formats *can* be written to a geopackage.

Sounds like a Boxing Day project. 

Hcahny

Andy

--
You received this message because you are subscribed to the Google Groups "QGIS Australia User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to australian-qgis-use...@googlegroups.com.
To view this discussion, visit https://groups.google.com/d/msgid/australian-qgis-user-group/ecc0af2c-c238-4a13-a4cf-ad74f27e38c7n%40googlegroups.com.

[Grant Boxer]

I am trying to use the graphical modeller to save a virtual image as a JPEG compressed Geotiff. I have tried COMPRESS=JPEG PHOTOMETRIC=YCBCR but get a message saying it needs to be an 8-bit file. I have attached the output for the standard compression and wondered if anyone has any clues on what to put in the creation options.

 

Cheers and happy festive season to all,

 

Grant

 

Running Translate raster layer [2/2]

Input Parameters:

{ bandList: None, copyMetadata: True, copyStyle: False, creationProfile: 'GTiff INTERLEAVE=BAND COMPRESS=LZW PREDICTOR=2 BIGTIFF=YES', dataType: None, excludeBadBands: False, excludeDerivedBadBands: False, extent: None, grid: None, noData: None, offset: None, outputTranslatedRaster: 'J:/Dropbox/Sentinel2/Temp/RGB_image.tif', raster: 'C:/Users/Grant/AppData/Local/Temp/processing_DKVQNU/2515a5c66d994cba916ca5360770fc22/OUTPUT.vrt', resampleAlg: 0, scale: None, sourceColumns: [nan,nan], sourceNoData: None, sourceRows: [nan,nan], spectralBandList: None, spectralSubset: None, unsetNoData: False, unsetSourceNoData: False, workingType: None, writeEnviHeader: False }

Translate raster [10980x10980x3](UInt16) -of GTiff -co INTERLEAVE=BAND COMPRESS=LZW PREDICTOR=2 BIGTIFF=YES J:/Dropbox/Sentinel2/Temp/RGB_image.tif

[David Sidwell]

Thank Andy,

Yes, it seems to be a bit of work. By coincidence it now IS Boxing Day in Melbourne. It's going to be 40c and the Cricket isn't starting on the TV for a few hours :-)...so I did a bit more reading.

I tried a quick `merge a folder of gpx files into a single shape file` (a quick search couldn't find the equivalent for a geopackage). It worked!   I use PowerShell on Windows, command line via Terminal:

# add my QGIS folder for my path, for this session only; ogr2ogr live here.

$addPath = "C:\Program Files\QGIS 3.34.4\bin" 

$env:Path = ($arrPath + $addPath) -join ';'

# Nominate a folder of gpx files and retrieve them, do this as I may merge into a script later

$folder = "D:\D_Backups\Pixel4A\GPS_logger"

$gpx = Get-ChildItem -Path $folder *.gpx

# Modify command from https://gis.stackexchange.com/questions/159360/how-to-bulk-import-gpx-files-to-qgis-and-merge-into-a-single-shapefile

foreach ($file in $gpx) {
   ogr2ogr gpx.shp -append $file track_points -fieldTypeToString DateTime 

}

--

A few errors, but this simple, copy-an-example,  worked.

[Andy Tice]

Hi Dave, calling the ogr translator in QGis could work there.  Probably could use automator to read in, covert then strip out start and end points to create a new master lookup file?

To view this discussion, visit https://groups.google.com/d/msgid/australian-qgis-user-group/fa7d2f07-e9fb-47e6-8159-b330900df0a7n%40googlegroups.com.

[box...@iinet.net.au]

Hi all,

 

Why is it that I can run the “gdal_translate -of gpkg” command in the OGeo 4W Shell but not in the gdal_translate algorithm within a graphical modeller script?

 

Cheers Grant

 

[Colin Mazengarb]

I have had similar issues running an interpolator in graphical modeler. Works fine as a standalone algorithm in QGIS but not in the GM. Perhaps a bug to report? Frustrating none-the-less.

--

You received this message because you are subscribed to the Google Groups "QGIS Australia User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to australian-qgis-use...@googlegroups.com.

To view this discussion, visit https://groups.google.com/d/msgid/australian-qgis-user-group/001401db58f4%24a3197260%24e94c5720%24%40iinet.net.au.

[box...@iinet.net.au]

Good afternoon all,

 

I am wondering where I can find a collection of the QGIS system icons that I can use in my training and user manuals? I can only find a github repo where I have to download them one-by-one and I am not sure they are all present.

 

Cheers Grant

Perth WA

 

[John Bryant]

Hi Grant, they should all be present in the QGIS repo, here I think: https://github.com/qgis/QGIS/tree/master/images/themes/default

You could clone the whole repo, or there maybe clone just the subfolder with sparse-checkout (https://git-scm.com/docs/git-sparse-checkout)...

Cheers

John

--

You received this message because you are subscribed to the Google Groups "QGIS Australia User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to australian-qgis-use...@googlegroups.com.

To view this discussion, visit https://groups.google.com/d/msgid/australian-qgis-user-group/008501db59d1%243a441960%24aecc4c20%24%40iinet.net.au.

[Brad Hards]

https://github.com/qgis/QGIS/archive/refs/heads/master.zip ( or the green Code button on the github page has a Download Zip button) will also get it for you.

To view this discussion, visit https://groups.google.com/d/msgid/australian-qgis-user-group/CAHY5hn9G4-7tionb5CEP96G23cFGJQsAQOcnn7Uhyc4tknAFGw%40mail.gmail.com.

[David Sidwell]

Hello everyone. A happy FYI update. I got this to work.

I've only got basic dev skills (PowerShell), but using DeepSeek AI today, I was able to get it to generate workable scripts going to achieve my aim. I'm sure the same could be done with Python (a future plugin?). I found it helps to have an understanding of the language per se,  to debug/enhance the generated code. 

A bit off topic, so I won't post the 2 scripts here, but am thinking of putting them up on Github as Gists.  They are:

• GPX script: read in the GPX file, from 'halfway thru the first track' grab a lat, long, date-time value - then  convert time to local and display everything (and can externally pipe to csv, json etc, then a file). The AI, unprompted, even showed me how to loop thru a list of .gpx files in a folder using the script (I knew that). It has all sort of error/missing_data_values handling.

• KML and KMZ script: rinse and repeat, both types in the same script;  but has some extra code as it has to hunt (regex) for a date-field which may be in the tracks name (!) in the data.

I can then import the CSV into QGIS and there's my visual catalogue of my hikes and drives.

I  could, I assume, get it to export a gpx file as the catalogue, but I can also use the CSV in PowerShell for other purposes ; viz pass in a Lat and Lon for (say) Marysville and have it (PowerShell) quickly search for my hikes/drive within N km of Marysville.  Again DeepSeek generated that one this afternoon too.

Thanks again for the hints to get me started.  Why, in late December, no-one suggested I use DeepSeek AI, is beyond me :-) 

Apologies for the double post, it seems someone asked a question about Geotiff in this thread and I thought I'd put this update in the wrong thread!

On Monday, 23 December 2024 at 4:58:30 pm UTC+11 Andy Tice wrote:

[Emma Hain]

HI All

Is this something we want to put on as a resource on QGIS Australia GitHub?

If so, we can subscribe to them I think through the snippets or you can load them directly into there.

https://github.com/qgisau/QGISAU-Resources/tree/main/snippets

Kind regards

Em

Emma Hain — Product Manager/Senior GIS Analyst
em...@north-road.com

North Road Cartography • Development • Spatial Analysis north-road.com QGIS User Conference 2025 2-3 June, Norrköping, Sweden FOSS4G 2025 17-23 November, Auckland, New Zealand

On Thu, 6 Feb 2025 at 16:13, David Sidwell <sidwel...@gmail.com> wrote:

Hello everyone. A happy FYI update. I got this to work.

I've only got basic dev skills (PowerShell), but using DeepSeek AI today, I was able to get it to generate workable scripts going to achieve my aim. I'm sure the same could be done with Python (a future plugin?). I found it helps to have an understanding of the language per se,  to debug/enhance the generated code. 

A bit off topic, so I won't post the 2 scripts here, but am thinking of putting them up on Github as Gists.  They are:

• GPX script: read in the GPX file, from 'halfway thru the first track' grab a lat, long, date-time value - then  convert time to local and display everything (and can externally pipe to csv, json etc, then a file). The AI, unprompted, even showed me how to loop thru a list of .gpx files in a folder using the script (I knew that). It has all sort of error/missing_data_values handling.

• KML and KMZ script: rinse and repeat, both types in the same script;  but has some extra code as it has to hunt (regex) for a date-field which may be in the tracks name (!) in the data.

I can then import the CSV into QGIS and there's my visual catalogue of my hikes and drives.

I  could, I assume, get it to export a gpx file as the catalogue, but I can also use the CSV in PowerShell for other purposes ; viz pass in a Lat and Lon for (say) Marysville and have it (PowerShell) quickly search for my hikes/drive within N km of Marysville.  Again DeepSeek generated that one this afternoon too.

Thanks again for the hints to get me started.  Why, in late December, no-one suggested I use DeepSeek AI, is beyond me :-) 

To view this discussion, visit https://groups.google.com/d/msgid/australian-qgis-user-group/f9448575-d657-4cc4-9c3e-f85abe2103c4n%40googlegroups.com.

[Slade Beard]

Hi Emma,

Just had a look at this. The British Geological chart is excellent. I note that the collections folder is empty, apart from a very nice folder structure - or perhaps I have made a mistake...

---

From: australian-qg...@googlegroups.com <australian-qg...@googlegroups.com> on behalf of Emma Hain <em...@north-road.com>
Sent: Friday, 7 February 2025 9:06 AM
To: australian-qg...@googlegroups.com <australian-qg...@googlegroups.com>
Subject: Re: [Aus-NZ-QGIS-group] QGIS system icons

 

To view this discussion, visit https://groups.google.com/d/msgid/australian-qgis-user-group/CACGKw0Z%2BapR-Be9uOFU7EDep%3DBWGoT5LF_JZYL8MzBvsi%3D0gEg%40mail.gmail.com.

[Emma Hain]

The snippets folder is empty and waiting...

Kind regards

Em

Emma Hain — Product Manager/Senior GIS Analyst
em...@north-road.com

North Road Cartography • Development • Spatial Analysis north-road.com QGIS User Conference 2025 2-3 June, Norrköping, Sweden FOSS4G 2025 17-23 November, Auckland, New Zealand

To view this discussion, visit https://groups.google.com/d/msgid/australian-qgis-user-group/SYYP282MB1357431FC96FDFFF3563563080F32%40SYYP282MB1357.AUSP282.PROD.OUTLOOK.COM.