Groups keyboard shortcuts have been updated
Dismiss
See shortcuts

Next Steps?

0 views
Skip to first unread message

Owen Ambur

unread,
May 19, 2023, 11:36:10 AM5/19/23
to Naval Sarda, Carroll Ganier, Lance Wassmuth, Jorge Sanchez, Jeff Maynard, pradee...@ictect.com, aboutthe...@googlegroups.com, ch...@chriscfox.com
Naval, all of the new files apparently have now been indexed.  Send me an invoice and I'll wire the money for adding the date column to the search results listing.

Let's think about what to do next.  Here are some of my thoughts:
  1. Add the plan/report name to the search results list, in the second column, provided that doing so doesn't make the listing too cluttered or crowded on the screen.
  2. Create the capability to periodically generate reports that can either automatically or manually be posted on the site, such as
    1. Statistics on the number of plans/reports, goals, objectives, values, organizations, stakeholders in the collection (similar to the stats that Andre Cusson used to provide).
    2. Static hypertext/browse listings of the names of the organizations and plans/reports in the collection, to enable me to stop maintaining my listing at https://stratml.us/drybridge/index.htm as well as Joe Carmel's listing by domain at https://stratml.us/docs/catalogsitemap.html (The Perl script for the latter seems to have stopped working anyway.)  I wouldn't expect an automatically generated listing to include the categorizations present in my manually created listings.  Nor do I care to replicate Joe's listing per se.  However, it would be good to enable a listing of plans/reports in the .gov domain, and if enabling such a selective listing enables selective listings of other domains as well, that would be fine.  One capability I do want to maintain is direct referencing of plans within the listing so that I can point others directly to them in the context of the list, like this.
  3. Either automatically generate or enable users to click to create PDFs of the files, perhaps by calling a conversion service provided by someone list Turn-Key Systems, e.g., by including a PDF column in the search results listings to the right of the hyperlink icon.  (Years ago, Computer Composition of Canada provided such capabilities along with RTF and HTML renditions.)
  4. Enable graphic display of numerical performance indicators.  There aren't currently very many of them in the collection and enabling such capability may be more complexity than we should take on right now.  However, it is something to keep in mind down the road.  One plan that does include some performance metrics is AMS's, which I just converted in follow up to the meeting convened by Beth Martin.  I understand she plans to bring us back together again soon.  I hope the timing allows you to join us.
  5. Speaking of Beth, we should also be thinking about how to support the Integrated Value Network initiative she is undertaking with Basil White and Ryan Wold.  The stratml:Relationship elements could be used but not many of them have been populated yet.  There will also be the need for query/discovery services revealing relationships not yet documented.  See StratML tool, app, and service requirement  Goal 8: Relationships
    Enable human beings to see and verify candidate relationships identified by automated services and to draft concise narrative descriptions of such relationships as well as to nominate such relationships not previously identified.
My assumption is that enabling users to dynamically create reports from the database whenever they wish may place too great a burden on the server.  However, if that's not true, dynamic reporting capabilities would be great.

Any and all comments and suggestions will be most welcome.  I'm copying Carroll, Lance, Jeff, Jorge, Chris, and Pradeep in the event they may wish to chime in.



On Friday, May 19, 2023 at 09:30:35 AM EDT, Naval Sarda <nsa...@epicomm.net> wrote:


Please see below



-------- Forwarded Message --------
Subject: Re: Fwd: [basex-talk] BaseX 10.6: Memory | Performance | XQuery 4
Date: Fri, 19 May 2023 18:32:36 +0530
From: Sudarshana Chavan <sudar...@epicomm.net>
To: Naval Sarda <nsa...@epicomm.net>


Owen,

File which you uploaded yesterday is indexed. Please check the screenshot attached, files got indexed. After uploading sitemap file, you need t wait for an hour to files get indexed.

If the file name which is being indexed is already present and it has same URL then we just overwrite that file. If file name in present but URL is not same in that file then file get indexed with appending some string in its name.

We have not indexed any files from our side which you are noticed. If you want to remove those files then we can remove that. 

 -Sudarshana

[deleted]

Lance Wassmuth

unread,
May 21, 2023, 10:46:59 PM5/21/23
to Owen Ambur, Naval Sarda, Carroll Ganier, Jorge Sanchez, Jeff Maynard, pradee...@ictect.com, aboutthe...@googlegroups.com, ch...@chriscfox.com

Hi Owen,

It looks like you are making great progress.

Just as reference if you were looking to use a conversion service, TopLeaf can provide outputs to PDF, RTF, HTML, epub, and Scorm from the XML.

My suggestion would be to have the PDF, RTF and HTML (shown separately, identified by icon) showing to the right or left of the document name and the user can select whichever output they want.  This will reduce stress on server and the need to have TopLeaf running as a service.

I would need to come back to you how this might work in practice as I would need to consult with Jeff first.

 

Kind Regards

Lance Wassmuth

 

Managing Director - Australia

 

l.was...@contiem.com | www.contiem.com

 

Check out Contiem's most recent mention in Forbes!

 

 

 

Office: + 61 2 9906 1577

Mobile: + 61 418 716 553

Suite 1, 20 Cliff Street

Lavender Bay, NSW 2060 AUSTRALIA

US | UK | Australia | India

Icon

Description automatically generatedIcon

Description automatically generatedA picture containing text, electronics

Description automatically generatedIcon

Description automatically generatedIcon

Description automatically generated

 

 

Owen Ambur

unread,
May 24, 2023, 9:30:47 PM5/24/23
to Naval Sarda, Carroll Ganier, Jorge Sanchez, aboutthe...@googlegroups.com, Andre Cusson, Lance Wassmuth
Naval, when we see how the new search results listing looks, with the document names included, we can get a sense of whether it might make sense to periodically generate hypertext browse listings showing those elements for the entire database.

Also, in my listing of potential projects, I forgot to mention the possibility of including a field for Organization Name on the search screen.  I mentioned it before but not in my most recent listing.  It was not a priority initially because the focus is on goals, objectives, and values rather that organizations per se.

Another possibility might be to include a search field for the domain of the sources of the content of the files.  (Although generally not the case now, ultimately, the thought is that the StratML files themselves would be the authorative sources of their content and, thus, cite their own URLs.)  Enabling domain-specific queries would serve the categorization purpose of Joe Carmel's StratML catalog, albeit dynamically rather than statically.  In particular, it would allow me to create selective listings of plans/reports in the .gov domain.

However, the ability to save and print search results listings would need to be enhanced, and if they could be saved as HTML with directly referenceable anchors and hyperlinks, that might be the way to replace both Joe's catalog and my hypertext listing.

Just some thoughts for now.  Again, I don't want to take on too much complexity at once nor do I want to over-burden the server and slow down the queries and presentation of results.  I'm content to wait to see how the new search results look with the document names included and then to decide what to do next.  However, as always, any other questions, comments, or suggestions you and your colleagues may have would be most welcome.

BTW, a full-text query for "." (a period) retrieves 5,687 files and using the browser print function doesn't look bad.  However, it apparently is limited to four pages and is not particularly well formated to replace my hypertext listing.



On Wednesday, May 24, 2023 at 10:20:21 AM EDT, Naval Sarda <nsa...@epicomm.net> wrote:


Please see below



-------- Forwarded Message --------
Subject: Re: Fwd: Fwd: Next Steps?
Date: Wed, 24 May 2023 17:43:52 +0530
From: Sudarshana Chavan <sudar...@epicomm.net>
To: Naval Sarda <nsa...@epicomm.net>


Owen,

Please see the comments below in BLUE

Sudarshana

See below

-------- Forwarded Message --------
Subject: Re: Next Steps?
Date: Tue, 23 May 2023 22:04:05 +0000 (UTC)
From: Owen Ambur <owen....@verizon.net>
Reply-To: Owen Ambur <owen....@verizon.net>
To: Naval Sarda <nsa...@epicomm.net>


Naval, with regard to the first item, I presume Sudarshana' response means that you believe the document names can be included in the second column in the search results listing without making it too cluttered or taking up too much screen space from the other columns.  If so, I am inclinded to go ahead with that project at the cost cited. Epi Comment-  Yes, we will start developing this.

Regarding item 2.1, Andre plans to get his portal up and running again within the next few months.  In the meantime, I have posted links to the Internet Achives' copies of those pages at https://stratml.us/#Cusson  See, for example, his StratML statistics page.  However, assuming that Andre can make those pages operational again, that reduces the business case for me to duplicate his capabilies -- unless it can be done at pretty low cost.  I'm inclined to wait a few months and see what he can do. 

Referencing item 2.2, Joe Carmel's StratML catalog sorts the files by Internet domain.  The listing includes the Internent domain/subdomain, publication/submission date, name of the organization, name of the document, and an edit link that opens the file in my XForm for Part 2.  I don't really want to duplicate all of that logic.  However, it would be good to be able to provide a listing of files whose source documents are in the .gov domain.

At some point I would like to stop manually maintaining my listing at  https://stratml.us/drybridge/index.htm  Again, I wouldn't expect to duplicate all of the logic of that listing, e.g., the sections referenced via hypelinks at the top of the page.  However, I do want to be able to point others directly to documents in the listing, like this.  One way of thinking about that project is as a static, persistent hypertext browse listing presentation of a query of the entire database showing the elements to be presented in the query results listing as per item 1.
Epi Comment- If you can provide us static part of the file(listing) and for dynamic part, let us know which columns/fields we will need to fetch from the collection or from the file for which the new item needs to be added in list. Then we can think of the logic and the efforts.
On Tuesday, May 23, 2023 at 11:39:26 AM EDT, Naval Sarda <nsa...@epicomm.net> wrote:


Please see below



-------- Forwarded Message --------
Subject: Re: Fwd: Next Steps?
Date: Tue, 23 May 2023 20:54:30 +0530
From: Sudarshana Chavan <sudar...@epicomm.net>
To: Naval Sarda <nsa...@epicomm.net>, Jitendra Shende <jite...@epicomm.net>, Balasaheb Pandarkar <balas...@epicomm.net>, kom...@epicomm.net


Owen,

Please check our comments in GREEN.

Sudarshana

On 5/22/2023 10:04 AM, Naval Sarda wrote:


See below

-------- Forwarded Message --------
Subject: Next Steps?
Date: Fri, 19 May 2023 15:34:29 +0000 (UTC)
From: Owen Ambur <owen....@verizon.net>
Reply-To: Owen Ambur <owen....@verizon.net>
To: Naval Sarda <nsa...@epicomm.net>
CC: Carroll Ganier <gani...@gmail.com>, Lance Wassmuth <lwas...@turnkey.com.au>, Jorge Sanchez <jo...@vionta.net>, Jeff Maynard <jmay...@turnkey.com.au>, pradee...@ictect.com <pradee...@ictect.com>, aboutthe...@googlegroups.com <aboutthe...@googlegroups.com>, ch...@chriscfox.com <ch...@chriscfox.com>


Naval, all of the new files apparently have now been indexed.  Send me an invoice and I'll wire the money for adding the date column to the search results listing.

Let's think about what to do next.  Here are some of my thoughts:
  1. Add the plan/report name to the search results list, in the second column, provided that doing so doesn't make the listing too cluttered or crowded on the screen. Epi-It will take 16 hours
  1. Create the capability to periodically generate reports that can either automatically or manually be posted on the site, such as
    1. Statistics on the number of plans/reports, goals, objectives, values, organizations, stakeholders in the collection (similar to the stats that Andre Cusson used to provide). Epi-We will need more information on this. What is exact design of Andre Cusson report so that we can analyse and give you estimates. When we tried accessing it, report did not render.
    2. Static hypertext/browse listings of the names of the organizations and plans/reports in the collection, to enable me to stop maintaining my listing at https://stratml.us/drybridge/index.htm as well as Joe Carmel's listing by domain at https://stratml.us/docs/catalogsitemap.html (The Perl script for the latter seems to have stopped working anyway.)  I wouldn't expect an automatically generated listing to include the categorizations present in my manually created listings.  Nor do I care to replicate Joe's listing per se.  However, it would be good to enable a listing of plans/reports in the .gov domain, and if enabling such a selective listing enables selective listings of other domains as well, that would be fine.  One capability I do want to maintain is direct referencing of plans within the listing so that I can point others directly to them in the context of the list, like this. Epi- We tried to understand the logic by which Joe Carmel's listing and others listing is prepared but we could not found any specific pattern for generating this listing. If you could provide us more details of this listing, which listing you want, what content we should take in listing,how to group items etc etc. So that we can understand your requirement.
  1. Either automatically generate or enable users to click to create PDFs of the files, perhaps by calling a conversion service provided by someone list Turn-Key Systems, e.g., by including a PDF column in the search results listings to the right of the hyperlink icon.  (Years ago, Computer Composition of Canada provided such capabilities along with RTF and HTML renditions.)
  1. Enable graphic display of numerical performance indicators.  There aren't currently very many of them in the collection and enabling such capability may be more complexity than we should take on right now.  However, it is something to keep in mind down the road.  One plan that does include some performance metrics is AMS's, which I just converted in follow up to the meeting convened by Beth Martin.  I understand she plans to bring us back together again soon.  I hope the timing allows you to join us.s
  1. Speaking of Beth, we should also be thinking about how to support the Integrated Value Network initiative she is undertaking with Basil White and Ryan Wold.  The stratml:Relationship elements could be used but not many of them have been populated yet.  There will also be the need for query/discovery services revealing relationships not yet documented.  See StratML tool, app, and service requirement  Goal 8: Relationships
  1. Enable human beings to see and verify candidate relationships identified by automated services and to draft concise narrative descriptions of such relationships as well as to nominate such relationships not previously identified. - Epi-This is a large effort project and will need lot more budget than the search project.
My assumption is that enabling users to dynamically create reports from the database whenever they wish may place too great a burden on the server.  However, if that's not true, dynamic reporting capabilities would be great. Epi-It will depend on the Turn-Key Systems. We have not invested their offerings so far.

Any and all comments and suggestions will be most welcome.  I'm copying Carroll, Lance, Jeff, Jorge, Chris, and Pradeep in the event they may wish to chime in.

Reply all
Reply to author
Forward
0 new messages