Metacat 2.10.0 Released

[Jing]

We are pleased to announce a new release of Metacat (2.10.0), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

New features in this release:

* Modernized support for sitemap.xml for guiding search engines to all dataset landing pages

* Support a new Dublin Core metadata variant: format id - http://www.openarchives.org/OAI/2.0/oai_dc/

Bugs fixed in this release:

* Exclude EcoGrid on Metacat

* Do not allow restrictive access control change to content with a DOI 

* MN/CN.updateSystemMetadata doesn't check the field - authoritativeMemberNode

* Integrate the fixed SeriesIdResolver class which gets SystemMetadata locally

* EZID metadata registration doesn't seem to work with SIDs

* Metacat white space pid filter overlooks some cases

* Update DOI registrations for EML objects with complete metadata

* Keep archived object solr index but they don't show up at the default search

* D1NodeService read api methods / getPidForSid bypassing Hz lookup

* Enable a blacklist configuration for IP addresses and subjects

* Replace the statement of "System.out.print" by the Log statement on D1URLFilter and D1HttpRequest classes

* Publish DOI includes old metadata PID in new resource map

* EML Attribute XSLT re-using anchors in such as way that they're not unique / changing attribute tabs doesn't for some entities

* Switch ORCID icons in EML XSLTs to be inlined instead of reference to MetacatUI

We hope that this software is useful to you. We welcome feedback and comments that will make the application more useful in the future. Please submit bugs and problems through our bug tracking system (https://github.com/NCEAS/metacat/issues) and send general feedback to 'metac...@ecoinformatics.org'. 


The Metacat Development Team

[Jing]

We are pleased to announce a new release of Metacat (2.10.1), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

Improvement and bugs fixed in this release:

* Optimization of users' authorization

* Optimization of the view service

* Disablement of the indexing of the log event counts

* Member node subject accessing all Solr records

* New Solr index field - replicationStatus

* Attribute list without a scrollbar on the Metadata Edtior

* Failure of updating the series ID on a private package

* Failure of creating the resource map when Metacat publishes a private package

[Jing]

We are pleased to announce a new release of Metacat (2.10.3), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

New features and bugs fixed in this release:

* Update DOI registrations for EML objects with complete metadata

* Can't update DOI metadata on the Metacat admin page if the doi is an SID
* Make Solr field "replicationAllowed" to be searchable
* Add an Metacat admin method to clear cached the style sheets
* Add a DataONE method to display the size of the index queue
* Not to check if the new index pathes were added during the Metacat startup

[Jing]

We are pleased to announce a new release of Metacat (2.10.4), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

Bugs fixed in this release:
* Publishing dataset with provenance loses all provenance relationships
* Publish call fails after adding provenance information

[Rafael Alvarez Berrios]

Hi:

I have not been following this project, and I want to unsubscribe from the list. How can I unsubscribe from the The Metacat Development Team list?

--
You received this message because you are subscribed to the Google Groups "eco...@ecoinformatics.org" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ecoinfo+u...@ecoinformatics.org.
To view this discussion on the web visit https://groups.google.com/a/ecoinformatics.org/d/msgid/ecoinfo/36e4f12f-7040-9609-b66d-372b7d740c91%40nceas.ucsb.edu.

--

Raf

[Jing]

We are pleased to announce a new release of Metacat (2.12.1), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

This release fixed a security bug. Please upgrade your Metacat instance immediately.

New fetures and bugs fixed in the previous 2.12.0, 2.11.1 and 2.11.0 releases:

* Support the new metadata standard - EML 2.2.0
* Support a new format id - portal, which will be used on the MetacatUI portal service
* Change how Metacat generates sitemaps. Sitemaps will now be generated automatically when Metacat starts, if enabled
* Add a mechanism that operators can pass paramters to the stylesheets of the view service
* Upgrade the version of the Xerces library to fix the issue of statck overflow when users upload XML objects having long text fields
* Metacat can't index the award tile element in an EML 2.2.0 object

[Jing]

We are pleased to announce a new release of Metacat (2.12.2), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

Bugs fixed in the releases:

* Modify the schema files of the format ids of portal and collections

[Jing]

We are pleased to announce a new release of Metacat (2.12.3), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

New features and bugs fixed in this release:

• Return an invalid response to the call of cn.getLogRecords if some log records have a null ip address
• Add the indication of completing the database upgrade process during configuration

[Jing]

We are pleased to announce a new release of Metacat (2.13.0), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

New features in this release:
* Upgrade Solr to version 8 and use the external Solr server
* Use the streaming HTTP multipart handler to improve performance
Notice
* Metacat Servlet APIs will be deprecated in the near future and its client software, Morpho, will not work with future versions of Metacat.
* Solr dynamic fields such as read_count_i will be deprecated.Note:

Notes for this release:

1. This Metacat release will use an external Solr server and operators should install the Solr server before upgrading Metacat instances. The Solr server installation instructions can be found here and please follow it very carefully:

https://knb.ecoinformatics.org/knb/docs/install.html#solr-server

2. Since the new external Solr server is empty, you need to re-index all objects of your Metacat server after complete the upgrade:

https://knb.ecoinformatics.org/knb/docs/query-index.html#regenerating-the-index

[Jing]

We are pleased to announce a new release of Metacat (2.14.0), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 


New features and bugs fixed in this release:

* Support the quota service for portals
* Upgrade the namespace of the datacite schema to 4.3
* Upgrade the version of log4j from 1.2 to 2.14
* Upgrade some library jar files to fix security threats

[Jing]

We are pleased to announce a new release of Metacat (2.14.1), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 


New features and bugs fixed in this release:

* Support new XML schemas for collections-1.1.0 and portals-1.1.0
* Metacat is creating too many Timer objects which leads to out of memory issues and excessive numbers of threads under high request loads
* Users with only write permission can change the access policy on update() requests, when this operation is reserved only for users with changePermission permission
* Close OutputStream objects after fulfilling DataONE API requests
* Fix how exclude filters are translated in the collectionQuery
* Update Apache setup docs to match current practices
* Update documentation build to Python3
* Fix an issue where a client editor sees a "Nothing was found" error despite having all permissions
* Project abstract displays oddly
* View service rendering EML project abstract incorrectly
* Add Methods section heading to metadata view

[Jing]

We are pleased to announce a new release of Metacat (2.15.0), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 


New features and bugs fixed in this release:

• Support non-XML metadata objects in Metacat
• Upgrade Solr to 8.8.2
• Enforce the node replication policy in the MN.replicate method
• Fix the bug of incorrect geohash
• Fix the bug of incorrect collectionQuery
• Change the default order to dateModified for the listObject method
• Remove extra logged event in the MN.update method

• Upgrade some library jar files to fix security threats

[Jing]

We are pleased to announce a new release of Metacat (2.15.1), a turnkey data repository software platform used across the earth science community.  Metacat (https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 


New features and bugs fixed in this release:

• Metacat hangs with excessive thread counts
• Support multiple DOI shoulders
• Update EML Semantic Annotation indexing to include and expand property URIs
• MNodeService.getPackage() takes too long for large packages
• Geohashes, text fields not being indexed for schema.org documents
• Expand elements covered by EML's attribute index fields beyond just dataTable
• EML to HTML/PDF is broken in the getPackage() method
• Have MNCore.getCapabilities() report on auth.allowSubmitters parameter setting
• GetPackage API doesn't work from R on Windows

[Jing Tao]

We are pleased to announce a new release of Metacat (2.16.0), a turnkey data repository software platform used across the earth science community.  Metacat(https://github.com/NCEAS/metacat) provides a standardized but customizable platform for preserving data and metadata in many formats. It helps scientists find, understand and effectively use data sets they manage or that have been created by others. Hundreds of thousands of data sets are currently documented in a standardized way and stored in Metacat systems, providing the scientific community with a broad range of science data that can be easily searched, compared, merged, or used in other ways because the data are well and consistently described. Metacat is compliant with the DataONE federation, making it easy for organizations to participate in the global DataONE data federation, and integrates with ORCiD and DOI identifier systems.  It also supports the customizable MetacatUI client-side application for searching and browsing data in the Metacat and DataONE systems, creating a simple-to-deploy system with advanced search and discovery features out of the box.

The open source Metacat system is maintained by NCEAS (https://nceas.ucsb.edu) and DataONE (https://dataone.org), and is used by data repositories worldwide to manage collections of data. We're an open community working towards sharing development of this common data platform to improve efficiency and sustainability across the open data world.  We welcome contributions of all sorts, from feedback on features and bugs, to documentation, code, and everything in between.  Please join us.

The new release of Metacat can be downloaded from: 
  https://knb.ecoinformatics.org/knb/docs/ 
 

New features and bugs fixed in this release:

• Upgrade some library jar files to fix critical security vulnerabilities
• Refactor the DOI service to use the plug-in architecture
• CN subjects cannot query private objects
• Users with the write permission cannot update system metadata
• Metacat should return a not-found error rather than the internal error when there is a typo in the old Metacat API url

We hope that this software is useful to you. We welcome feedback and comments that will make the application more useful in the future. Please submit bugs and problems through our bug tracking system (https://github.com/NCEAS/metacat/issues) and send general feedback to 'metacat-d...@ecoinformatics.org'. 
 

The Metacat Development Team