Greenplum 7 beta.4 released!!!

59 views

Skip to first unread message

Ashwin Agrawal

unread,

Jun 20, 2023, 3:31:48 AM6/20/23

to Greenplum Developers, Greenplum Users

The Greenplum Team announces that the Beta.4 release of Greenplum
Database 7 is now available for [download]
(https://github.com/greenplum-db/gpdb/releases/tag/7.0.0-beta.4).

We are getting closer to GA ready state. Please continue to play with
it and provide your feedback to further improve GPDB7.

Team continues to do amazing work to take GPDB7 forward with features
and fixes. Around 260 commits were made on top of 7.0.0-beta.3 for
7.0.0-beta.4.

Greenplum 7 Beta.4 Highlights:

- A Client and Loader Tools Package is now provided for installation
on RHEL 9.

- Because Python 2 is no longer supported, the PL/Python 2.7 extension
and documentation have been removed in favor of PL/Python 3.9.

- In the gp_configuration_history table the desc column has been
renamed to description.

- Greenplum Database introduces substantial changes to resource
group-based resource management, including the following:
The possible settings for the gp_resource_manager server configuration parameter have changed. They now include the following:
none - Configures Greenplum Database to not use any resource
manager. This is the default.
group - Configures Greenplum Database to use resource groups and
base resource group behavior on the cgroup v1 version of Linux
cgroup functionality.
group-v2 - Configures Greenplum Database to use resource groups
and base resource group behavior on the cgroup v2 version of
Linux cgroup functionality.
queue - Configures Greenplum Database to use resource queues.
Greenplum Database now includes a new server configuration parameter
-- gp_resgroup_memory_query_fixed_mem -- which allows you to
override at a session level the fixed amount of memory reserved for
all queries in a resource group.
The gp_resgroup_status_per_segment system view has been removed from Greenplum Database.
The cpu_usage and memory_usage fields have been moved from the gp_resgroup_status system view to the gp_resgroup_status_per_host system view.
You may configure three new resource group attributes using the CREATE RESOURCE GROUP and ALTER RESOURCE GROUP SQL commands:
CPU_MAX_PERCENT, which configures the maximum amount of CPU
resources the resource group can use.
CPU_WEIGHT, which configures the scheduling priority of the
resource group.
MIN_COST, which configures the minimum amount a query's query
plan cost for the query to remain in the resource group.
The following resource group attributes have been removed:
CPU_RATE_LIMIT
MEMORY_AUDITOR
MEMORY_SPILL_RATIO
MEMORY_SHARED_QUOTA
The following server configuration parameters have been removed from Greenplum Database:
gp_hashagg_default_nbatches
gp_hashagg_groups_per_bucket
gp_resource_group_enable_recalculate_query_mem
gp_resource_group_memory_limit
gp_resource_group_cpu_ceiling_enforcement

- Greenplum Database now includes the new gp_*_summary system views
listed below. Each of these views aggregates across the Greenplum
cluster the metrics reported by its corresponding gp_ view. For
example, gp_stat_archiver_summary aggregates the metrics reported by
gp_stat_archiver.

- The Greenplum Query Optimizer does not support planning or executing
queries on multi-level partitioned tables.

- The pattern matching behaviour of the substring() function is
changed. In cases where the pattern can be matched in more than one
way, the initial sub-pattern is now treated as matching the least
possible amount of text rather than the greatest. For example, a
pattern such as %#"aa*#"% now selects the first group of a's from
the input, not the last group.

- VMware Greenplum Streaming Server (GPSS) version 1.10.1 is bundled,
which includes support for VMware Greenplum 7 Beta 4+, as well as
changes and bug fixes. Refer to the Greenplum Streaming Server
Documentation for more information about this release and for
upgrade instructions.

- Add views that report the progress of ANALYZE, CLUSTER, COPY, CREATE
INDEX, REINDEX, and VACUUM operations during command execution;
refer to Monitoring Long-Running Operations for more information.

- Adds support for covering indexes. A covering index allows you to
add additional columns to an index using the INCLUDE clause, and is
useful for performing index-only scans, especially on data types
that are not indexable by B-tree indexes.

- The Greenplum Query Optimizer partially supports index-only scans
and covering indexes. Refer to the GPORCA Limitations Unsupported
SQL Query Features topic for a list of unsupported features in this
area.

- Just-in-Time (JIT) compilation uses the new server configuration
parameters optimizer_jit_above_cost, optimizer_jit_inline_above_cost
and optimizer_jit_optimize_above_cost to enable triggering of JIT
compilation based on the cost model calculated by GPORCA.

- When the encoding of a table column changes (ALTER TABLE ... ALTER
COLUMN ... SET ENCODING), Greenplum Database rewrites only the
column data, it no longer rewrites the table.

- Greenplum Database no longer rewrites the table when a column is
added (ALTER TABLE ... ADD COLUMN ...) to an append-optimized table.

- The Greenplum Database gpfdist parallel file distribution utility
now supports multi-threaded data compression and transmission.

- Revised support for AO/ENCODING in CREATE TABLE .. LIKE INCLUDING

- Add guc plpython3.python_path, fix plpython3 build

- Support DPE for duplicate sensitive random motions in Orca

- Enable `wal_compression` by default

- Bump minimum requirement of zstd to 1.4.0

- ao/co: Implement partial scans

- Make gp_toolkit an extension

- Support executing foreign tables from segments in Orca

- gp_replica_check: Support all reltypes

- Disallow "LIKE <AO/AOCO> INCLUDING STORAGE" if table AM is already set

- Change key `log` to UNRESERVED_KEYWORD

- Do not create pg_type entries for AO AUX relations

- Don't create pg_type entries for sequences or toast tables.

- Create composite array types for initdb-created relations.

- Run analyze of databases during ICW

- gprecoverseg differential recovery

- Reimplement BRIN internals for AO/CO tables

- Re-support Dynamic Partition Elimination with semi joins in Orca

- Analyze related improvements - making it fast for AO/CO tables and
also send rows in binary mode

Beta Information
=============

Greenplum Beta releases are pre-release testing versions before a new
release is generally available. We release these to the public for
testing before our final release. Greenplum Betas are not meant for
use in production systems. Beta releases are especially helpful for
developers of platforms, drivers, tools, and utilities that depend
upon Greenplum Database in order to prepare for changes in the new
version.

We strongly advise against using Beta versions of Greenplum Database
in production installations or active development projects. While the
Greenplum Database code is continuously subject to several automated
and manual tests, Beta releases might have serious bugs. Features are
subject to changes that are backward incompatible at any time during
the development of the Betas and could possibly be removed altogether.

Testing for Bugs & Compatibility
=========================

The stability of each Greenplum Database release greatly depends on
you, the community, to test the upcoming version with your workloads
and testing tools in order to find bugs and regressions before general
availability. As this is a Beta, changes to database behaviors,
feature details, and APIs are possible. Your feedback and testing will
help determine the final adjustments to the new features, so please
test. The quality of user testing helps determine when we can make a
final release.

You can report bugs using [github
issues](https://github.com/greenplum-db/gpdb/issues).

Links
======

- [7.0.0-beta.4 Release](https://github.com/greenplum-db/gpdb/releases/tag/7.0.0-beta.4)
- [Greenplum Version 7 Youtube Playlist](https://www.youtube.com/playlist?list=PL4duir3J-8GX9EmTGRXoBE9vTKFWHsXLC)
- [Progress Reporting Views In Greenplum 7](https://greenplum.org/progress-reporting-views-in-greenplum-7)