Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,15 +10,18 @@ All notable changes to this project will be documented in this file.
- Support objectOverrides using `.spec.objectOverrides`.
See [objectOverrides concepts page](https://docs.stackable.tech/home/nightly/concepts/overrides/#object-overrides) for details ([#665]).
- Enable the [restart-controller](https://docs.stackable.tech/home/nightly/commons-operator/restarter/), so that the Pods are automatically restarted on config changes ([#666]).
- Add support for `4.2.0` ([#668]).

### Changed

- Bump testing-tools to `0.3.0-stackable0.0.0-dev` ([#664]).
- Deprecate support for `4.1.0` ([#668]).

[#652]: https://github.com/stackabletech/hive-operator/pull/652
[#664]: https://github.com/stackabletech/hive-operator/pull/664
[#665]: https://github.com/stackabletech/hive-operator/pull/665
[#666]: https://github.com/stackabletech/hive-operator/pull/666
[#668]: https://github.com/stackabletech/hive-operator/pull/668

## [25.11.0] - 2025-11-07

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ metadata:
name: hive-postgres-s3
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:postgresql://postgresql:5432/hive
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ metadata:
name: hive-postgres-s3
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:postgresql://postgresql:5432/hive
Expand Down
14 changes: 7 additions & 7 deletions docs/modules/hive/pages/usage-guide/database-driver.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ spec:
mountPath: /stackable/externals
containers:
- name: hive-driver
image: oci.stackable.tech/sdp/tools:1.0.0-stackable24.3.0
image: oci.stackable.tech/sdp/tools:1.0.0-stackable25.11.0
env:
- name: DEST_DIR
value: "/stackable/externals"
Expand Down Expand Up @@ -114,7 +114,7 @@ spec:
claimName: pvc-hive-drivers
containers:
- name: hive-driver
image: oci.stackable.tech/sdp/tools:1.0.0-stackable24.3.0
image: oci.stackable.tech/sdp/tools:1.0.0-stackable25.11.0
env:
- name: DEST_DIR
value: "/stackable/externals"
Expand Down Expand Up @@ -147,7 +147,7 @@ metadata:
name: hive-with-drivers
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:mysql://mysql:3306/hive # <1>
Expand Down Expand Up @@ -200,15 +200,15 @@ If you have access to a registry to store custom images, another approach is to
.Copy the driver
[source]
----
FROM oci.stackable.tech/sdp/hive:4.1.0-stackable0.0.0-dev
FROM oci.stackable.tech/sdp/hive:4.2.0-stackable0.0.0-dev
RUN curl --fail -L https://repo1.maven.org/maven2/com/mysql/mysql-connector-j/8.0.31/mysql-connector-j-8.0.31.jar -o /stackable/mysql-connector-j-8.0.31.jar
----

.Build and tag the image
[source]
----
docker build -f ./Dockerfile -t oci.stackable.tech/sdp/hive:4.1.0-stackable0.0.0-dev-mysql .
docker build -f ./Dockerfile -t oci.stackable.tech/sdp/hive:4.2.0-stackable0.0.0-dev-mysql .
----

.Reference the new path to the driver without the need for using a volume mounted from a PVC
Expand All @@ -221,8 +221,8 @@ metadata:
name: hive
spec:
image:
custom: oci.stackable.tech/sdp/hive:4.1.0-stackable0.0.0-dev-mysql # <1>
productVersion: 4.1.0
custom: oci.stackable.tech/sdp/hive:4.2.0-stackable0.0.0-dev-mysql # <1>
productVersion: 4.2.0
clusterConfig:
database:
...
Expand Down
19 changes: 9 additions & 10 deletions docs/modules/hive/pages/usage-guide/derby-example.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ metadata:
name: simple-hive-derby
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/metastore_db;create=true
Expand All @@ -39,12 +39,11 @@ stringData:

WARNING: You should not use the `Derby` database in production. Derby stores data locally which does not work in high availability setups (multiple replicas) and all data is lost after Pod restarts.

To create a single node Apache Hive Metastore (v4.1.0) cluster with derby and S3 access, deploy a minio (or use any available S3 bucket):
To create a single node Apache Hive Metastore (v4.2.0) cluster with derby and S3 access, deploy a minio (or use any available S3 bucket):
[source,bash]
----
helm install minio \
minio \
--repo https://charts.bitnami.com/bitnami \
oci://registry-1.docker.io/bitnamicharts/minio \
--set image.repository=bitnamilegacy/minio \
--set clientImage.repository=bitnamilegacy/minio-client \
--set defaultInitContainers.volumePermissions.image.repository=bitnamilegacy/os-shell \
Expand All @@ -71,7 +70,7 @@ metadata:
name: simple-hive-derby
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/stackable/metastore_db;create=true
Expand Down Expand Up @@ -130,17 +129,17 @@ You might see an error message like this:
`The authentication type 10 is not supported.`
If this is the case, either use an older PostgreSQL version or change its https://www.postgresql.org/docs/current/runtime-config-connection.html#GUC-PASSWORD-ENCRYPTION[`password_encryption`] setting to `md5`.

This installs PostgreSQL in version 10 to work around the issue mentioned above:
This installs PostgreSQL in version 12 to work around the issue mentioned above:
[source,bash]
----
helm install hive bitnami/postgresql --version=12.1.5 \
--set image.repository=bitnamilegacy/postgresql \
--set volumePermissions.image.repository=bitnamilegacy/os-shell \
--set metrics.image.repository=bitnamilegacy/postgres-exporter \
--set global.security.allowInsecureImages=true \
--set postgresqlUsername=hive \
--set postgresqlPassword=hive \
--set postgresqlDatabase=hive
--set auth.username=hive \
--set auth.password=hive \
--set auth.database=hive
----

.Create Hive Metastore using a PostgreSQL database
Expand All @@ -152,7 +151,7 @@ metadata:
name: simple-hive-postgres
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:postgresql://hive-postgresql.default.svc.cluster.local:5432/hive
Expand Down
4 changes: 2 additions & 2 deletions docs/modules/hive/partials/supported-versions.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@
// This is a separate file, since it is used by both the direct Hive-Operator documentation, and the overarching
// Stackable Platform documentation.

- 4.2.0 (experimental)
- 4.1.0 (experimental)
- 4.2.0
- 4.1.0 (deprecated)
- 4.0.1 (LTS)
- 4.0.0 (deprecated)
- 3.1.3 (deprecated)
Expand Down
8 changes: 7 additions & 1 deletion examples/hive-opa-cluster.yaml
Original file line number Diff line number Diff line change
@@ -1,3 +1,9 @@
# helm install listener-operator \
# oci://oci.stackable.tech/sdp-charts/listener-operator
# helm install hive-operator \
# oci://oci.stackable.tech/sdp-charts/hive-operator
# helm install opa-operator \
# oci://oci.stackable.tech/sdp-charts/opa-operator
# helm install postgresql oci://registry-1.docker.io/bitnamicharts/postgresql \
# --version 16.5.0 \
# --namespace default \
Expand All @@ -17,7 +23,7 @@ metadata:
name: hive
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
pullPolicy: IfNotPresent
clusterConfig:
authorization:
Expand Down
24 changes: 13 additions & 11 deletions examples/simple-hive-cluster-postgres-s3.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,11 @@
# helm install secret-operator \
# oci://oci.stackable.tech/sdp-charts/secret-operator
# helm install listener-operator \
# oci://oci.stackable.tech/sdp-charts/listener-operator
# helm install hive-operator \
# oci://oci.stackable.tech/sdp-charts/hive-operator
# helm install minio \
# minio \
# --repo https://charts.bitnami.com/bitnami \
# oci://registry-1.docker.io/bitnamicharts/minio \
# --set image.repository=bitnamilegacy/minio \
# --set clientImage.repository=bitnamilegacy/minio-client \
# --set defaultInitContainers.volumePermissions.image.repository=bitnamilegacy/os-shell \
Expand All @@ -15,23 +18,22 @@
# --set volumePermissions.image.repository=bitnamilegacy/os-shell \
# --set metrics.image.repository=bitnamilegacy/postgres-exporter \
# --set global.security.allowInsecureImages=true \
# --set postgresqlUsername=hive \
# --set postgresqlPassword=hive \
# --set postgresqlDatabase=hive
# --set auth.username=hive \
# --set auth.password=hive \
# --set auth.database=hive
---
apiVersion: hive.stackable.tech/v1alpha1
kind: HiveCluster
metadata:
name: simple-hive-postgres
spec:
image:
productVersion: 4.1.0
stackableVersion: 0.0.0-dev
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/hive;create=true
connString: jdbc:postgresql://hive-postgresql.default.svc.cluster.local:5432/hive
credentialsSecret: hive-credentials
dbType: derby
dbType: postgres
s3:
inline:
host: test-minio
Expand Down Expand Up @@ -70,5 +72,5 @@ metadata:
name: hive-credentials
type: Opaque
stringData:
username: APP
password: mine
username: hive
password: hive
7 changes: 5 additions & 2 deletions examples/simple-hive-cluster.yaml
Original file line number Diff line number Diff line change
@@ -1,12 +1,15 @@
# helm install listener-operator \
# oci://oci.stackable.tech/sdp-charts/listener-operator
# helm install hive-operator \
# oci://oci.stackable.tech/sdp-charts/hive-operator
---
apiVersion: hive.stackable.tech/v1alpha1
kind: HiveCluster
metadata:
name: simple-hive-derby
spec:
image:
productVersion: 4.1.0
stackableVersion: 0.0.0-dev
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/hive;create=true
Expand Down
4 changes: 2 additions & 2 deletions rust/operator-binary/src/config/jvm.rs
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ mod tests {
name: simple-hive
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/hive;create=true
Expand Down Expand Up @@ -142,7 +142,7 @@ mod tests {
name: simple-hive
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/hive;create=true
Expand Down
2 changes: 1 addition & 1 deletion rust/operator-binary/src/crd/affinity.rs
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ mod tests {
name: simple-hive
spec:
image:
productVersion: 4.1.0
productVersion: 4.2.0
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/hive;create=true
Expand Down
2 changes: 1 addition & 1 deletion tests/test-definition.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ dimensions:
- 3.1.3
- name: hive-new
values:
- 4.1.0
- 4.2.0
- name: hdfs-latest
values:
- 3.4.1
Expand Down