Cherry pick commits for releasing v2.0.0 - #2156

Merged

google-oss-prow[bot] merged 30 commits into

kubeflow:release-2.0from

ChenYi015:release-2.0

Sep 23, 2024

Commits on Sep 9, 2024

Support gang scheduling with Yunikorn (#2107)

jacobsalway
authored and
ChenYi015
committed
44e5530
Update Makefile for building sparkctl (#2119)
ChenYi015
committed
5dcdb7c
fix: Add default values for namespaces to match usage descriptions (#2128)

authored and
ChenYi015
committed
466d070
Fix: Spark role binding did not render properly when setting spark service account name (#2135)
ChenYi015
committed
344a84f
Reintroduce option webhook.enable (#2142)
ChenYi015
committed
a8b0bf3
Add default batch scheduler argument (#2143)

jacobsalway
authored and
ChenYi015
committed
0df79cd
fix: unable to set controller/webhook replicas to zero (#2147)
ChenYi015
committed
99db16a
Adding support for setting spark job namespaces to all namespaces (#2123)
ChenYi015
committed
f625347
Support extended kube-scheduler as batch scheduler (#2136)
ChenYi015
committed
1800255
Run e2e tests on Kind (#2148)

jacobsalway
authored and
ChenYi015
committed
7c4902b
Set schedulerName to Yunikorn (#2153)

jacobsalway
authored and
ChenYi015
committed
c79093e
Create role and rolebinding for controller/webhook in every spark job namespace if not watching all namespaces (#2129)
ChenYi015
committed
c2b0fd0
Fix: e2e test failes due to webhook not ready (#2149)
ChenYi015
committed
51f611d
Upgrade to Go 1.23.1 (#2155)

jacobsalway
authored and
ChenYi015
committed
4c277a3
Upgrade to Spark 3.5.2 (#2154)

jacobsalway
authored and
ChenYi015
committed
8b3b279

Commits on Sep 10, 2024

Bump sigs.k8s.io/scheduler-plugins from 0.29.7 to 0.29.8 (#2159)

dependabot[bot]
authored and
ChenYi015
committed
93bdccb
feat: support driver and executor pod use different priority (#2146)

authored and
ChenYi015
committed
7ce0ae4
Bump gocloud.dev from 0.37.0 to 0.39.0 (#2160)

dependabot[bot]
authored and
ChenYi015
committed
059be26

Commits on Sep 19, 2024

Update e2e tests (#2161)
ChenYi015
committed
6e68bea
fix: webhook not working when settings spark job namespaces to empty (#2163)
ChenYi015
committed
b310c58
fix: The logger had an odd number of arguments, making it panic (#2166)

tcassaert
authored and
ChenYi015
committed
bac4dd2
Upgrade to Spark 3.5.2(#2012) (#2157)

ha2hi
authored and
ChenYi015
committed
ffd2ed8
Feature: Add pprof endpoint (#2164)

ImpSy
authored and
ChenYi015
committed
4a10b27
fix the make kind-delete-custer to avoid accidental kubeconfig deletion (#2172)

ImpSy
authored and
ChenYi015
committed
9327d77
Bump github.com/aws/aws-sdk-go-v2/config from 1.27.27 to 1.27.33 (#2174)

dependabot[bot]
authored and
ChenYi015
committed
6bc13ee
Bump helm.sh/helm/v3 from 3.15.3 to 3.16.1 (#2173)

dependabot[bot]
authored and
ChenYi015
committed
b2d6e4f
Add specific error in log line when failed to create web UI service (#2170)

tcassaert
and
ChenYi015
committed
c70541d
Account for spark.executor.pyspark.memory in Yunikorn gang scheduling (#2178)

jacobsalway
authored and
ChenYi015
committed
8921518
Fix: spark application does not respect time to live seconds (#2165)
ChenYi015
committed
c37fa88
Update release workflow and docs (#2121)
ChenYi015
committed
bb56d03