[SPARK-26601][SQL] Make broadcast-exchange thread pool configurable#23519

Closed

caneGuy wants to merge 75 commits into

apache:masterfrom

caneGuy:zhoukang/make-broadcast-exchange

Commits on Jan 11, 2019

[SPARK-26601][SQL] Make broadcast-exchange thread pool configurable
caneGuy
committed
[SPARK-26503][CORE] Get rid of spark.sql.legacy.timeParser.enabled
srowen
committed
[SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories

HeartSaVioR
authored and
Marcelo Vanzin
committed
[SPARK-26551][SQL] Fix schema pruning error when selecting one complex field and having is not null predicate on another one

viirya
authored and
dbtsai
committed
[SPARK-26586][SS] Fix race condition that causes streams to run with unexpected confs

mukulmurthy
authored and
zsxwing
committed

Commits on Jan 13, 2019

[SPARK-26503][CORE][DOC][FOLLOWUP] Get rid of spark.sql.legacy.timeParser.enabled

MaxGekk
authored and
HyukjinKwon
committed
[SPARK-23182][CORE] Allow enabling TCP keep alive on the RPC connections

peshopetrov
authored and
srowen
committed
[SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

bersprockets
authored and
hvanhovell
committed
[SPARK-26065][FOLLOW-UP][SQL] Revert hint behavior in join reordering

maryannxue
authored and
gatorsmile
committed
[SPARK-26576][SQL] Broadcast hint not applied to partitioned table

jzhuge
authored and
gatorsmile
committed

Commits on Jan 14, 2019

Commits on Jan 15, 2019

[MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only

maropu
authored and
srowen
committed
[SPARK-25935][SQL] Allow null rows for bad records from JSON/CSV parsers

MaxGekk
authored and
cloud-fan
committed
[CORE][MINOR] Fix some typos about MemoryMode

SongYadong
authored and
HyukjinKwon
committed
[SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions

aokolnychyi
and
dongjoon-hyun
committed
[SPARK-26592][SS] Throw exception when kafka delegation token tried to obtain with proxy user

gaborgsomogyi
authored and
Marcelo Vanzin
committed
[SPARK-26462][CORE] Use ConfigEntry for hardcoded configs for execution categories

pralabhkumar
authored and
srowen
committed
[SPARK-25857][CORE] Add developer documentation regarding delegation tokens.
Marcelo Vanzin
committed
[SPARK-17928][MESOS] No driver.memoryOverhead setting for mesos cluster mode

Devaraj K
authored and
srowen
committed
[SPARK-25530][SQL] data source v2 API refactor (batch write)

cloud-fan
authored and
gatorsmile
committed
[SPARK-26350][FOLLOWUP] Add actual verification on new UT introduced on SPARK-26350

HeartSaVioR
authored and
zsxwing
committed

Commits on Jan 16, 2019

[SPARK-26604][CORE] Clean up channel registration for StreamManager

viirya
authored and
cloud-fan
committed
[SPARK-26615][CORE] Fixing transport server/client resource leaks in the core unittests

attilapiros
authored and
srowen
committed
[MINOR][PYTHON] Fix SQLContext to SparkSession in Python API main page
HyukjinKwon
committed
[SPARK-25992][PYTHON] Document SparkContext cannot be shared for multiprocessing
HyukjinKwon
committed
[SPARK-26629][SS] Fixed error with multiple file stream in a query + restart on a batch that has no data for one file stream

tdas
authored and
zsxwing
committed
[SPARK-26550][SQL] New built-in datasource - noop

MaxGekk
authored and
hvanhovell
committed
[SPARK-26619][SQL] Prune the unused serializers from SerializeFromObject

viirya
authored and
dbtsai
committed
[SPARK-26625] Add oauthToken to spark.redaction.regex

Vinoo Ganesh
authored and
mccheah
committed
[SPARK-26633][REPL] Add ExecutorClassLoader.getResourceAsStream

Kris Mok
authored and
gatorsmile
committed

Commits on Jan 17, 2019

[SPARK-26600] Update spark-submit usage message

LucaCanali
authored and
srowen
committed
[SPARK-26466][CORE] Use ConfigEntry for hardcoded configs for submit categories.

HeartSaVioR
authored and
srowen
committed
[MINOR][BUILD] ensure call to translate_component has correct number of arguments

wright
authored and
srowen
committed
Refine comment
caneGuy
committed
fix code style
caneGuy
committed
Refine comment
caneGuy
committed
[SPARK-26457] Show hadoop configurations in HistoryServer environment tab

authored and
srowen
committed
Update
caneGuy
committed
[SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path

gengliangwang
authored and
cloud-fan
committed
[SPARK-26593][SQL] Use Proleptic Gregorian calendar in casting UTF8String to Date/TimestampType

MaxGekk
authored and
hvanhovell
committed
[SPARK-26621][CORE] Use ConfigEntry for hardcoded configs for shuffle categories.

10110346
authored and
srowen
committed
[SPARK-26622][SQL] Revise SQL Metrics labels

authored and
gatorsmile
committed
[SPARK-26638][PYSPARK][ML] Pyspark vector classes always return error for unary negation
srowen
committed

Commits on Jan 18, 2019

Commits on Jan 19, 2019

[SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

kiszk
authored and
dongjoon-hyun
committed
[MINOR][TEST] Correct some unit test mistakes

10110346
authored and
srowen
committed

Commits on Jan 20, 2019

[SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

mgaido91
authored and
HyukjinKwon
committed
[SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

LucaCanali
authored and
Felix Cheung
committed

Commits on Jan 21, 2019

Commits on Jan 28, 2019

Refine comment
caneGuy
committed
refine
caneGuy
committed