[SPARK-31655][BUILD][3.0] Upgrade snappy-java to 1.1.7.5#28508

Closed

AngersZhuuuu wants to merge 699 commits into

apache:branch-3.0from

AngersZhuuuu:SPARK-31655]-2.4]-BUILD]-Upgrade-snappy-java-to-1.1.7.5

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 18, 2019

Commits on Apr 19, 2019

[SPARK-25079][PYTHON][BRANCH-2.4] update python3 executable to 3.6.x
shaneknapp
committed

Commits on Apr 21, 2019

[SPARK-24601][SPARK-27051][BACKPORT][CORE] Update to Jackson 2.9.8

srowen
authored and
dongjoon-hyun
committed

Commits on Apr 22, 2019

[SPARK-27496][CORE] Fatal errors should also be sent back to the sender

zsxwing
authored and
dongjoon-hyun
committed
[SPARK-27419][FOLLOWUP][DOCS] Add note about spark.executor.heartbeatInterval change to migration guide

srowen
authored and
cloud-fan
committed
[SPARK-27469][BUILD][BRANCH-2.4] Unify commons-beanutils deps to latest 1.9.3

srowen
authored and
dongjoon-hyun
committed

Commits on Apr 23, 2019

Commits on Apr 24, 2019

[SPARK-27550][TEST][BRANCH-2.4] Fix `test-dependencies.sh` not to use `kafka-0-8`profile for Scala-2.12
dongjoon-hyun
committed

Commits on Apr 25, 2019

[MINOR][TEST] switch from 2.4.1 to 2.4.2 in HiveExternalCatalogVersionsSuite
cloud-fan
committed

Commits on Apr 27, 2019

[SPARK-25535][CORE][BRANCH-2.4] Work around bad error handling in commons-crypto.

Marcelo Vanzin
authored and
dongjoon-hyun
committed
[SPARK-26745][SQL][TESTS] JsonSuite test case: empty line -> 0 record count

Branden Smith
authored and
dongjoon-hyun
committed

Commits on Apr 30, 2019

Commits on May 1, 2019

[SPARK-26048][SPARK-24530][2.4] Cherrypick all the missing commits to 2.4 release script

committed

Commits on May 3, 2019

Commits on May 6, 2019

[SPARK-27596][SQL] The JDBC 'query' option doesn't work for Oracle database

dilipbiswal
authored and
gatorsmile
committed

Commits on May 7, 2019

Commits on May 8, 2019

[MINOR][DOCS] Fix invalid documentation for StreamingQueryManager Class

asaf400
authored and
HyukjinKwon
committed
[SPARK-25139][SPARK-18406][CORE][2.4] Avoid NonFatals to kill the Executor in PythonRunner

jiangxb1987
authored and
dongjoon-hyun
committed

Commits on May 10, 2019

[MINOR][TEST] Fix schema mismatch error

ericl
authored and
cloud-fan
committed
[SPARK-27672][SQL] Add `since` info to string expressions

HyukjinKwon
authored and
dongjoon-hyun
committed
[SPARK-27673][SQL] Add `since` info to random, regex, null expressions

HyukjinKwon
authored and
dongjoon-hyun
committed
[SPARK-27347][MESOS] Fix supervised driver retry logic for outdated tasks

Sam Tran
authored and
dongjoon-hyun
committed

Commits on May 13, 2019

[SPARK-27671][SQL] Fix error when casting from a nested null in a struct

viirya
authored and
dongjoon-hyun
committed

Commits on May 14, 2019

[SPARK-26812][SQL][BACKPORT-2.4] Report correct nullability for complex datatypes in Union

mgaido91
authored and
dongjoon-hyun
committed

Commits on May 15, 2019

[MINOR][SS] Remove duplicate 'add' in comment of `StructuredSessionization`.

beliefer
authored and
HyukjinKwon
committed

Commits on May 16, 2019

[SPARK-27735][SS] Parsing interval string should be case-insensitive in SS

zsxwing
authored and
dongjoon-hyun
committed

Commits on May 20, 2019

Commits on May 21, 2019

[MINOR][DOCS] Fix Spark hive example.

ScrapCodes
authored and
HyukjinKwon
committed
[SPARK-27726][CORE] Fix performance of ElementTrackingStore deletes when using InMemoryStore under high loads

David Navas
authored and
Marcelo Vanzin
committed

Commits on May 22, 2019

Commits on May 23, 2019

Commits on May 24, 2019

[MINOR][DOC] ForeachBatch doc fix.

gaborgsomogyi
authored and
HyukjinKwon
committed

Commits on May 26, 2019

[SPARK-27711][CORE] Unset InputFileBlockHolder at the end of tasks

jose-torres
authored and
dongjoon-hyun
committed
[SPARK-27441][SQL][TEST] Add read/write tests to Hive serde tables

wangyum
authored and
dongjoon-hyun
committed

Commits on May 28, 2019

[SPARK-27858][SQL] Fix for avro deserialization on union types with multiple non-null types

Gabbi Merz
authored and
dongjoon-hyun
committed
[SPARK-27657][ML] Fix the log format of ml.util.Instrumentation.logFai…

MJ Tang
authored and
srowen
committed

Commits on May 29, 2019

[SPARK-27863][SQL][BACKPORT-2.4] Metadata files and temporary files should not be counted as data files

wangyum
authored and
dongjoon-hyun
committed
[SPARK-27869][CORE] Redact sensitive information in System Properties from UI

aaruna
authored and
dongjoon-hyun
committed
[SPARK-27868][CORE] Better default value and documentation for socket server backlog.

Marcelo Vanzin
authored and
dongjoon-hyun
committed

Commits on May 31, 2019

[SPARK-26192][MESOS][2.4] Retrieve enableFetcherCache option from submission for driver URIs

mwlon
authored and
dongjoon-hyun
committed
[SPARK-27794][R][DOCS][BACKPORT] Use https URL for CRAN repo

srowen
authored and
dongjoon-hyun
committed
[SPARK-27896][ML] Fix definition of clustering silhouette coefficient for 1-element clusters

srowen
authored and
dongjoon-hyun
committed

Commits on Jun 1, 2019

Revert "[SPARK-27896][ML] Fix definition of clustering silhouette coefficient for 1-element clusters"
dongjoon-hyun
committed

Commits on Jun 2, 2019

[SPARK-27907][SQL] HiveUDAF should return NULL in case of 0 rows

ajithme
authored and
dongjoon-hyun
committed

Commits on Jun 3, 2019

[MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala

HyukjinKwon
authored and
dongjoon-hyun
committed

Commits on Jun 4, 2019

Commits on Jun 5, 2019

[MINOR][SQL] Skip warning if JOB_SUMMARY_LEVEL is set to NONE

jmsanders
authored and
dongjoon-hyun
committed

Commits on Jun 8, 2019

Commits on Jun 11, 2019

[SPARK-27917][SQL][BACKPORT-2.4] canonical form of CaseWhen object is incorrect

sandeep-katta
authored and
dongjoon-hyun
committed

Commits on Jun 13, 2019

[SPARK-28031][PYSPARK][TEST] Improve doctest on over function of Column

viirya
authored and
HyukjinKwon
committed

Commits on Jun 14, 2019

[SPARK-21882][CORE] OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function
srowen
committed

Commits on Jun 17, 2019

[SPARK-24898][DOC] Adding spark.checkpoint.compress to the docs

sandeepvja
authored and
dongjoon-hyun
committed

Commits on Jun 18, 2019

[SPARK-28058][DOC] Add a note to doc of mode of CSV for column pruning

viirya
authored and
HyukjinKwon
committed

Commits on Jun 19, 2019

[SPARK-28081][ML] Handle large vocab counts in word2vec
srowen
committed

Commits on Jun 20, 2019

[SPARK-26555][SQL][BRANCH-2.4] make ScalaReflection subtype checking thread safe

mwlon
authored and
JoshRosen
committed
[MINOR][DOC] Fix python variance() documentation

tools4origins
authored and
dongjoon-hyun
committed
[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue

wangyum
authored and
dongjoon-hyun
committed

Commits on Jun 21, 2019

[SPARK-26038][BRANCH-2.4] Decimal toScalaBigInt/toJavaBigInteger for decimals not fitting in long

juliuszsompolski
authored and
JoshRosen
committed

Commits on Jun 24, 2019

Commits on Jun 25, 2019

[SPARK-28154][ML][FOLLOWUP] GMM fix double caching

zhengruifeng
authored and
srowen
committed

Commits on Jun 26, 2019

[SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to prevent StackOverflowError

parthchandra
authored and
dbtsai
committed
[SPARK-28164] Fix usage description of `start-slave.sh`

shivusondur
authored and
srowen
committed

Commits on Jun 27, 2019

[SPARK-28157][CORE][2.4] Make SHS clear KVStore `LogInfo`s for the blacklisted entries

dongjoon-hyun
authored and
dbtsai
committed

Commits on Jun 30, 2019

[SPARK-28160][CORE] Fix a bug that callback function may hang when unchecked exception missed

LantaoJin
authored and
srowen
committed

Commits on Jul 1, 2019

[SPARK-28170][ML][PYTHON] Uniform Vectors and Matrix documentation

mgaido91
authored and
HyukjinKwon
committed

Commits on Jul 3, 2019

[MINOR] Add requestHeaderSize debug log

gaborgsomogyi
authored and
dongjoon-hyun
committed

Commits on Jul 8, 2019

[SPARK-28261][CORE] Fix client reuse test

gaborgsomogyi
authored and
dongjoon-hyun
committed

Commits on Jul 9, 2019

Commits on Jul 10, 2019

[SPARK-28335][DSTREAMS][TEST] DirectKafkaStreamSuite wait for Kafka async commit

gaborgsomogyi
authored and
dongjoon-hyun
committed

Commits on Jul 11, 2019

[SPARK-28015][SQL] Check stringToDate() consumes entire input for the yyyy and yyyy-[m]m formats

MaxGekk
authored and
dongjoon-hyun
committed

Commits on Jul 12, 2019

Commits on Jul 13, 2019

[SPARK-28371][SQL] Make Parquet "StartsWith" filter null-safe

Marcelo Vanzin
authored and
dongjoon-hyun
committed

Commits on Jul 14, 2019

[SPARK-28378][PYTHON] Remove usage of cgi.escape

viirya
authored and
HyukjinKwon
committed

Commits on Jul 15, 2019

[SPARK-28404][SS] Fix negative timeout value in RateStreamContinuousPartitionReader

gaborgsomogyi
authored and
dongjoon-hyun
committed

Commits on Jul 16, 2019

Commits on Jul 17, 2019

Commits on Jul 18, 2019

[SPARK-28430][UI] Fix stage table rendering when some tasks' metrics are missing

JoshRosen
authored and
dongjoon-hyun
committed

Commits on Jul 21, 2019

[SPARK-28464][DOC][SS] Document Kafka source minPartitions option

Arun Pandian
authored and
dongjoon-hyun
committed

Commits on Jul 22, 2019

Commits on Jul 24, 2019

Commits on Jul 25, 2019

Commits on Jul 26, 2019

[MINOR][SQL] Fix log messages of DataWritingSparkTask

dongjoon-hyun
authored and
HyukjinKwon
committed
[SPARK-28489][SS] Fix a bug that KafkaOffsetRangeCalculator.getRanges may drop offsets

zsxwing
authored and
dongjoon-hyun
committed

Commits on Jul 27, 2019

[SPARK-28535][CORE][TEST] Slow down tasks to de-flake JobCancellationSuite

Marcelo Vanzin
authored and
dongjoon-hyun
committed

Commits on Jul 28, 2019

[SPARK-28545][SQL] Add the hash map size to the directional log of ObjectAggregationIterator
dongjoon-hyun
committed

Commits on Jul 29, 2019

[SPARK-25474][SQL][2.4] Support `spark.sql.statistics.fallBackToHdfs` in data source tables

shahidki31
authored and
dongjoon-hyun
committed

Commits on Jul 30, 2019

[SPARK-26152][CORE][2.4] Synchronize Worker Cleanup with Worker Shutdown

ajithme
authored and
dbtsai
committed

Commits on Jul 31, 2019

[MINOR][CORE][DOCS] Fix inconsistent description of showConsoleProgress

beliefer
authored and
HyukjinKwon
committed
[SPARK-28564][CORE] Access history application defaults to the last attempt id

cxzl25
authored and
Marcelo Vanzin
committed

Commits on Aug 1, 2019

Commits on Aug 2, 2019

Commits on Aug 3, 2019

Commits on Aug 4, 2019

[SPARK-28609][DOC] Fix broken styles/links and make up-to-date
dongjoon-hyun
committed

Commits on Aug 7, 2019

[SPARK-28649][INFRA] Add Python .eggs to .gitignore

rvesse
authored and
dongjoon-hyun
committed

Commits on Aug 12, 2019

[SPARK-28638][WEBUI] Task summary should only contain successful tasks' metrics

gengliangwang
authored and
Marcelo Vanzin
committed

Commits on Aug 13, 2019

[SPARK-28713][BUILD][2.4] Bump checkstyle from 8.2 to 8.23

Fokko
authored and
dongjoon-hyun
committed

Commits on Aug 15, 2019

Commits on Aug 17, 2019

[SPARK-28766][R][DOC] Fix CRAN incoming feasibility warning on invalid URL
dongjoon-hyun
committed

Commits on Aug 18, 2019

Commits on Aug 19, 2019

Commits on Aug 20, 2019

Commits on Aug 21, 2019

Commits on Aug 22, 2019

[SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR

triplesheep
authored and
dongjoon-hyun
committed
[SPARK-28780][ML][2.4] deprecate LinearSVCModel.setWeightCol

zhengruifeng
authored and
dongjoon-hyun
committed
[SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

xuanyuanking
authored and
dongjoon-hyun
committed

Commits on Aug 23, 2019

[SPARK-28642][SQL][2.4] Hide credentials in show create table

wangyum
authored and
dongjoon-hyun
committed
[SPARK-27330][SS][2.4] support task abort in foreach writer

Eyal Zituny
authored and
dongjoon-hyun
committed
[SPARK-28025][SS][2.4] Fix FileContextBasedCheckpointFileManager leaking crc files

HeartSaVioR
authored and
dongjoon-hyun
committed

Commits on Aug 25, 2019

Commits on Aug 31, 2019

[SPARK-28778][MESOS][2.4] Fixed executors advertised address in virtual network

Anton Kirillov
authored and
dongjoon-hyun
committed
[SPARK-28903][STREAMING][PYSPARK][TESTS] Fix AWS JDK version conflict that breaks Pyspark Kinesis tests
srowen
committed

Commits on Sep 2, 2019

[SPARK-28951][INFRA] Add release announce template
dongjoon-hyun
committed

Commits on Sep 3, 2019

[SPARK-28921][BUILD][K8S][2.4] Update kubernetes client to 4.4.2

andygrove
authored and
dongjoon-hyun
committed
[SPARK-22955][DSTREAMS] - graceful shutdown shouldn't lead to job gen…

Nikita Gorbachevsky
authored and
srowen
committed
[SPARK-28709][DSTREAMS] Fix StreamingContext leak through Streaming

Nikita Gorbachevsky
authored and
srowen
committed

Commits on Sep 5, 2019

Commits on Sep 7, 2019

Commits on Sep 10, 2019

[SPARK-23519][SQL][2.4] Create view should work from query with duplicate output columns

authored and
cloud-fan
committed

Commits on Sep 11, 2019

[SPARK-28906][BUILD] Fix incorrect information in bin/spark-submit --version

kiszk
authored and
srowen
committed

Commits on Sep 12, 2019

[MINOR][DOCS] Fix few typos in the java docs

dengziming
authored and
HyukjinKwon
committed

Commits on Sep 13, 2019

Commits on Sep 14, 2019

Commits on Sep 16, 2019

[SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

LucaCanali
authored and
dongjoon-hyun
committed

Commits on Sep 17, 2019

[SPARK-29046][SQL][2.4] Fix NPE in SQLConf.get when active SparkContext is stopping

HeartSaVioR
authored and
dongjoon-hyun
committed

Commits on Sep 18, 2019

Commits on Sep 19, 2019

Commits on Sep 20, 2019

[MINOR][BUILD][2.4] Fix 4 misc build warnings

srowen
authored and
dongjoon-hyun
committed
[SPARK-26003][SQL][2.4] Improve SQLAppStatusListener.aggregateMetrics performance

mgaido91
authored and
dongjoon-hyun
committed
[SPARK-27460][TESTS][2.4] Running slowest test suites in their own forked JVMs for higher parallelism

authored and
dongjoon-hyun
committed
[MINOR][INFRA] Use java-version instead of version for GitHub Action

wangyum
authored and
dongjoon-hyun
committed

Commits on Sep 21, 2019

Commits on Sep 22, 2019

[CORE][MINOR] Correct a log message in DAGScheduler

madianjun
authored and
HyukjinKwon
committed
[SPARK-29201][INFRA][2.4] Add Hadoop 2.6 combination to GitHub Action

dongjoon-hyun
authored and
HyukjinKwon
committed

Commits on Sep 23, 2019

Commits on Sep 24, 2019

Commits on Sep 25, 2019

[SPARK-23197][STREAMING][TESTS][2.4] Fix ReceiverSuite."receiver_life_cycle" to not rely on timing

HeartSaVioR
authored and
dongjoon-hyun
committed

Commits on Sep 26, 2019

[SPARK-29203][SQL][TESTS][2.4] Reduce shuffle partitions in SQLQueryTestSuite
wangyum
committed

Commits on Sep 27, 2019

[SPARK-29213][SQL] Generate extra IsNotNull predicate in FilterExec

wangshuo128
authored and
cloud-fan
committed
[SPARK-29240][PYTHON] Pass Py4J column instance to support PySpark column in element_at function

HyukjinKwon
authored and
dongjoon-hyun
committed
[SPARK-29263][SCHEDULER] Update `availableSlots` in `resourceOffers()` before checking available slots for barrier taskSet

juliuszsompolski
authored and
jiangxb1987
committed
[SPARK-29263][CORE][TEST][FOLLOWUP][2.4] Fix build failure of `TaskSchedulerImplSuite`

jiangxb1987
authored and
Marcelo Vanzin
committed

Commits on Sep 29, 2019

[SPARK-29247][SQL] Redact sensitive information in when construct HiveClientHive.state

AngersZhuuuu
authored and
dongjoon-hyun
committed

Commits on Sep 30, 2019

Commits on Oct 1, 2019

Commits on Oct 4, 2019

Commits on Oct 7, 2019

[SPARK-28938][K8S][2.4] Move to supported OpenJDK docker image for Kubernetes

viirya
authored and
dongjoon-hyun
committed

Commits on Oct 8, 2019

[MINOR][BUILD] Fix an incorrect path in license file

beliefer
authored and
HyukjinKwon
committed
[SPARK-28917][CORE] Synchronize access to RDD mutable state

squito
authored and
Marcelo Vanzin
committed

Commits on Oct 12, 2019

[SPARK-29410][BUILD] Update commons-beanutils to 1.9.4

peter-toth
authored and
srowen
committed
[SPARK-29445][CORE] Bump netty-all from 4.1.39.Final to 4.1.42.Final

Fokko
authored and
srowen
committed

Commits on Oct 16, 2019

[SPARK-27259][CORE] Allow setting -1 as length for FileBlock

prasha2
authored and
dongjoon-hyun
committed

Commits on Oct 18, 2019

Commits on Oct 19, 2019

[SPARK-29494][SQL][2.4] Fix for ArrayOutofBoundsException while converting string to timestamp

rahulsmahadev
authored and
srowen
committed

Commits on Oct 21, 2019

[SPARK-28963][BUILD] Fall back to archive.apache.org in build/mvn for older releases

srowen
authored and
dongjoon-hyun
committed

Commits on Oct 22, 2019

Commits on Oct 23, 2019

[SPARK-21492][SQL][2.4] Fix memory leak in SortMergeJoin

xuanyuanking
authored and
cloud-fan
committed

Commits on Oct 24, 2019

[SPARK-21492][SQL][FOLLOW UP] Reimplement UnsafeExternalRowSorter in database style iterator

xuanyuanking
authored and
cloud-fan
committed
[SPARK-21287][SQL] Remove requirement of fetch_size>=0 from JDBCOptions

fuwhu
authored and
dongjoon-hyun
committed

Commits on Oct 25, 2019

[SPARK-29530][SQL][2.4] Make SQLConf in SQL parse process thread safe

AngersZhuuuu
authored and
dongjoon-hyun
committed
[SPARK-29498][SQL][2.4] CatalogTable to HiveTable should not change the table's ownership

wangyum
authored and
dongjoon-hyun
committed

Commits on May 12, 2020

[SPARK-31655][BUILD][2.4] Upgrade snappy-java to 1.1.7.5
AngersZhuuuu
committed