[SPARK-10931][PYSPARK][ML] PySpark ML Models should contain Param values#10270

Closed

evanyc15 wants to merge 1220 commits into

apache:masterfrom

evanyc15:SPARK-10931-pyspark-mllib

This pull request is big! We're only showing the most recent 250 commits

Commits on Jul 14, 2016

[SPARK-16536][SQL][PYSPARK][MINOR] Expose `sql` in PySpark Shell

dongjoon-hyun
authored and
rxin
committed
[SPARK-16503] SparkSession should provide Spark version

lw-lin
authored and
rxin
committed
[SPARK-16448] RemoveAliasOnlyProject should not remove alias with metadata

cloud-fan
authored and
liancheng
committed
[SPARK-16500][ML][MLLIB][OPTIMIZER] add LBFGS convergence warning for all used place in MLLib

WeichenXu123
authored and
srowen
committed
[SPARK-16403][EXAMPLES] Cleanup to remove unused imports, consistent style, minor fixes

BryanCutler
authored and
srowen
committed
[SPARK-14963][MINOR][YARN] Fix typo in YarnShuffleService recovery file name

jerryshao
authored and
Tom Graves
committed
[SPARK-16505][YARN] Optionally propagate error during shuffle service startup.

Marcelo Vanzin
authored and
Tom Graves
committed
[SPARK-16530][SQL][TRIVIAL] Wrong Parser Keyword in ALTER TABLE CHANGE COLUMN

gatorsmile
authored and
hvanhovell
committed
[SPARK-16543][SQL] Rename the columns of `SHOW PARTITION/COLUMNS` commands

dongjoon-hyun
authored and
hvanhovell
committed
[SPARK-16509][SPARKR] Rename window.partitionBy and window.orderBy to windowPartitionBy and windowOrderBy.

sun-rui
authored and
shivaram
committed
[SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

felixcheung
authored and
shivaram
committed
[SPARK-16529][SQL][TEST] `withTempDatabase` should set `default` database before dropping

dongjoon-hyun
authored and
liancheng
committed
[SPARK-16528][SQL] Fix NPE problem in HiveClientImpl

jacek-lewandowski
authored and
rxin
committed
[SPARK-16540][YARN][CORE] Avoid adding jars twice for Spark running on yarn

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-16553][DOCS] Fix SQL example file name in docs

shivaram
authored and
rxin
committed
[SPARK-16555] Work around Jekyll error-handling bug which led to silent failures

JoshRosen
authored and
rxin
committed

Commits on Jul 15, 2016

Commits on Jul 16, 2016

[SPARK-16582][SQL] Explicitly define isNull = false for non-nullable expressions

sameeragarwal
authored and
rxin
committed
[SPARK-3359][DOCS] More changes to resolve javadoc 8 errors that will help unidoc/genjavadoc compatibility

srowen
authored and
rxin
committed
[SPARK-16112][SPARKR] Programming guide for gapply/gapplyCollect

Narine Kokhlikyan
authored and
shivaram
committed

Commits on Jul 17, 2016

Commits on Jul 18, 2016

[SPARK-16027][SPARKR] Fix R tests SparkSession init/stop

felixcheung
authored and
shivaram
committed
[SPARK-16588][SQL] Deprecate monotonicallyIncreasingId in Scala/Java
rxin
committed
[MINOR][TYPO] fix fininsh typo

WeichenXu123
authored and
srowen
committed
[SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

krishnakalyan3
authored and
shivaram
committed
[SPARK-16351][SQL] Avoid per-record type dispatch in JSON when writing

HyukjinKwon
authored and
yhuai
committed
[SPARK-16515][SQL] set default record reader and writer for script transformation

adrian-wang
authored and
yhuai
committed
[SPARKR][DOCS] minor code sample update in R programming guide

felixcheung
authored and
shivaram
committed

Commits on Jul 19, 2016

[SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to check generated SQL directly

dongjoon-hyun
authored and
rxin
committed
[HOTFIX] Fix Scala 2.10 compilation
rxin
committed
[SPARK-16615][SQL] Expose sqlContext in SparkSession
rxin
committed
[MINOR] Remove unused arg in als.py

zhengruifeng
authored and
rxin
committed
[SPARK-16303][DOCS][EXAMPLES] Minor Scala/Java example update

liancheng
authored and
yhuai
committed
[DOC] improve python doc for rdd.histogram and dataframe.join

mortada
authored and
rxin
committed
[MINOR][BUILD] Fix Java Linter `LineLength` errors

dongjoon-hyun
authored and
srowen
committed
[SPARK-16535][BUILD] In pom.xml, remove groupId which is redundant definition and inherited from the parent

keypointt
authored and
srowen
committed
[MINOR][SQL][STREAMING][DOCS] Fix minor typos, punctuations and grammar

ahmed-mahran
authored and
srowen
committed
[SPARK-16600][MLLIB] fix some latex formula syntax error

WeichenXu123
authored and
srowen
committed
[SPARK-16395][STREAMING] Fail if too many CheckpointWriteHandlers are queued up in the fixed thread pool
srowen
committed
[SPARK-16478] graphX (added graph caching in strongly connected components)

Michał Wesołowski
authored and
srowen
committed
[SPARK-16494][ML] Upgrade breeze version to 0.12

yanboliang
authored and
srowen
committed
[SPARK-16620][CORE] Add back the tokenization process in `RDD.pipe(command: String)`

lw-lin
authored and
rxin
committed
[SPARK-16602][SQL] `Nvl` function should support numeric-string cases

dongjoon-hyun
authored and
rxin
committed
[SPARK-15705][SQL] Change the default value of spark.sql.hive.convertMetastoreOrc to false.

yhuai
authored and
rxin
committed

Commits on Jul 20, 2016

[SPARK-14702] Make environment of SparkLauncher launched process more configurable

Andrew Duffy
authored and
Marcelo Vanzin
committed
[SPARK-16568][SQL][DOCUMENTATION] update sql programming guide refreshTable API in python code

WeichenXu123
authored and
rxin
committed
[SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite
shivaram
committed
[SPARK-16632][SQL] Respect Hive schema when merging parquet schema.

Marcelo Vanzin
authored and
liancheng
committed
[SPARK-16440][MLLIB] Destroy broadcasted variables even on driver

Anthony Truchet
authored and
srowen
committed
[SPARK-15923][YARN] Spark Application rest api returns 'no such app: …

weiqingy
authored and
srowen
committed
[SPARK-16613][CORE] RDD.pipe returns values for empty partitions

srowen
authored and
rxin
committed
[SPARK-15951] Change Executors Page to use datatables to support sorting columns and searching

kishorvpatil
authored and
Tom Graves
committed
[SPARK-16634][SQL] Workaround JVM bug by moving some code out of ctor.
Marcelo Vanzin
committed
[SPARK-16344][SQL] Decoding Parquet array of struct with a single field named "element"

liancheng
authored and
yhuai
committed

Commits on Jul 21, 2016

[SPARK-16272][CORE] Allow config values to reference conf, env, system props.
Marcelo Vanzin
committed
[SPARK-16644][SQL] Aggregate should not propagate constraints containing aggregate expressions

cloud-fan
authored and
yhuai
committed
[MINOR][DOCS][STREAMING] Minor docfix schema of csv rather than parquet in comments

holdenk
authored and
srowen
committed
[SPARK-16226][SQL] Weaken JDBC isolation level to avoid locking when writing partitions
srowen
committed
[SPARK-16632][SQL] Use Spark requested schema to guide vectorized Parquet reader initialization
liancheng
committed
[SPARK-16640][SQL] Add codegen for Elt function

viirya
authored and
cloud-fan
committed
[SPARK-16632][SQL] Revert PR #14272: Respect Hive schema when merging parquet schema
liancheng
committed
[SPARK-16194] Mesos Driver env vars

Michael Gummelt
authored and
srowen
committed
[SPARK-16656][SQL] Try to make CreateTableAsSelectSuite more stable
yhuai
committed
Copied parameters over from Estimator to Transformer
Evan Chen
committed
Copied parameters over from Estimator to Transformer
Evan Chen
committed
[SPARK-10931] Fixed conflicts
Evan Chen
committed
[SPARK-10931][PYSPARK][ML] PySpark ML Model updated to newest Spark changes
Evan Chen
committed
[SPARK-10931][PYSPARK][ML] PySpark ML Model updated to newest Spark changes
Evan Chen
committed
[SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader

sameeragarwal
authored and
rxin
committed

Commits on Jul 22, 2016

[SPARK-16287][SQL] Implement str_to_map SQL function

techaddict
authored and
cloud-fan
committed
[SPARK-16556][SPARK-16559][SQL] Fix Two Bugs in Bucket Specification

gatorsmile
authored and
cloud-fan
committed
[SPARK-16287][HOTFIX][BUILD][SQL] Fix annotation argument needs to be a constant

jaceklaskowski
authored and
srowen
committed
[SPARK-16487][STREAMING] Fix some batches might not get marked as fully processed in JobGenerator

ahmed-mahran
authored and
srowen
committed
[GIT] add pydev & Rstudio project file to gitignore list

WeichenXu123
authored and
srowen
committed
[SPARK-16650] Improve documentation of spark.task.maxFailures

Tom Graves
authored and
srowen
committed
[SPARK-16651][PYSPARK][DOC] Make `withColumnRenamed/drop` description more consistent with Scala API

dongjoon-hyun
authored and
srowen
committed

Commits on Jul 23, 2016

[SPARK-16622][SQL] Fix NullPointerException when the returned value of the called method in Invoke is null

viirya
authored and
cloud-fan
committed
[SPARK-16561][MLLIB] fix multivarOnlineSummary min/max bug

WeichenXu123
authored and
srowen
committed
[SPARK-16662][PYSPARK][SQL] fix HiveContext warning bug

WeichenXu123
authored and
srowen
committed
[SPARK-16690][TEST] rename SQLTestUtils.withTempTable to withTempView

cloud-fan
authored and
rxin
committed
[SPARK-16380][EXAMPLES] Update SQL examples and programming guide for Python language binding

liancheng
authored and
rxin
committed

Commits on Jul 24, 2016

Commits on Jul 25, 2016

Commits on Jul 26, 2016

[SPARK-15590][WEBUI] Paginate Job Table in Jobs tab

nblintao
authored and
zsxwing
committed
[SPARK-16722][TESTS] Fix a StreamingContext leak in StreamingContextSuite when eventually fails

zsxwing
authored and
tdas
committed
[SPARK-16678][SPARK-16677][SQL] Fix two View-related bugs

gatorsmile
authored and
cloud-fan
committed
Fix description of spark.speculation.quantile

nwbvt
authored and
rxin
committed
[SPARK-16672][SQL] SQLBuilder should not raise exceptions on EXISTS queries

dongjoon-hyun
authored and
rxin
committed
[SPARK-16724] Expose DefinedByConstructorParams

marmbrus
authored and
rxin
committed
[SPARK-16633][SPARK-16642][SPARK-16721][SQL] Fixes three issues related to lead and lag functions
yhuai
committed
[SPARK-16686][SQL] Remove PushProjectThroughSample since it is handled by ColumnPruning

viirya
authored and
cloud-fan
committed
[SPARK-16706][SQL] support java map in encoder

cloud-fan
authored and
liancheng
committed
[TEST][STREAMING] Fix flaky Kafka rate controlling test
tdas
committed
[SPARK-16675][SQL] Avoid per-record type dispatch in JDBC when writing

HyukjinKwon
authored and
cloud-fan
committed
[SPARK-16697][ML][MLLIB] improve LDA submitMiniBatch method to avoid redundant RDD computation

WeichenXu123
authored and
srowen
committed
[SPARK-16663][SQL] desc table should be consistent between data source and hive serde tables

cloud-fan
authored and
liancheng
committed
[SPARK-15271][MESOS] Allow force pulling executor docker images

philipphoffmann
authored and
srowen
committed
[SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus event queue size configurable

dhruve
authored and
Tom Graves
committed

Commits on Jul 27, 2016

[SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGenerator

ooq
authored and
rxin
committed
[SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

dongjoon-hyun
authored and
liancheng
committed
[SPARK-16729][SQL] Throw analysis exception for invalid date casts

petermaxlee
authored and
cloud-fan
committed
[MINOR][ML] Fix some mistake in LinearRegression formula.

yanboliang
authored and
srowen
committed
[MINOR][DOC][SQL] Fix two documents regarding size in bytes

viirya
authored and
cloud-fan
committed
[SPARK-15254][DOC] Improve ML pipeline Cross Validation Scaladoc & PyDoc

krishnakalyan3
authored and
Nick Pentreath
committed
[SPARK-5847][CORE] Allow for configuring MetricsSystem's use of app ID to namespace all metrics

markgrover
authored and
Marcelo Vanzin
committed
[MINOR][DOC] missing keyword new

Bartek Wiśniewski
authored and
rxin
committed
[SPARK-16110][YARN][PYSPARK] Fix allowing python version to be specified per submit for cluster mode.

KevinGrealish
authored and
Marcelo Vanzin
committed

Commits on Jul 28, 2016

[SPARK-16730][SQL] Implement function aliases for type casts

petermaxlee
authored and
cloud-fan
committed
[SPARK-15232][SQL] Add subquery SQL building tests to LogicalPlanToSQLSuite

dongjoon-hyun
authored and
rxin
committed
[SPARK-16552][SQL] Store the Inferred Schemas into External Catalog Tables when Creating Tables

gatorsmile
authored and
cloud-fan
committed
[SPARK-16639][SQL] The query with having condition that contains grouping by column should work

viirya
authored and
cloud-fan
committed
[SPARK-16740][SQL] Fix Long overflow in LongToUnsafeRowMap

sylvinus
authored and
rxin
committed
[SPARK-16764][SQL] Recommend disabling vectorized parquet reader on OutOfMemoryError

sameeragarwal
authored and
rxin
committed
[SPARK-16772] Correct API doc references to PySpark classes + formatting fixes

nchammas
authored and
rxin
committed

Commits on Jul 29, 2016

[SPARK-16664][SQL] Fix persist call on Data frames with more than 200…

Wesley Tang
authored and
srowen
committed
[SPARK-16750][ML] Fix GaussianMixture training failed due to feature column type mistake

yanboliang
authored and
srowen
committed
[SPARK-16751] Upgrade derby to 10.12.1.1

a-roberts
authored and
srowen
committed
[SPARK-16637] Unified containerizer

Michael Gummelt
authored and
srowen
committed
[SPARK-16761][DOC][ML] Fix doc link in docs/ml-guide.md

sundapeng
authored and
srowen
committed
[SPARK-16772][PYTHON][DOCS] Restore "datatype string" to Python API docstrings

nchammas
authored and
rxin
committed

Commits on Jul 30, 2016

Commits on Jul 31, 2016

Commits on Aug 1, 2016

[SPARK-16731][SQL] use StructType in CatalogTable and remove CatalogColumn

cloud-fan
authored and
yhuai
committed
[SPARK-16805][SQL] Log timezone when query result does not match

rxin
authored and
yhuai
committed
[SPARK-16726][SQL] Improve `Union/Intersect/Except` error messages on incompatible types

dongjoon-hyun
authored and
hvanhovell
committed
[SPARK-16485][DOC][ML] Remove useless latex in a log messge.

lins05
authored and
srowen
committed
[SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with SQLContext

holdenk
authored and
srowen
committed
[SPARK-16776][STREAMING] Replace deprecated API in KafkaTestUtils for 0.10.0.

HyukjinKwon
authored and
srowen
committed
[SPARK-16791][SQL] cast struct with timestamp field fails

eyal farago
authored and
cloud-fan
committed
[SPARK-16774][SQL] Fix use of deprecated timestamp constructor & improve timezone handling

holdenk
authored and
srowen
committed
[SPARK-15869][STREAMING] Fix a potential NPE in StreamingJobProgressListener.getBatchUIData
zsxwing
committed

Commits on Aug 2, 2016

[SPARK-16828][SQL] remove MaxOf and MinOf

cloud-fan
authored and
yhuai
committed
[SPARK-16793][SQL] Set the temporary warehouse path to sc'conf in TestHive.

jiangxb1987
authored and
rxin
committed
[SPARK-16734][EXAMPLES][SQL] Revise examples of all language bindings

liancheng
authored and
cloud-fan
committed
[SPARK-16850][SQL] Improve type checking error message for greatest/least

petermaxlee
authored and
cloud-fan
committed
[SPARK-16851][ML] Incorrect threshould length in 'setThresholds()' evoke Exception

zhengruifeng
authored and
yanboliang
committed
[SPARK-16558][EXAMPLES][MLLIB] examples/mllib/LDAExample should use MLVector instead of MLlib Vector

yinxusen
authored and
yanboliang
committed
[SPARK-15541] Casting ConcurrentHashMap to ConcurrentMap (master branch)

Maciej Brynski
authored and
srowen
committed
[SPARK-16822][DOC] Support latex in scaladoc.

lins05
authored and
srowen
committed
[SPARK-16837][SQL] TimeWindow incorrectly drops slideDuration in constructors

tmagrino
authored and
srowen
committed
[SPARK-16062] [SPARK-15989] [SQL] Fix two bugs of Python-only UDTs

viirya
authored and
davies
committed
[SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals

hvanhovell
authored and
rxin
committed
[SPARK-16816] Modify java example which is also reflect in documentation exmaple

phalodi
authored and
srowen
committed
[SPARK-16855][SQL] move Greatest and Least from conditionalExpressions.scala to arithmetic.scala

cloud-fan
authored and
rxin
committed
[SPARK-16787] SparkContext.addFile() should not throw if called twice with the same file
JoshRosen
committed
[SPARK-16858][SQL][TEST] Removal of TestHiveSharedState

gatorsmile
authored and
rxin
committed
[SPARK-16796][WEB UI] Visible passwords on Spark environment page

Devian-ua
authored and
srowen
committed

Commits on Aug 3, 2016

[SQL][MINOR] use stricter type parameter to make it clear that parquet reader returns UnsafeRow

cloud-fan
authored and
liancheng
committed
[SPARK-16831][PYTHON] Fixed bug in CrossValidator.avgMetrics

pkch
authored and
srowen
committed
[SPARK-16714][SPARK-16735][SPARK-16646] array, map, greatest, least's type coercion should handle decimal type

cloud-fan
authored and
yhuai
committed
[SPARK-16596] [SQL] Refactor DataSourceScanExec to do partition discovery at execution instead of planning time

ericl
authored and
davies
committed
[SPARK-14204][SQL] register driverClass rather than user-specified class

mchalek
authored and
srowen
committed

Commits on Aug 4, 2016

[SPARK-16770][BUILD] Fix JLine dependency management and version (Sca…

stsc-pentasys
authored and
srowen
committed
[SPARK-16814][SQL] Fix deprecated parquet constructor usage

holdenk
authored and
srowen
committed
[SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

sharkdtu
authored and
rxin
committed
[MINOR][SQL] Fix minor formatting issue of SortAggregateExec.toString
liancheng
committed
[SPARK-16888][SQL] Implements eval method for expression AssertNotNull

clockfly
authored and
cloud-fan
committed
[SPARK-16867][SQL] createTable and alterTable in ExternalCatalog should not take db

cloud-fan
authored and
liancheng
committed
[SPARK-16853][SQL] fixes encoder error in DataSet typed select

clockfly
authored and
cloud-fan
committed
[SPARK-16802] [SQL] fix overflow in LongToUnsafeRowMap

Davies Liu
authored and
davies
committed
[SPARK-16884] Move DataSourceScanExec out of ExistingRDD.scala file

ericl
authored and
davies
committed
[SPARK-16875][SQL] Add args checking for DataSet randomSplit and sample

zhengruifeng
authored and
srowen
committed
[SPARK-16880][ML][MLLIB] make ann training data persisted if needed

WeichenXu123
authored and
srowen
committed
[SPARK-16877][BUILD] Add rules for preventing to use Java annotations (Deprecated and Override)

HyukjinKwon
authored and
srowen
committed
[SPARK-16863][ML] ProbabilisticClassifier.fit check threshoulds' length

zhengruifeng
authored and
srowen
committed
[SPARK-15074][SHUFFLE] Cache shuffle index file to speedup shuffle fetch

Sital Kedia
authored and
JoshRosen
committed
[HOTFIX] Remove unnecessary imports from #12944 that broke build
JoshRosen
committed
MAINTENANCE. Cleaning up stale PRs.
Marcelo Vanzin
committed

Commits on Aug 5, 2016

[SPARK-16907][SQL] Fix performance regression for parquet table when vectorized parquet record reader is not being used

clockfly
authored and
cloud-fan
committed
[SPARK-15726][SQL] Make DatasetBenchmark fairer among Dataset, DataFrame and RDD

inouehrs
authored and
cloud-fan
committed
[SPARK-16879][SQL] unify logical plans for CREATE TABLE and CTAS

cloud-fan
authored and
hvanhovell
committed
[SPARK-16312][STREAMING][KAFKA][DOC] Doc for Kafka 0.10 integration

koeninger
authored and
srowen
committed
[MINOR] Update AccumulatorV2 doc to not mention "+=".

petermaxlee
authored and
srowen
committed
[SPARK-16625][SQL] General data types to be mapped to Oracle

wangyum
authored and
srowen
committed
[SPARK-16826][SQL] Switch to java.net.URI for parse_url()

sylvinus
authored and
srowen
committed
[SPARK-16421][EXAMPLES][ML] Improve ML Example Outputs

BryanCutler
authored and
srowen
committed
[SPARK-13238][CORE] Add ganglia dmax parameter

ekasitk
authored and
Marcelo Vanzin
committed
[SPARK-16750][FOLLOW-UP][ML] Add transformSchema for StringIndexer/VectorAssembler and fix failed tests.

yanboliang
authored and
srowen
committed
[SPARK-16901] Hive settings in hive-site.xml may be overridden by Hive's default values
yhuai
committed

Commits on Aug 6, 2016

Commits on Aug 7, 2016

[SPARK-16925] Master should call schedule() after all executor exit events, not only failures
JoshRosen
committed
document that Mesos cluster mode supports python

Michael Gummelt
authored and
srowen
committed
[SPARK-16932][DOCS] Changed programming guide to not reference old accumulator API in Scala

BryanCutler
authored and
srowen
committed
[SPARK-16870][DOCS] Summary:add "spark.sql.broadcastTimeout" into docs/sql-programming-gu…

biglobster
authored and
srowen
committed
[SPARK-16911] Fix the links in the programming guide

shiv4nsh
authored and
srowen
committed
[SPARK-16909][SPARK CORE] Streaming for postgreSQL JDBC driver

princejwesley
authored and
srowen
committed
[SPARK-16409][SQL] regexp_extract with optional groups causes NPE
srowen
committed
[SPARK-16939][SQL] Fix build error by using `Tuple1` explicitly in StringFunctionsSuite

dongjoon-hyun
authored and
srowen
committed

Commits on Aug 8, 2016

[SPARK-16919] Configurable update interval for console progress bar

tejasapatil
authored and
srowen
committed
[SPARK-16404][ML] LeastSquaresAggregators serializes unnecessary data

sethah
authored and
dbtsai
committed
[SPARK-16945] Fix Java Lint errors

weiqingy
authored and
srowen
committed
[SPARK-16804][SQL] Correlated subqueries containing non-deterministic operations return incorrect results

nsyca
authored and
hvanhovell
committed
[SPARK-16906][SQL] Adds auxiliary info like input class and input schema in TypedAggregateExpression

clockfly
authored and
cloud-fan
committed
[SPARK-16457][SQL] Fix Wrong Messages when CTAS with a Partition By Clause

gatorsmile
authored and
cloud-fan
committed
[SPARK-16936][SQL] Case Sensitivity Support for Refresh Temp Table

gatorsmile
authored and
cloud-fan
committed
[SPARK-16586][CORE] Handle JVM errors printed to stdout.
Marcelo Vanzin
committed
[SPARK-16953] Make requestTotalExecutors public Developer API to be consistent with requestExecutors/killExecutors
tdas
committed
[SPARK-16779][TRIVIAL] Avoid using postfix operators where they do not add much and remove whitelisting

holdenk
authored and
Marcelo Vanzin
committed
Update docs to include SASL support for RPC

Michael Gummelt
authored and
rxin
committed
[SPARK-16749][SQL] Simplify processing logic in LEAD/LAG processing.

hvanhovell
authored and
yhuai
committed

Commits on Aug 9, 2016

[SPARK-16898][SQL] Adds argument type information for typed logical plan like MapElements, TypedFilter, and AppendColumn

clockfly
authored and
cloud-fan
committed
[SPARK-16563][SQL] fix spark sql thrift server FetchResults bug

Alice
authored and
rxin
committed
[SPARK-16610][SQL] Add `orc.compress` as an alias for `compression` option.

HyukjinKwon
authored and
cloud-fan
committed
[SPARK-16606][CORE] Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."
srowen
committed
[SPARK-16522][MESOS] Spark application throws exception on exit.

sun-rui
authored and
srowen
committed
[SPARK-16940][SQL] `checkAnswer` should raise `TestFailedException` for wrong results

dongjoon-hyun
authored and
srowen
committed
[SPARK-16809] enable history server links in dispatcher UI

Michael Gummelt
authored and
srowen
committed
[SPARK-16964][SQL] Remove private[sql] and private[spark] from sql.execution package

rxin
authored and
cloud-fan
committed
[SPARK-16933][ML] Fix AFTAggregator in AFTSurvivalRegression serializes unnecessary data.
yanboliang
committed
[SPARK-16950] [PYSPARK] fromOffsets parameter support in KafkaUtils.createDirectStream for python3

Mariusz Strzelecki
authored and
davies
committed
[SPARK-16905] SQL DDL: MSCK REPAIR TABLE

Davies Liu
authored and
davies
committed
[SPARK-16956] Make ApplicationState.MAX_NUM_RETRY configurable
JoshRosen
committed
Copied parameters over from Estimator to Transformer
Evan Chen
committed

Commits on Aug 11, 2016

Merge branch 'SPARK-10931-pyspark-mllib' of github.com:evanyc15/spark into SPARK-10931-pyspark-mllib
Evan Chen
committed