-
Notifications
You must be signed in to change notification settings - Fork 29.1k
[SPARK-19540][SQL] Add ability to clone SparkSession wherein cloned session has an identical copy of the SessionState #16826
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 1 commit
18ce1b8
9beb78d
a343d8a
4210079
6da6bda
579d0b7
2837e73
8c00344
f423f74
b1371d8
2cee190
e2bbfa8
8ac778a
0c732ce
3c995e1
292011a
b027412
295ee41
847b484
9beba84
3d2e4a6
4f70d12
dd2dedd
8a8d47b
ffc2058
16824f9
fd11ee2
437b0bc
300d3a0
3ee271f
c3f052f
0bdc81c
2740c63
0f167db
2f0b1ad
c41e7bc
5eb6733
05abcf8
4c23e7a
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
- Loading branch information
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -274,6 +274,7 @@ private[hive] class HiveClientImpl( | |
| val original = Thread.currentThread().getContextClassLoader | ||
| // Set the thread local metastore client to the client associated with this HiveClientImpl. | ||
| Hive.set(client) | ||
| // replace conf in cached hive with current conf | ||
| Hive.get(conf) | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Because
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Because of reusing
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Thank you! |
||
| // The classloader in clientLoader could be changed after addJar, always use the latest | ||
| // classloader | ||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A
getafter asetlooks weird. Actually I need to go back to check Hive source to knowgetwill replace conf with provided one. Shall we move this intoprivate def client: Hiveand add comment for it?There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@viirya
Hive.get(conf)replaces conf in the thread local Hive with current conf, so it must be called afterHive.set(client)which sets the current thread local Hive.