Skip to content

[ZEPPELIN-2257] notification about incompleteness of data#2134

Closed
tinkoff-dwh wants to merge 6 commits into
apache:masterfrom
tinkoff-dwh:ZEPPELIN-2257
Closed

[ZEPPELIN-2257] notification about incompleteness of data#2134
tinkoff-dwh wants to merge 6 commits into
apache:masterfrom
tinkoff-dwh:ZEPPELIN-2257

Conversation

@tinkoff-dwh
Copy link
Copy Markdown
Contributor

What is this PR for?

Added notification about exceeding the limit in the result.

What type of PR is it?

Improvement

What is the Jira issue?

https://issues.apache.org/jira/browse/ZEPPELIN-2257

How should this be tested?

  1. Create table test with more than 2 records (if not exists)
  2. Set parameter common.max_count = 2
  3. Execute
%jdbc
select *from test

You should see message about exceeds limit

Screenshots (if appropriate)

6

Questions:

  • Does the licenses files need update? no
  • Is there breaking changes for older versions? no
  • Does this needs documentation? no

@Leemoonsoo
Copy link
Copy Markdown
Member

LGTM

@Leemoonsoo
Copy link
Copy Markdown
Member

Merge to master and branch-0.7 if no further discussions.

@1ambda
Copy link
Copy Markdown
Member

1ambda commented Mar 15, 2017

Sorry for late reply.

For example,

image

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

ok.
111

@1ambda
Copy link
Copy Markdown
Member

1ambda commented Mar 16, 2017

LGTM

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

111

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

@AhyoungRyu
Copy link
Copy Markdown
Contributor

@tinkoff-dwh Then you can make this CI status green by reopening-closing this PR :)

@tinkoff-dwh tinkoff-dwh reopened this Mar 16, 2017
@prabhjyotsingh
Copy link
Copy Markdown
Contributor

prabhjyotsingh commented Mar 16, 2017

Just saw it, this definitely looks better. I don't have a strong opinion on this, just observed a small diff, hence, highlighting it.

This is how it gets displayed in spark/livy, with some extra information.
screen shot 2017-03-16 at 10 21 36 pm

And this is how it will look like if there were multiple queries.
screen shot 2017-03-16 at 10 24 54 pm

@Leemoonsoo
Copy link
Copy Markdown
Member

In addition to @prabhjyotsingh mentions, there are another type of message controlled by ZEPPELIN_INTERPRETER_OUTPUT_LIMIT env variable.

image

All three messages Color, location, Decorations are different.
Basically these three messages are saying the same thing "Not a complete data".

So it make sense to display all three message in similar way, i think.

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

@Leemoonsoo
what final version, bootstrap?

@Leemoonsoo
Copy link
Copy Markdown
Member

Leemoonsoo commented Mar 17, 2017

Message location

Because of existing message Results are limited by X. and Output exceeds 10240. Truncated. are displayed below the table.
I think showing Attention! Result is incomplete ... below the table helps keep user experience more consistent.

Message style

Bootstrap decoration is pretty. If we apply bootstrap alert to all 3 messages, then that means existing 2 message ux is changed, too.

From taking less height of the screen, receiving less attention,
To taking more height of the screen, receiving more attention.

So which is the way we should go do you guys think? @tinkoff-dwh @1ambda

Message text

All three message are different.

Results are limited by X.
Output exceeds 10240. Truncated.
Attention! Result is incomplete ...

It'll be better use similar form of message. But how they're limited are all different. And it'll be great if we user give some link how they're limited.
So for example,

Output is truncated to X rows. Learn more about common.max_count
Output is truncated to 10240 bytes. learn more about ZEPPELIN_INTERPRETER_OUTPUT_LIMIT

What do you think?

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

tinkoff-dwh commented Mar 17, 2017

@Leemoonsoo
location
agree
style
Bootstrap attracts attention and this is important
text
Output is truncated to {count} {rows | bytes}. Learn more about {variable_name}

sorry for offtopic. @Leemoonsoo can you watch #2085

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

_jdbc
_jdbc_size
_livy
_livy_size
_pig
_pig_size
_spark
_spark_size

@Leemoonsoo
Copy link
Copy Markdown
Member

image

Top margin looks bit small and bottom margin looks too large. What do you think adjust them little bit and make top and bottom margin the same?

@1ambda @AhyoungRyu @prabhjyotsingh @felixcheung @zjffdu @jongyoul Can you guys take a look and give some feedback how this new message style looks like?

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

@Leemoonsoo
I think now is fine (data table + message separated from footer), but I can increase the top margin

@Leemoonsoo
Copy link
Copy Markdown
Member

@tinkoff-dwh thanks!

It's nit, but bottom margin is bit much compare to other margins in paragraph. i tried mark other margins.

image

Of course there's no rule that all the margin should be the same, but the margin on bottom looks bit inconsistent. Message is already decorated by bootstrap box so it already gives good visual separation.

What do you think?

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

tinkoff-dwh commented Mar 23, 2017

@Leemoonsoo
possible. This margin within HTML Message maybe there are problems in other messages(HTML, without bootstrap). I'll try.

@Leemoonsoo
Copy link
Copy Markdown
Member

@tinkoff-dwh Ah, i see. i didn't see where this margin comes from.

@AhyoungRyu
Copy link
Copy Markdown
Contributor

Tested and basically agree with @Leemoonsoo. But one thing I just noticed is this new message can be seen in report mode.

screen shot 2017-03-24 at 12 20 56 pm
I think it would be better we can hide this msg in this case.

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

@AhyoungRyu
if you configure the note and working only in report mode then you will not see when the report is incomplete.I can add the close button

@AhyoungRyu
Copy link
Copy Markdown
Contributor

I can add the close button

@tinkoff-dwh Yeah that's better. Having close button will be better for other cases as well.

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

1

@AhyoungRyu
Copy link
Copy Markdown
Contributor

@tinkoff-dwh Thanks! Looks good :)

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

tinkoff-dwh commented Mar 27, 2017

@Leemoonsoo
Yes you were right, this margin from alert (bootstrap class). fix it
1

@tinkoff-dwh
Copy link
Copy Markdown
Contributor Author

tinkoff-dwh commented Mar 29, 2017

Ready to review

@sotnich
Copy link
Copy Markdown

sotnich commented Mar 29, 2017

LGTM

# Conflicts:
#	livy/src/main/java/org/apache/zeppelin/livy/LivySparkSQLInterpreter.java
@Leemoonsoo
Copy link
Copy Markdown
Member

LGTM and merge to master if no further discussions.

Thanks @tinkoff-dwh for the improvement!

@asfgit asfgit closed this in 61b7162 Apr 5, 2017
@tinkoff-dwh tinkoff-dwh deleted the ZEPPELIN-2257 branch April 6, 2017 05:06
prabhjyotsingh added a commit to prabhjyotsingh/zeppelin that referenced this pull request Sep 1, 2017
### What is this PR for?
Added notification about exceeding the limit in the result.

### What type of PR is it?
Improvement

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-2257

### How should this be tested?
1. Create table *test* with more than 2 records (if not exists)
2. Set parameter `common.max_count ` = 2
3. Execute
```
%jdbc
select *from test
```
You should see message about exceeds limit

### Screenshots (if appropriate)
![6](https://cloud.githubusercontent.com/assets/25951039/23899435/f5a23e48-08d6-11e7-9cb0-1613398ce22e.png)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

Author: Tinkoff DWH <tinkoff.dwh@gmail.com>

Closes apache#2134 from tinkoff-dwh/ZEPPELIN-2257 and squashes the following commits:

367ac65 [Tinkoff DWH] [ZEPPELIN-2257] merge
1048214 [Tinkoff DWH] Merge remote-tracking branch 'origin/master' into ZEPPELIN-2257
3c52b52 [Tinkoff DWH] [ZEPPELIN-2257]  custom css class for alert
2e6c976 [Tinkoff DWH] [ZEPPELIN-2257] close button to alert
d6dbe3e [Tinkoff DWH] Merge remote-tracking branch 'origin/master' into ZEPPELIN-2257
edeca0e [Tinkoff DWH] [ZEPPELIN-2257] notifications about incompleteness of data
prabhjyotsingh added a commit to prabhjyotsingh/zeppelin that referenced this pull request Oct 23, 2017
### What is this PR for?
Added notification about exceeding the limit in the result.

### What type of PR is it?
Improvement

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-2257

### How should this be tested?
1. Create table *test* with more than 2 records (if not exists)
2. Set parameter `common.max_count ` = 2
3. Execute
```
%jdbc
select *from test
```
You should see message about exceeds limit

### Screenshots (if appropriate)
![6](https://cloud.githubusercontent.com/assets/25951039/23899435/f5a23e48-08d6-11e7-9cb0-1613398ce22e.png)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

Author: Tinkoff DWH <tinkoff.dwh@gmail.com>

Closes apache#2134 from tinkoff-dwh/ZEPPELIN-2257 and squashes the following commits:

367ac65 [Tinkoff DWH] [ZEPPELIN-2257] merge
1048214 [Tinkoff DWH] Merge remote-tracking branch 'origin/master' into ZEPPELIN-2257
3c52b52 [Tinkoff DWH] [ZEPPELIN-2257]  custom css class for alert
2e6c976 [Tinkoff DWH] [ZEPPELIN-2257] close button to alert
d6dbe3e [Tinkoff DWH] Merge remote-tracking branch 'origin/master' into ZEPPELIN-2257
edeca0e [Tinkoff DWH] [ZEPPELIN-2257] notifications about incompleteness of data
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants