Skip to content
This repository was archived by the owner on Nov 16, 2023. It is now read-only.

[WIP] ProduceNgrams - #247

Closed
ganik wants to merge 4 commits into
microsoft:masterfrom
ganik:ganik/lp
Closed

[WIP] ProduceNgrams #247
ganik wants to merge 4 commits into
microsoft:masterfrom
ganik:ganik/lp

Conversation

@ganik

@ganik ganik commented Aug 23, 2019

Copy link
Copy Markdown
Contributor

fixes #245
Requires next version of ML.NET 1.4

@ganik ganik changed the title [WIP] LpNormalizer, ProduceNgrams [WIP] ProduceNgrams Sep 9, 2019
pipe = Pipeline([
CharTokenizer(columns={'SentimentText_Transform': 'SentimentText'}),
NGramExtractor(ngram_length=1, all_lengths=False, columns={'Ngrams': 'SentimentText_Transform'}),
ColumnDropper(columns=['SentimentText_Transform', 'SentimentText', 'Sentiment'])

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I'm missing something here. How does Sentiment get dropped, then printed below? Are we looking to teach users to explicitly drop no longer needed cols like SentimentText?

@ganik

ganik commented Oct 10, 2019

Copy link
Copy Markdown
Contributor Author

duplicate of #320

@ganik ganik closed this Oct 10, 2019
@ganik
ganik deleted the ganik/lp branch May 16, 2020 20:49
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add ProduceNgrams transform

2 participants