Skip to content

Add samples in TT for FFM - #3312

Merged
wschin merged 3 commits into
dotnet:masterfrom
wschin:tt-ffm
Apr 16, 2019
Merged

Add samples in TT for FFM#3312
wschin merged 3 commits into
dotnet:masterfrom
wschin:tt-ffm

Conversation

@wschin

@wschin wschin commented Apr 12, 2019

Copy link
Copy Markdown
Contributor

Two samples in for FFM are added following new sample guideline. Related to #2522.

@wschin wschin added the documentation Related to documentation of ML.NET label Apr 12, 2019
@wschin wschin self-assigned this Apr 12, 2019
@@ -0,0 +1,74 @@
using System;

@wschin wschin Apr 12, 2019

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file is produced by TT. Please ignore the difference here because it replaces the old file entirely.

@@ -0,0 +1,84 @@
using System;

@wschin wschin Apr 12, 2019

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file is produced by TT. Please ignore the difference here because it replaces the old file entirely.

@@ -1,84 +1,167 @@
using System;
using System.Collections.Generic;

@wschin wschin Apr 12, 2019

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file is produced by TT. Please ignore the difference here because it replaces the old file entirely.

@@ -1,76 +1,157 @@
using System;
using System.Collections.Generic;

@wschin wschin Apr 12, 2019

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file is produced by TT. Please ignore the difference here because it replaces the old file entirely.
#Resolved

@codecov

codecov Bot commented Apr 12, 2019

Copy link
Copy Markdown

Codecov Report

Merging #3312 into master will decrease coverage by <.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #3312      +/-   ##
==========================================
- Coverage   72.65%   72.64%   -0.01%     
==========================================
  Files         807      807              
  Lines      145191   145191              
  Branches    16223    16223              
==========================================
- Hits       105485   105481       -4     
- Misses      35290    35293       +3     
- Partials     4416     4417       +1
Flag Coverage Δ
#Debug 72.64% <ø> (-0.01%) ⬇️
#production 68.17% <ø> (-0.01%) ⬇️
#test 88.97% <ø> (ø) ⬆️
Impacted Files Coverage Δ
src/Microsoft.ML.Maml/MAML.cs 24.75% <0%> (-1.46%) ⬇️
...soft.ML.Data/DataLoadSave/Text/TextLoaderCursor.cs 84.7% <0%> (-0.21%) ⬇️
src/Microsoft.ML.FastTree/TreeTrainersCatalog.cs 94.18% <0%> (ø) ⬆️
src/Microsoft.ML.Transforms/NormalizerCatalog.cs 84.78% <0%> (ø) ⬆️

Use proper namespace

Remove old samples

Fix typo

Fix csproj
var metrics = mlContext.BinaryClassification.Evaluate(transformedTrainingData);

// Show the quality metrics.
Microsoft.ML.SamplesUtils.ConsoleUtils.PrintMetrics(metrics);

@shmoradims shmoradims Apr 12, 2019

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Microsoft.ML.SamplesUtils [](start = 12, length = 25)

we're deprecating SamplesUtils. Let's add the helper to the .ttincludefile #Resolved


// Expected output:
// Accuracy: 0.99
// AUC: 1.00

@shmoradims shmoradims Apr 12, 2019

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1.00 [](start = 22, length = 4)

[optional] can we make it a little harder for the classifier? maybe reduce the label delta from 0.2f to 0.05f or some lower number? #ByDesign

@wschin wschin Apr 12, 2019

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe no? It's super important to show a case where a model works well. This is a motive way to push user to think about feature engineering if my model doesn't work on their case. #Resolved

}
}
}

@shmoradims shmoradims Apr 12, 2019

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

extra line? #ByDesign

@shmoradims shmoradims left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@Ivanidzo4ka

Ivanidzo4ka commented Apr 15, 2019

Copy link
Copy Markdown
Contributor

using System;

Any reason why we don't include this file in csproj? #Resolved


Refers to: docs/samples/Microsoft.ML.Samples/Dynamic/Trainers/BinaryClassification/MultipleFeatureColumnsBinaryClassification.ttinclude:1 in 4b8cd50. [](commit_id = 4b8cd50, deletion_comment = False)

<#+
string ClassName="FieldAwareFactorizationMachine";
string Trainer = @"FieldAwareFactorizationMachine(
// Specify three feature columns!

@Ivanidzo4ka Ivanidzo4ka Apr 15, 2019

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

// Specify three feature columns! [](start = 16, length = 33)

Majestic.
Maybe it's worth to mention what most of the trainers support one feature column, and why person should pass three separate feature columns instead of concat them into one.
Or maybe it's should be part of xml documentation and not related to you PR, what do I know about documentation anyway. #Resolved

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is explained in data generation code.


In reply to: 275450376 [](ancestors = 275450376)

@Ivanidzo4ka Ivanidzo4ka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@wschin

wschin commented Apr 16, 2019

Copy link
Copy Markdown
Contributor Author

using System;

There is no ttinclude in Sample's csproj.


In reply to: 483329386 [](ancestors = 483329386)


Refers to: docs/samples/Microsoft.ML.Samples/Dynamic/Trainers/BinaryClassification/MultipleFeatureColumnsBinaryClassification.ttinclude:1 in 4b8cd50. [](commit_id = 4b8cd50, deletion_comment = False)

@wschin
wschin merged commit 738e5d5 into dotnet:master Apr 16, 2019
@wschin
wschin deleted the tt-ffm branch April 16, 2019 20:24
@ghost ghost locked as resolved and limited conversation to collaborators Mar 22, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

documentation Related to documentation of ML.NET

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants