Skip to content

Add VBufferDataFrameCoumn to DataFrame - #6409

Merged
beccamc merged 14 commits into
dotnet:mainfrom
beccamc:u/beccam/vbuffer2
Jan 9, 2023
Merged

Add VBufferDataFrameCoumn to DataFrame#6409
beccamc merged 14 commits into
dotnet:mainfrom
beccamc:u/beccam/vbuffer2

Conversation

@beccamc

@beccamc beccamc commented Oct 25, 2022

Copy link
Copy Markdown
Contributor

Adding VBuffer type to the DataFrame. I modeled this off the of StringDataFrameColumn. I am not sure if a more complex approach is needed for the VBuffer type. An IDataView containing VBuffer type will convert to a DataFrame correctly.

Relevant issue: #5872

Comment thread src/Microsoft.Data.Analysis/IDataView.Extension.cs
@beccamc

beccamc commented Nov 28, 2022

Copy link
Copy Markdown
Contributor Author

@michaelgsharp could I get a review on this? Or @LittleLittleCloud?

@michaelgsharp

Copy link
Copy Markdown
Contributor

@beccamc looking into it now. Trying to figure out why things are failing.

@michaelgsharp

Copy link
Copy Markdown
Contributor

/azp run

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 2 pipeline(s).

@beccamc

beccamc commented Jan 3, 2023

Copy link
Copy Markdown
Contributor Author

/azp run

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 2 pipeline(s).

@beccamc

beccamc commented Jan 4, 2023

Copy link
Copy Markdown
Contributor Author

/azp run

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 2 pipeline(s).

@codecov

codecov Bot commented Jan 9, 2023

Copy link
Copy Markdown

Codecov Report

Merging #6409 (496681e) into main (ce0a5ba) will decrease coverage by 0.01%.
The diff coverage is 59.38%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6409      +/-   ##
==========================================
- Coverage   68.46%   68.44%   -0.02%     
==========================================
  Files        1165     1174       +9     
  Lines      246202   248037    +1835     
  Branches    25558    25909     +351     
==========================================
+ Hits       168550   169772    +1222     
- Misses      70967    71512     +545     
- Partials     6685     6753      +68     
Flag Coverage Δ
Debug 68.44% <59.38%> (-0.02%) ⬇️
production 62.83% <51.82%> (-0.04%) ⬇️
test 88.93% <100.00%> (-0.06%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
src/Microsoft.Data.Analysis/Strings.Designer.cs 42.36% <0.00%> (-0.91%) ⬇️
.../Microsoft.Data.Analysis/VBufferDataFrameColumn.cs 47.48% <47.48%> (ø)
src/Microsoft.Data.Analysis/IDataView.Extension.cs 91.72% <80.85%> (-4.20%) ⬇️
...oft.Data.Analysis.Tests/DataFrameIDataViewTests.cs 100.00% <100.00%> (ø)
...st/Microsoft.Data.Analysis.Tests/DataFrameTests.cs 99.24% <100.00%> (+<0.01%) ⬆️
...icrosoft.ML.FastTree/RandomForestClassification.cs 51.51% <0.00%> (-33.58%) ⬇️
src/Microsoft.ML.TorchSharp/Utils/FileUtils.cs 0.00% <0.00%> (-24.62%) ⬇️
...c/Microsoft.ML.FastTree/Utils/ThreadTaskManager.cs 79.48% <0.00%> (-20.52%) ⬇️
...rc/Microsoft.ML.FastTree/RandomForestRegression.cs 54.14% <0.00%> (-17.29%) ⬇️
...icrosoft.ML.TorchSharp/NasBert/Models/BaseModel.cs 66.66% <0.00%> (-14.92%) ⬇️
... and 76 more

@beccamc
beccamc merged commit 6708456 into dotnet:main Jan 9, 2023
@ghost ghost locked as resolved and limited conversation to collaborators Feb 9, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants