Image featurization - #4
Open
LittleLittleCloud wants to merge 412 commits into
Open
Conversation
* Fix documentation for LightGbm parameter * Brew install libomp 7.0.0 only. (dotnet#3721) * Brew install libomp 7.0.0 only. * Brew install libomp 7.0.0 only. * Brew install libomp 7.0.0 only. * Brew install libomp 7.0.0 only. * Fix documentation for LightGbm parameter
… have WordBagEstimator return transformer chain (dotnet#3700) * Add option to execute only the last transform in TransformWrapper. * PR feedback. * cleanup. * cleanup. * PR feedback. * PR feedback. * PR feedback. * PR feedback. * PR feedback. * PR feedback. * fix paths. * PR feedback. * PR feedback.
…net#3742) * These changes allow for ML.NET to be built from source by VS2019 * Updates to files as per comments on pull request * Add support for x86 since VS 2019 project generator doesn't default to x86 anymore
* Sample of using LoadFromEnumerable with a SchemaDefinition
…net#3745) * Adding samples for data save and load from text and binary files * PR comments * nits
… resulting vector is sparse. (dotnet#3763) * Create indicies array for sparse vector in KeyToValue transfomer only when resulting vector is sparse. * PR feedback. * cleanup. * cleanup. * port changes from PR dotnet#2678.
* Add load names to Platt calibrator * Add unit test
…her in-memory custom types) (dotnet#3263)
…ument (dotnet#3682) * Replace VectorType with VectorDataViewType * Update SchemaComprehension.md Fix some other places to trigger the build.
* Add SrCnn Anomaly Detector * Add core calculation code to SrCnn * Fix implementation bugs * Add test and sample. * Fix commented problems: 1.Add xml to DetectAnomalyBySrCnn; 2.Add default value to DetectAnomalyBySrCnn; 3.Change class name of SrCnnAnomalyDetectionBaseWrapper; 4.fix AlertThreshold write bug; 5.Add check argument part and remove redundent TODOs 6.Fix slot name filling bug. * Fix a predict bug * 1. Fix build fail problem; 2. Improve samples; 3. Minor change to docs * Add document. * Add equations to doc
…et#3805) * API to checkpoint time series model to a stream. * PR feedback.
* Forecasting interface with a unit-test. * Comments. * cleanup. * cleanup. * Internalize forecasting model and expose bare minimum needed and merge from master. * PR feedback. * PR feedback. * PR feedback. * Comments. * Samples. * Samples. * Comments. * Fix sample output. * clean up. * clean up. * docs and cleanup. * typo in doc. * PR feedback.
* Added samples for loading text * Simplification
…otnet#3819) * Add Mkl redist package as dependency to time series package. * PR feedback.
* Bump master to 1.2 and 0.14 and upgrade tensorflow nuget to Release. * Remove tensorflow from release.
* Release notes for 1.1.0 * format. * Release notes for 1.1.0 * Release notes for 1.1.0 * Release notes for 1.1.0 * Release notes for 1.1.0 * update release notes. * update release notes. * update release notes. * samples. * PR feedback. * formatting. * PR feedback. * PR feedback.
* Update release notes. * PR feedback.
* Removed publishing to private feed * Removed commented task that used to publish to myget feed * Fixed typo in OPTOUT variable
* Changed some defaults * Changed metrics callback default * metricsCallback will write to mlcontext log by default. The sample has been update to show how to get the output to console from the log. * deleted unnecessary comments * Addressed comments * Minor clean up. * Disable unstable test.
* Modified how data is saved to disk pre-trained meta files are now stored in one location always, this allows multiple runst to re-use the same meta file without having to redownload. Additionally added the ability to cleanup the temporary workspace used to train the model. This should prevent issues of running out of disk space when running multiple training session sequentially. * fixed extra line error. * changes based on comments. * comment fixes. * address comments. * fixed error * fix for when to download. * Remove special handling of inception as we have fixed the meta file to not have extras that need to be downloaded.
…on API. (dotnet#4430) * Do not pass validation set to Image Classification API. * remove metric callback since it is set to default in ImageClassification Trainer.
… free up unmanaged memory. (dotnet#4438) * Recreate workspace directory when fit() is called, fix documentation, free up unmanaged memory. * PR feedback.
…review. (dotnet#4414) * Bump release version to 1.5.0-preview and preview version to 0.17.0-preview. * disable app compat tool on Microsoft.ML.Vision.
* Upgraded OnnxRuntime to v1.0 and Google Protobuf to 3.10.1 * Fixed version number to 1.0.0 * Changed type checking for ReadOnlyMemory<char> and changed Char to char * Fixed string handling in CreateScalarNamedOnnxValue from code review comments * Disabled GPU codepath for running Onnx models until it is better supported in onnxruntime * Upgraded baseline files to match the new ORT version * Adjusted accuracy range for onnx test
* Aligned line ending to 85 char limit * Cleaned up Early Stopping sample * Added comments to ResnetV2101TransferLearningTrainTestSplit * Added comments to ResnetV2101TransferLearningEarlyStopping * Add comments to ImageClassificationDefault sample * Added comments to LearningRateSchedulingCifarResnetTransferLearning sample * added '.', formatted output. * fixed sample after rebase * fix ealy stopping sample * fix GetAbsolutePath function for samples. * remove unnecessary try catch block from samples. * review comments.
…dotnet#4453) * Increment stable API version and add new stable packages to the list. * Increment stable API version and add new stable packages to the list.
…e same Program.cs file (dotnet#4300) * Adding a Program.cs to ML.Samples.GPU project, different from the one in ML.Samples * Removing the content in the ML.Samples.GPU main method * Put again the original content of Program.cs in the ML.Samples.GPU project. * Remove original Program.cs from Samples.GPU references
* nightly build pipeline
* Stabilize the LR test Found issue with how we were using random for our ImageClassificationTrainer. This caused instability in our unit test, as we were not able to control the random seed. Modified the code to now use the same random object throughout, the trainer, thus allowing us to control the seed and therefor have predictable output.
*Changes in PredictionTransformer.cs and Calibrator.cs to fix the problem of the create methods not being called, to make CMP load its internal calibrator and predictor first so to assign the correct paramaters types and runtimes, and added a PredictionTransformerLoadTypeAttribute so that the binary prediction transformer knows what type to assign when loading a CMP as its internal model. *Added a working sample for using PFI with BPT and CMPB while loading a model from disk. This is based entirely in the original sample. *Added file CalibratedModelParametersTests.cs with tests that the CMPs modified in this PR are now being correctly loaded from disk. *Changed a couple of tests in LbfgsTests.cs that failed because they used casts that now return 'null'.
…actingTransformer (dotnet#4451) * Added onnx export support for string related transforms * Updated baseline test files A large portion of this commit is upgrading the baseline test files. The rest of the fixes deal with build breaks resulting from the upgrade of ORT version. * Fixed bugs in ValueToKeyMappingTransformer and added additional tests
…ig. (dotnet#4465) When we refactored CpuMath to support netcoreapp3.0, we broke the packages.config support to copy the native assembly. This fixes it again by copying the file from the correct location. Fix dotnet#93
…icrosoft.ML.ModelBuilder.AutoMLService.Gpu (dotnet#4474)
…Max (dotnet#4472) * Fixed model saving and loading of OneVersusAllTrainer to include SoftMax * Modified existing test to include SoftMax option * Modified test to verify both cases: when UseSoftmax is true and false
* Initial work for adding onnx export support for OptionalColumnTransform * Implemented support for optional initializers in OnnxTranformer to support OptionalColumnTransform * Fixed handling of double values and non-long numeric types * Removed redundant line * Updated review comment
* Fix a flaky Extensions.ML test. Make the reload model tests more resistant to timing changes. * PR feedback.
…net#4490) * Ignore hidden columns in AutoML schema checks of validation data
LittleLittleCloud
force-pushed
the
ImageFeaturization
branch
from
December 6, 2019 19:11
ebbba51 to
90edc1f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.