System Information (please complete the following information):
- Model Builder Version (available in Manage Extensions dialog): 16.13.1.2210302
- Visual Studio Version: Microsoft Visual Studio Community 2022 (64-bit) - Current Version 17.1.1
Describe the bug
- On which step of the process did you run into an issue: Training
- Clear description of the problem: Exception in Microsoft.ML.Transforms.RowShufflingTransformer.Cursor.MoveNextCore() when data input is a SQL server, and the choosen Table actually is a SQL server view. The SQL server view selects (all) columns from a single table, just renaming two columns of type String (from Key to ContainerKey and Type to ContainerType)
To Reproduce
Steps to reproduce the behavior:
- Create new console app project.
- Add ML.Net Model builder
- Choose Data Classification seneario
- Enviroment is Local CPU
- Data input is SQL server, some DB view with two renamed columns (from Key to ContainerKey and Type to ContainerType)
- Some other column selected to predict
- Data Preview shows ok 10 rows of 39.985
- Choose Time to train = 60 sec
- Press Start training button
- Error message "Shuffle input cursor reader failed with an exception'" and stack dump shows up
- Pressing Start traning again actually will let the training run. In the loop an error message are written in Output pane: "Trial 689 encounter error with message: Read only 0 bytes in file, expected header size of 256"
- After loop ends an Error message dialog are shown: Training time finished without any models trained.
Expected behavior
Training runnig for 60 seconds. Producing a trained model.
Additional context
ML Model log file
2022-03-17 14:28:23.3141 INFO Set log file path to C:\Users\kbl\AppData\Local\Temp\MLVSTools\logs\MLModel1-2FCBTX.txt (Microsoft.ML.ModelBuilder.Utils.Logger.Info)
2022-03-17 14:29:16.8359 INFO start nni training (Microsoft.ML.ModelBuilder.Utils.Logger.Info)
2022-03-17 14:29:16.8479 INFO Experiment output folder: C:\Users\kbl\AppData\Local\Temp\AutoML-NNI\Experiment-1C6Y0N (Microsoft.ML.ModelBuilder.Utils.Logger.Info)
2022-03-17 14:29:16.8479 DEBUG row count is unknown, count it explicitly (Microsoft.ML.ModelBuilder.Utils.Logger.Debug)
2022-03-17 14:29:17.3847 DEBUG count elapse 535ms (Microsoft.ML.ModelBuilder.Utils.Logger.Debug)
2022-03-17 14:29:17.3847 INFO | Trainer MicroAccuracy MacroAccuracy Duration #Iteration | (Microsoft.ML.ModelBuilder.Utils.Logger.Info)
2022-03-17 14:29:17.5989 DEBUG Shuffle input cursor reader failed with an exception
at Microsoft.ML.Transforms.RowShufflingTransformer.Cursor.MoveNextCore()
at Microsoft.ML.Data.RootCursorBase.MoveNext()
at Microsoft.ML.Data.LinkedRowFilterCursorBase.MoveNextCore()
at Microsoft.ML.Data.RootCursorBase.MoveNext()
at Microsoft.ML.Data.IO.BinarySaver.RowsPerBlockHeuristic(IDataView data, ColumnCodec[] actives)
at Microsoft.ML.Data.IO.BinarySaver.SaveData(Stream stream, IDataView data, Int32[] colIndices)
at Microsoft.ML.Data.DataSaverUtils.SaveDataView(IChannel ch, IDataSaver saver, IDataView view, Stream stream, Boolean keepHidden)
at Microsoft.ML.BinaryLoaderSaverCatalog.SaveAsBinary(DataOperationsCatalog catalog, IDataView data, Stream stream, Boolean keepHidden)
at Microsoft.ML.ModelBuilder.AutoMLService.Proposer.ResampleStrategyProposer.Initialize(String outputFolder) in //src/Microsoft.ML.ModelBuilder.AutoMLService/Proposer/ResampleStrategyProposer.cs:line 97
at Microsoft.ML.ModelBuilder.AutoMLService.Proposer.ResampleStrategyProposer.Propose(TrialParameter trialParameter) in //src/Microsoft.ML.ModelBuilder.AutoMLService/Proposer/ResampleStrategyProposer.cs:line 59
at Microsoft.ML.ModelBuilder.AutoMLService.Proposer.Controller.Propose() in //src/Microsoft.ML.ModelBuilder.AutoMLService/Proposer/Controller.cs:line 66
at Microsoft.ML.ModelBuilder.AutoMLService.Experiments.LocalAutoMLExperiment.d__15.MoveNext() in //src/Microsoft.ML.ModelBuilder.AutoMLService/Experiments/LocalAutoMLExperiment.cs:line 163
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.ML.ModelBuilder.AutoMLEngine.d__21.MoveNext() in //src/Microsoft.ML.ModelBuilder.AutoMLService/AutoMLEngineService/AutoMLEngine.cs:line 160 (Microsoft.ML.ModelBuilder.Utils.Logger.Debug)
System Information (please complete the following information):
Describe the bug
To Reproduce
Steps to reproduce the behavior:
Expected behavior
Training runnig for 60 seconds. Producing a trained model.
Additional context
ML Model log file
2022-03-17 14:28:23.3141 INFO Set log file path to C:\Users\kbl\AppData\Local\Temp\MLVSTools\logs\MLModel1-2FCBTX.txt (Microsoft.ML.ModelBuilder.Utils.Logger.Info)
2022-03-17 14:29:16.8359 INFO start nni training (Microsoft.ML.ModelBuilder.Utils.Logger.Info)
2022-03-17 14:29:16.8479 INFO Experiment output folder: C:\Users\kbl\AppData\Local\Temp\AutoML-NNI\Experiment-1C6Y0N (Microsoft.ML.ModelBuilder.Utils.Logger.Info)
2022-03-17 14:29:16.8479 DEBUG row count is unknown, count it explicitly (Microsoft.ML.ModelBuilder.Utils.Logger.Debug)
2022-03-17 14:29:17.3847 DEBUG count elapse 535ms (Microsoft.ML.ModelBuilder.Utils.Logger.Debug)
2022-03-17 14:29:17.3847 INFO | Trainer MicroAccuracy MacroAccuracy Duration #Iteration | (Microsoft.ML.ModelBuilder.Utils.Logger.Info)
2022-03-17 14:29:17.5989 DEBUG Shuffle input cursor reader failed with an exception
at Microsoft.ML.Transforms.RowShufflingTransformer.Cursor.MoveNextCore()
at Microsoft.ML.Data.RootCursorBase.MoveNext()
at Microsoft.ML.Data.LinkedRowFilterCursorBase.MoveNextCore()
at Microsoft.ML.Data.RootCursorBase.MoveNext()
at Microsoft.ML.Data.IO.BinarySaver.RowsPerBlockHeuristic(IDataView data, ColumnCodec[] actives)
at Microsoft.ML.Data.IO.BinarySaver.SaveData(Stream stream, IDataView data, Int32[] colIndices)
at Microsoft.ML.Data.DataSaverUtils.SaveDataView(IChannel ch, IDataSaver saver, IDataView view, Stream stream, Boolean keepHidden)
at Microsoft.ML.BinaryLoaderSaverCatalog.SaveAsBinary(DataOperationsCatalog catalog, IDataView data, Stream stream, Boolean keepHidden)
at Microsoft.ML.ModelBuilder.AutoMLService.Proposer.ResampleStrategyProposer.Initialize(String outputFolder) in //src/Microsoft.ML.ModelBuilder.AutoMLService/Proposer/ResampleStrategyProposer.cs:line 97
at Microsoft.ML.ModelBuilder.AutoMLService.Proposer.ResampleStrategyProposer.Propose(TrialParameter trialParameter) in //src/Microsoft.ML.ModelBuilder.AutoMLService/Proposer/ResampleStrategyProposer.cs:line 59
at Microsoft.ML.ModelBuilder.AutoMLService.Proposer.Controller.Propose() in //src/Microsoft.ML.ModelBuilder.AutoMLService/Proposer/Controller.cs:line 66
at Microsoft.ML.ModelBuilder.AutoMLService.Experiments.LocalAutoMLExperiment.d__15.MoveNext() in //src/Microsoft.ML.ModelBuilder.AutoMLService/Experiments/LocalAutoMLExperiment.cs:line 163
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.ML.ModelBuilder.AutoMLEngine.d__21.MoveNext() in //src/Microsoft.ML.ModelBuilder.AutoMLService/AutoMLEngineService/AutoMLEngine.cs:line 160 (Microsoft.ML.ModelBuilder.Utils.Logger.Debug)