[Unity][MSC][Tracking Issue] Introduction to Multi-System Compiler

[Archermmt]

• [M0] Build MSCGraph core parts. Enable translation between Relay, Relax and MSCGraph without lossing information.
  • [M0.1] Passes for set name and layout for expressions (src/contrib/msc/transform)
  • [M0.2] MSCGraph core (src/contrib/msc/core/ir/graph && python/tvm/contrib/msc/core/ir/graph)
  • [M0.3] MSCGraph Builder (src/contrib/msc/core/ir/graph_builder)
  • [M0.4] Codegen (src/contrib/msc/core/codegen, src/contrib/msc/framework/tvm/codegen)
  • [M0.5] Translation test (relax/relay test && related helper modules in python)
• [M1] Finish RuntimeManager for relax, and torch, so that a compiling process can be test based on MSCGraph.
  • [M1.1] Add translate && codegen for torch
  • [M1.2] Add translate && codegen for tensorflow
  • [M1.3] Add codegen for tensorrt
  • [M1.4] Add Runner and test with relax
  • [M1.5] Add Runner and test with torch
  • [M1.6] Add Runner and test with tensorflow
  • [M1.7] Add Runner and test with tensorrt
• [M2] Use msc.runtime.Manager to manage the compiling pipeline && tools.
  • [M2.1] Add Manager for compile pipeline
  • [M2.2] Add pruner for model pruning
  • [M2.3] Add tracker for track layer datas
  • [M2.4] Add quantizer for quantize model
• [M3] Add MSCGym, enable auto compression. Add distiller, enable knowledge distilliation.
  • [M3.1] Add distiller for distill model
  • [M3.2] Add gym for pruning and quantization, enable auto prune/quantize
• [M4] Add plugin builder, enable plugin wrap in different frameworks.
  • [M4.1] Add plugin && plugin_builder, enable build and test in different frameworks.
  • [M4.2] Enable plugin with manager, test plugins in compile pipeline.
• [M5] [Optional] Add MSCWrapper as compression toolchain.
  • [M5.1] Build wrapper to support compression
  • [M5.2] Enable quantize && prune with gym by wrapper
  • [M5.3] Support torch.dynamo for dynamic models

cc @quic-sanirudh

[Archermmt]

Intorduction @ https://discuss.tvm.apache.org/t/rfc-unity-msc-introduction-to-multi-system-compiler/15251

[Archermmt]

TODO: add tests for M0.2 after M0.3

[Archermmt]

Discussion on translate relay to relax without loss info: https://discuss.tvm.apache.org/t/msc-translate-relay-to-relax-without-loss-info/15650

[Lunderberg]

I'm somewhat concerned about the relay -> python codegen -> relax code path used in tvm.contrib.msc.framework.torch.frontend.translate.from_torch when via_relax=False. This is a duplication of the serialization/parsing used in TVMScript (tvm.script), and can cause CI failures (e.g #15783) due to this duplication.

While I agree with the need for a operator-level conversion from relay to relax, I think it should be done through extending the existing relax.testing.relay_translator.from_relay converter rather than having an additional python code-generator.