Coordinating Effort around a community run organization

[boydjohnson]

I was wondering what people thought about making an /rust-onnxruntime organization with some type of maintainers structure. There are several forks with a lot of work on them, and even some crates released with forks. It would be good to consolidate this effort in the same place.

I'm pinging people with long forks that have been recently updated.

@qwerty2501
@xaynetwork
@seddonm1
@EmbarkStudios

[seddonm1]

I would like to upstream my changes if possible as I have focused on implementing io_binding . My fork has changed quite a lot of log levels etc though.

I also had to expose an extra C API method to be able to copy data back from the GPU when io_binding which if we had more users would be easier to convince the onnxruntime team to include

[nbigaouette]

That's a great idea! Sorry I cannot put work on this project, transferring its ownership to an org would certainly make sense.

[boydjohnson]

I have made the rust-onnxruntime organization. https://github.com/rust-onnxruntime. I'm going to wait a little while on this to see if we get more responses.

[seddonm1]

Out of interest, have you reached out to the main https://github.com/microsoft/onnxruntime repository to see if they would consider hosting this code as well?

[regzon]

I use the ONNX Runtime bindings for Rust in my organization quite a lot (with ARM32 and ARM64 devices).
And I'd be happy to help!

[qwerty2501]

I think that is good if it is hosted by microsoft. otherwise I don't feel very interested.
Since Onnxruntime is not in great demand, Maintenance may not be continuous.
And I need onnxruntime's thin wrapper. But this repo is a slightly high level wrapper.
Therefore I guress too difficult to integrate the opinions of the wrapper's direction.

[boydjohnson]

Just giving an update here. Thanks all, for the replies. Looks like the folks behind /microsoft/onnxruntime are interested in hosting the bindings. I'm going to talk to them about logistics next week, and then hopefully make the PR shortly after.

[seddonm1]

Great. Thanks for the update. I would like to merge a lot of the GPU binding work as I am sure it is useful for others 👍

…

On Fri, 8 July 2022, 11:22 am Boyd Johnson, ***@***.***> wrote: Just giving an update here. Thanks all, for the replies. Looks like the folks behind /microsoft/onnxruntime are interested in hosting the bindings. I'm going to talk to them about logistics next week, and then hopefully make the PR shortly after. — Reply to this email directly, view it on GitHub <#112 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AA2O2UCFJWD7ID3JPNAOL33VS57F3ANCNFSM5ZSBZCLQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[boydjohnson]

Just giving another update after I talked with the Microsoft folks. From talking to them, it might be a longer process. The initial PR will be made this month or next. A legal review may need to be made because of licensing issues. When I have my fork of onnxruntime more complete I may ask folks to take a look.

@regzon Those Arm32 and Arm64 bindings that you are using at you company, must be in another fork? If there is a company need we may be able to put them in when I make the PR to onnxruntime.

[qwerty2501]

@boydjohnson Is Microsoft going to make onnxruntime-rs from scratch? Or make it as fork this repo?

[boydjohnson]

@qwerty2501 Fork of this repo.

[regzon]

@regzon Those Arm32 and Arm64 bindings that you are using at you company, must be in another fork? If there is a company need we may be able to put them in when I make the PR to onnxruntime.

Bindings for the ARM64 arch are in the organization's fork. For the ARM32 - they're not tested well, so I didn't publish them.

Regarding the PR - I'll help however I can.

[nbigaouette]

I don't mind transferring the repo to the rust-onnxruntime org but would that help the transition to microsoft? It might help for updating crates.io's version though?

[boydjohnson]

@nbigaouette I think we have settled on microsoft/onnxruntime hosting the bindings and it just might be a slow process.

Just so everyone knows, Microsoft folks said they want to make their own crates.io listing and not use a previous one.