I want to integrate tvm with brpc. As far as I know, the graph executor is not thread-safety. So I created n executor in concurrent queue https://gist.github.com/lyqscmy/3251452fad17f09cd6983925ab39803b. When I request the server in serial, it’s very slow but works. But when I try https://github.com/brpc/brpc/blob/master/docs/cn/rpc_press.md, the server core dump.
Thanks for pointing this out. This is something we need to fix. This could still due to multiple threads running the tvm functions