首页 文章

asyncio与同步代码

提问于
浏览
0

我有一个模块,它阻止网络请求到某个TCP服务器并接收响应 . 我必须将它集成到asyncio应用程序中 . 我的模块看起来像这样:

import socket

# class providing transport facilities
# can be implemented in any manner
# for example it can manage asyncio connection
class CustomTransport:
    def __init__(self, host, port):
        self.sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
        self.host = host
        self.port = port

    def write(self, data):
        left = len(data)
        while left:
            written = self.sock.send(data.encode('utf-8'))
            left = left - written
            data = data[written:]

    def read(self, sz):
        return self.sock.recv(sz)

    def open(self):
        self.sock.connect((self.host, self.port))

    def close(self):
        self.sock.shutdown(2)


# generated. shouldn't be modified
# however any transport can be passed
class HelloNetClient:
    def __init__(self, transport):
        self.transport = transport

    def say_hello_net(self):
        self.transport.write('hello')
        response = self.transport.read(5)
        return response


# can be modified
class HelloService:
    def __init__(self):
        # create transport for connection to echo TCP server
        self.transport = CustomTransport('127.0.0.1', 6789)
        self.hello_client = HelloNetClient(self.transport)

    def say_hello(self):
        print('Saying hello...')
        return self.hello_client.say_hello_net()

    def __enter__(self):
        self.transport.open()
        return self

    def __exit__(self,exc_type, exc_val, exc_tb):
        self.transport.close()

用法:

def start_conversation():
    with HelloService() as hs:
        answer = hs.say_hello()
        print(answer.decode('utf-8'))


if __name__ == "__main__":
    start_conversation()

现在我看到只有将我的模块与 asyncio 兼容的方法是将所有内容转换为协同程序并用asyncio提供的传输替换常规套接字 . 但我不想触摸生成的代码(HelloNetClient) . 可能吗?

附:我希望它像这样使用:

async def start_conversation():
    async with HelloService() as hs:
        answer = await hs.say_hello()
        print(answer.decode('utf-8'))


if __name__ == "__main__":
    loop = asyncio.get_event_loop()
    loop.run_until_complete(start_conversation())

1 回答

  • 0

    HelloService 可能需要使用 run_in_executor (管理线程池)在后台运行 HelloNetClient 方法 . 例如:

    async def say_hello(self):
        print('Saying hello...')
        loop = asyncio.get_event_loop()
        return await loop.run_in_executor(self.hello_client.say_hello_net)
    

    这不是asyncio的习惯用法,并且您能够创建数千个并行工作的客户端,并且您无法获得可靠的取消(能够完成您希望的任何任务) . 尽管如此,简单的使用将很好地工作 .

    不幸的是,提供自定义传输的能力在这里没有帮助,因为中间层 HelloNetClient 期望同步行为 . 即使你要编写一个挂钩到asyncio的自定义传输,像 say_hello_net 这样的方法仍会等待响应到达所需的时间,因此 HelloService 必须在单独的线程中安排它们 . 因此,最好的办法是使用默认传输,并使用asyncio将代码与服务中的代码相连,如上所示 .

相关问题