I've been digging in Cortex, just storing this for later ref:
- Locking object allowing for write once, read many operations
- LockedModel - For granting shared/exclusive (R/W) access to a model resource (model name + model version). Also applies global read lock on the models holder
Also dumping a lot of info on async, asyncio, run_in_threadpool, shared objects in FastAPI
- Best method for modifying global shared object safely - no answer :(
- Sync and Async issues
- Concurrency and async / await in FastAPI
- When you declare a path operation function with normal def instead of async def, [it is r