Open
Description
In order to achieve thread-safety and allow multiple processes to simultaneously create subjective evaluations, the client and server code should be separated into a new cache. We don't want to create a random cache directory, as we would have to npm install every time we create. Instead, default to using the same cache as the credentials and evaluations. Allow the user to provide a cache directory for creation (and just creation).
If we want to make local development thread-safe as well, we need to decide how to assign unique ports. The user may have to provide the port.