A workspace by @danniesim while working with the Wellcome Collection Digital Platform and Machine Learning team.
This workspace is meant to be used with VS Code.
The source of the wc_simd Python package is found in src/wc_simd
I use UV for Python dependency management, you may install it with this line curl -LsSf https://astral.sh/uv/install.sh | sh.
To be able to import the wc_simd module from code and install Python dependencies, run: uv sync from the repo root.
If requirements.txt is needed, run: uv run pip freeze > requirements.txt
Explorations and experiments found in notebooks.
Bespoke data files are placed in data. Files that can be imported from other sources are found in data/imports. See: Data Import Index
See this
I use pytest for testing. Tests can be found in tests.
I use LTeX and Markdown Lint to keep my docs and comments sane. Here are my recommended VS Code extensions
This VS Code workspace can be run on a remote EC2 instance. I use a c5.4xlarge instance.
Typically, long-running jobs can be run with screen which will continue running programs started on the command line even if the SSH connection is gone.
Once reconnected via SSH, we can retrieve the terminal running the program with screen -R. List all terminals with screen -list.
sudo apt install clang