Source Caching for Node.js
- Creates v8 cache data for executed javascript files.
- Groups javascript files that are used together. (These groups are called "Voo"s.)
- Stores a cache file into the systems temp directory.
- Puts lazy required files into separate cache files.
- Learns which modules are required conditionally and puts them into separate cache files.
- Improves startup speed of node.js applications after a few runs
The first run captures used modules and source code. It groups modules together. The cache file contains a list of modules with source code.
The second run loads the modules from cache and creates a single source code for all modules of the group. This source code is executed and modules are served from this groups source code. The single source code and v8 cached data is added to the cache file.
The 3rd run loads the single source code and v8 cached data from the cache and restores compiled code from it. This run uses optimized code which was generated on the second run.
Note that code might get reoptimized when captured type info changes. When this happens cache files are updated.
When the process exits, Voos are persisted by a probablilty process until the time limit has reached (default 100ms). The probablilty process ensures that all Voos get eventually persisted without increasing the exit delay too much. As the lifetime of the Voo increases, the probablility of persisting decreases.
Voos are also persisted everytime their lifetime has doubled (minimum 10s, maximum 1h).
require("node-voo");
require("<real-entry>");yarn add node-voo
yarn node-voo --yarn <real-entry> <arguments>-or-
npm install -g node-voo
node-voo --npm <real-entry> <arguments>-or-
yarn global add node-voo
node-voo <real-entry> <arguments>-or-
NODE_OPTIONS="-r node-voo" node <real-entry> <arguments>(*nix only)
-or-
set NODE_OPTIONS=-r node-voo
node <real-entry> <arguments>(windows only, stays active for all futures node calls too)
-or-
export NODE_OPTIONS="-r node-voo"
node <real-entry> <arguments>(*nix only, , stays active for all futures node calls too)
-or-
node -r node-voo <real-entry> <arguments>(doesn't capture child processes)
-or-
npx node-voo <real-entry> <arguments>(npx has a performance overhead)
It's possible to pass options via environment variables:
NODE_VOO_YARN=true: Trustnode_modules/.yarn-integrityto agressively cache resolving and modules in node_modules. Requirements:- Only use Yarn.
- Do not modify files in node_modules manually.
NODE_VOO_NPM=true: Trustpackage-lock.jsonto agressively cache resolving and modules in node_modules. Requirements:- Only use Npm.
- Do not modify files in node_modules manually.
- Do not run node-voo between changes to
package-lock.jsonandnpm i. i. e. when switching branches, etc.
NODE_VOO_LOGLEVEL=warning: Display warnings on console when- cached data was rejected by v8
- not all Voos can be persisted due to time limit
- cache can't be restore due to an error
- cache can't be persisted due to an error
NODE_VOO_LOGLEVEL=info: Display warnings and info on console when- any warning from above occurs
- cache can't be used because source file changed
- cache file was not found and will probably be created
- a unoptimized Voo is restored (including count info)
- a Voo is reorganized due to detected conditional requires
NODE_VOO_LOGLEVEL=verbose: Display warnings and info on console when- any warning or info from above occurs
- a Voo could be reorganized but it's not worth it due to minor difference
- a Voo is restored (including count and size info)
- a Voo is persisted (including count and size info)
- the process exit and all Voos are persisted (including timing info)
NODE_VOO_CACHE_ONLY=true: Always use the cache and never check if real files have changed. Also allows to cache resolving.NODE_VOO_NO_PERSIST=true: Never persist Voos (Use only when cache files already reached the optimum)NODE_VOO_PERSIST_LIMIT=<number>: Time limit in milliseconds, how long node-voo persists Voos on process exitNODE_VOO_CACHE_DIRECTORY: Directory to store cache files. Defaults toNODE_VOO_TEMP_DIRECTORY.NODE_VOO_TEMP_DIRECTORY: Directory to store temporary files. Defaults to os temp directory.
When using the CLI it's also possible to pass some options with argument:
node-voo --yarn=NODE_VOO_YARNnode-voo --npm=NODE_VOO_NPMnode-voo --cache-only=NODE_VOO_CACHE_ONLYnode-voo --no-persist=NODE_VOO_NO_PERSISTnode-voo --warning=NODE_VOO_LOGLEVEL=warningnode-voo --info=NODE_VOO_LOGLEVEL=infonode-voo --verbose=NODE_VOO_LOGLEVEL=verbose
Performance hints:
- Use
yarnresp.npmoptimization viaNODE_VOO_YARNresp.NODE_VOO_NPMto enable caching for resolving. - Code has to run a few times to reach performance optimum.
All examples were run with NODE_VOO_YARN=true NODE_VOO_LOGLEVEL=verbose NODE_OPTIONS=-r .../node-voo/index.js:
> node -e "console.time(); require('eslint'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/eslint/lib/api.js no cache file
default: 459.409ms
[node-voo] .../node_modules/eslint/lib/api.js persisted [unoptimized] 170 modules
[node-voo] 1 Voos persisted in 33ms
> node -e "console.time(); require('eslint'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/eslint/lib/api.js restored [unoptimized] 170 modules
default: 268.427ms
[node-voo] .../node_modules/eslint/lib/api.js persisted [optimized for 133ms] 170 modules 1.8 MiB Source Code 651 kiB Cached Data 220 Resolve Entries
[node-voo] 1 Voos persisted in 83ms
> node -e "console.time(); require('eslint'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/eslint/lib/api.js restored [optimized for 133ms] 170 modules 1.8 MiB Source Code 651 kiB Cached Data 220 Resolve Entries
default: 122.383ms
[node-voo] .../node_modules/eslint/lib/api.js persisted [optimized for 220ms] 170 modules 1.8 MiB Source Code 651 kiB Cached Data 220 Resolve Entries
[node-voo] 1 Voos persisted in 50ms
> node -e "console.time(); require('eslint'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/eslint/lib/api.js restored [optimized for 220ms] 170 modules 1.8 MiB Source Code 651 kiB Cached Data 220 Resolve Entries
default: 123.616ms
> node -e "console.time(); require('eslint'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/eslint/lib/api.js restored [optimized for 220ms] 170 modules 1.8 MiB Source Code 651 kiB Cached Data 220 Resolve Entries
default: 131.611ms
> node -e "console.time(); require('babel-core'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/babel-core/index.js no cache file
default: 901.891ms
[node-voo] .../node_modules/babel-core/index.js persisted [unoptimized] 487 modules
[node-voo] 1 Voos persisted in 53ms
> node -e "console.time(); require('babel-core'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/babel-core/index.js restored [unoptimized] 487 modules
default: 243.541ms
[node-voo] .../node_modules/babel-core/index.js persisted [optimized for 122ms] 487 modules 1.1 MiB Source Code 750 kiB Cached Data 633 Resolve Entries
[node-voo] 1 Voos persisted in 88ms
> node -e "console.time(); require('babel-core'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/babel-core/index.js restored [optimized for 122ms] 487 modules 1.1 MiB Source Code 750 kiB Cached Data 633 Resolve Entries
default: 140.512ms
[node-voo] .../node_modules/babel-core/index.js persisted [optimized for 223ms] 487 modules 1.1 MiB Source Code 750 kiB Cached Data 633 Resolve Entries
[node-voo] 1 Voos persisted in 78ms
> node -e "console.time(); require('babel-core'); console.timeEnd()"
[node-voo] enabled (cache directory: ...)
[node-voo] .../node_modules/babel-core/index.js restored [optimized for 223ms] 487 modules 1.1 MiB Source Code 750 kiB Cached Data 633 Resolve Entries
default: 140.497ms
[node-voo] .../node_modules/babel-core/index.js persisted [optimized for 325ms] 487 modules 1.1 MiB Source Code 750 kiB Cached Data 633 Resolve Entries
[node-voo] 1 Voos persisted in 88ms