@drupflare/spool - v0.1.0
    Preparing search index...

    Type Alias InferenceFigures

    the per-request cost of a locally served model, above the model-resident idle draw

    type InferenceFigures = {
        cacheHitJoules: Spread;
        cpuJoules: Spread;
        gpuJoules: Spread;
        keepWarmCpuWatts: Spread;
        keepWarmGpuWatts: Spread;
        latencyS: Spread;
        ollamaCpuMs: number;
        originCpuMs: number;
        outputTokens: number;
        rounds: number;
        totalJoules: Spread;
    }
    Index
    cacheHitJoules: Spread

    package joules per request of a cached copy of the same response, above the loaded idle draw

    cpuJoules: Spread
    gpuJoules: Spread
    keepWarmCpuWatts: Spread

    watts a resident model adds to an idle machine

    keepWarmGpuWatts: Spread
    latencyS: Spread

    seconds per request, over every request of every kept round

    ollamaCpuMs: number

    CPU milliseconds the ollama container used per request

    originCpuMs: number

    the origin's own CPU milliseconds per request

    outputTokens: number
    rounds: number
    totalJoules: Spread