Skip to content

Commit

Permalink
Revert "Disable warmup"
Browse files Browse the repository at this point in the history
This reverts commit 21a30be.

See #485
  • Loading branch information
jart committed Jul 4, 2024
1 parent 21a30be commit 1601118
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 5 deletions.
2 changes: 1 addition & 1 deletion llama.cpp/common.h
Original file line number Diff line number Diff line change
Expand Up @@ -171,7 +171,7 @@ struct gpt_params {
bool infill = false; // use infill mode
bool dump_kv_cache = false; // dump the KV cache contents for debugging purposes
bool no_kv_offload = false; // disable KV offloading
bool warmup = false; // warmup run
bool warmup = true; // warmup run
bool check_tensors = false; // validate tensor data

std::string cache_type_k = "f16"; // KV cache data type for the K
Expand Down
4 changes: 0 additions & 4 deletions llamafile/schlep.c
Original file line number Diff line number Diff line change
Expand Up @@ -80,10 +80,6 @@ void llamafile_schlep(const void *data, size_t size) {
if (size < 128 * 1024 * 1024)
return;

// don't bother if we're using a gpu
if (llamafile_has_gpu())
return;

// don't bother if stderr isn't a terminal
if (!isatty(2))
return;
Expand Down

0 comments on commit 1601118

Please sign in to comment.