All issues

Search results

📋 Documentation Enhancement Suggestion

Status: Open.

#319 In turboderp/exllama;

· croviatrust opened on Mar 16, 2026

Beating the (probably dead) Metal horse

Status: Open.

#318 In turboderp/exllama;

· bleedingedgedebian opened on Apr 4, 2025

Run on CPU without AVX2

Status: Open.

#315 In turboderp/exllama;

· ZanMax opened on Apr 14, 2024

piece id is out of range

Status: Open.

#314 In turboderp/exllama;

· chethanwiz opened on Apr 9, 2024

When will the bfloat16 type of GPTQ algorithm be supported?

Status: Open.

#310 In turboderp/exllama;

· Kelang-Tian opened on Dec 20, 2023

Does it support safetytensor formate?>

Status: Open.

#309 In turboderp/exllama;

· lucasjinreal opened on Nov 28, 2023

Error when using Beam Search

Status: Open.

#308 In turboderp/exllama;

· bibekyess opened on Nov 17, 2023

Occasionally RuntimeError

Status: Open.

#307 In turboderp/exllama;

· leegohi04517 opened on Nov 16, 2023

Using Exllama backend requires all the modules to be on GPU - how?

Status: Open.

#306 In turboderp/exllama;

· tigerinus opened on Nov 6, 2023

Changing hyper-parameters after initilization without reloading weights from disk.

Status: Open.

#299 In turboderp/exllama;

· kmccleary3301 opened on Sep 28, 2023

doesn't use CUDA_HOME?

Status: Open.

#293 In turboderp/exllama;

· j2l opened on Sep 20, 2023

OSError: CUDA_HOME environment variable is not set.

Status: Open.

#291 In turboderp/exllama;

· jamesbraza opened on Sep 17, 2023