Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llminference
Follow
Hide
Posts
Left menu
๐
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Qwen 3.6 enable_thinking โ The MoE Pitfall That Broke My Agent JSON Parsing
SleepyQuant
SleepyQuant
SleepyQuant
Follow
May 18
Qwen 3.6 enable_thinking โ The MoE Pitfall That Broke My Agent JSON Parsing
#
qwen
#
mlx
#
localai
#
llminference
Comments
Addย Comment
5 min read
Multiple Independent Questions: Batch Into One Request or Split Into Many? โ An Analysis of LLM Concurrent Processing
eyanpen
eyanpen
eyanpen
Follow
May 3
Multiple Independent Questions: Batch Into One Request or Split Into Many? โ An Analysis of LLM Concurrent Processing
#
llminference
#
autoregressivegeneration
#
parallelrequests
#
continuousbatching
Comments
Addย Comment
5 min read
๐
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account