Discussions

• 1 You must be logged in to vote

  💬

  Language Restriction for LLM Outputs

  yileitu started Jul 13, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to use this with hugging face API?

  michael-newsrx asked Jun 27, 2024 in Q&A · Closed · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does guidance need an API endpoint that supports streaming?

  afg1 asked Jun 24, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  Enable chat completition/embeddings Openai Endpoint in Guidance Server

  doomgrave started Jun 23, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💬

  I have an issue when loading a Qwen chat model with LlamaCpp

  Abdechakour-Mc started Jun 21, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Help needed using Select Object

  mbilalazeem asked Jun 19, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙌

  Terminal output color and streaming!

  dimondjik started May 22, 2024 in Show and tell

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Comparison between Guidance and AICI

  rudrOwO asked Jun 2, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Token healing?

  yonitjio asked Apr 11, 2024 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  What's going on under the hood?

  rudrOwO asked May 31, 2024 in Q&A · Unanswered

  

  

  3
• 2 You must be logged in to vote

  🙏

  Raw BNF grammars instead of Guidance grammar DSL

  lemontheme asked May 3, 2024 in Q&A · Unanswered

  

  

  

  

  7
• 2 You must be logged in to vote

  💡

  Why is there no support for top-p / top-k ?

  DanJbk started Jan 20, 2024 in Ideas

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Is there support for mamba-based models, or am I doing something wrong?

  zvxayr asked May 1, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  TypeError with ModelStream Object in Python

  snowyday asked May 9, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  I keep getting <|eot_id|> or </s> in my outputs when using chat mode for llama-3-8b-instruct and mistral-7b-instruct.

  michael-newsrx asked Apr 30, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙌

  Guidance called from Chainlit

  snowyday started May 5, 2024 in Show and tell

  

  

  0
• 4 You must be logged in to vote

  🙏

  Using models locally via Ollama.ai

  JanMP asked Aug 20, 2023 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  Guaranteeing valid output syntax with API based models

  woolr asked Apr 4, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Can guidance be used on custom models or NVIDIA NEMO model ?

  tcourat asked Apr 5, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  Multiple calls optimization using Guidance

  FrankP89 started Mar 31, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙌

  Reimplementing regex grammars with finite state machines

  hudson-ai started Mar 15, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  🙏

  I'm trying to load mixtral-8x7b-instruct-v0.1.Q6_K.gguf but I'm getting an initialization error?

  michael-conrad asked Mar 14, 2024 in Q&A · Answered

  

  

  1
• 3 You must be logged in to vote

  🙏

  What is the best practice to extract JSON from the guidance output?

  aeft asked Jan 15, 2024 in Q&A · Answered

  

  

  

  

  4
• 2 You must be logged in to vote

  🙌

  Blog post on regex constraint decoding

  vivien000 started Feb 23, 2024 in Show and tell

  

  

  1
• 2 You must be logged in to vote

  🙏

  How do generate a list of variable length where each element follows a regex

  prnvbn asked Dec 19, 2023 in Q&A · Closed · Answered

  

  

  

  

  4