Skip to content

@janhq Jan

Change the repository type filter

All

BetaGive feedback

    Repositories list

    39 repositories

    • research

      Public
      Python
      •0•1•6•0•Updated Jul 19, 2024Jul 19, 2024

    • jan

      Public
      Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
      electronself-hostedgptllamacpplocalaillama2
      TypeScript
      •
      GNU Affero General Public License v3.0
      •1.2k•21k•172•8•Updated Jul 19, 2024Jul 19, 2024

    • cortex

      Public
      Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan
      aicudallamaacceleratedinference-engineopenai-apillmstable-diffusionllmsllamacpp
      C++
      •
      Apache License 2.0
      •98•1.8k•49•7•Updated Jul 19, 2024Jul 19, 2024

    • homebrew.ltd

      Public
      Homebrew Website
      MDX
      •
      Apache License 2.0
      •0•0•0•0•Updated Jul 19, 2024Jul 19, 2024

    • cortex.so

      Public
      TypeScript
      •1•2•10•2•Updated Jul 19, 2024Jul 19, 2024

    • cortex.tensorrt-llm

      Public
      Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.
      nvidiajantensorrtllmtensorrt-llm
      C++
      •
      Apache License 2.0
      •822•32•13•5•Updated Jul 19, 2024Jul 19, 2024

    • cortex.llamacpp

      Public
      cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server at runtime.
      C++
      •
      GNU Affero General Public License v3.0
      •3•4•8•4•Updated Jul 18, 2024Jul 18, 2024

    • research-utils

      Public
      Python
      •0•0•0•0•Updated Jul 18, 2024Jul 18, 2024

    • llama3-s

      Public
      Training sound instruct llama3
      0•0•3•2•Updated Jul 18, 2024Jul 18, 2024

    • docs

      Public
      Jan.ai Website & Documentation
      websitedocumentationself-hostedjanapi-referencelocalai
      MDX
      •6•16•52•4•Updated Jul 15, 2024Jul 15, 2024

    • cortex-node

      Public
      The official Node.js / Typescript library for the OpenAI API
      TypeScript
      •
      Apache License 2.0
      •771•1•0•6•Updated Jul 12, 2024Jul 12, 2024

    • cortex.audio

      Public
      C++
      •0•0•0•0•Updated Jul 9, 2024Jul 9, 2024

    • homebrew-cortexso

      Public
      Ruby
      •0•0•0•0•Updated Jul 5, 2024Jul 5, 2024

    • cortex.onnx

      Public
      C++
      •0•1•2•1•Updated Jul 3, 2024Jul 3, 2024

    • ppa

      Public
      GNU Affero General Public License v3.0
      •0•0•0•0•Updated Jun 27, 2024Jun 27, 2024

    • awesome-local-ai

      Public
      An awesome repository of local AI tools
      87•1.1k•6•4•Updated Jun 21, 2024Jun 21, 2024

    • cortex.python

      Public
      C++ code that run Python embedding
      C++
      •
      GNU Affero General Public License v3.0
      •0•4•1•0•Updated May 23, 2024May 23, 2024

    • cortex-python

      Public
      The official Python library for the OpenAI API
      Python
      •
      Apache License 2.0
      •2.9k•1•0•1•Updated May 20, 2024May 20, 2024

    • pymaker

      Public
      Make the py
      0•0•0•0•Updated Apr 9, 2024Apr 9, 2024

    • tensorrtllm_backend

      Public
      The Triton TensorRT-LLM Backend
      Python
      •
      Apache License 2.0
      •86•0•0•0•Updated Mar 19, 2024Mar 19, 2024

    • triton_tensorrt_llm

      Public
      Shell
      •0•1•0•0•Updated Mar 15, 2024Mar 15, 2024

    • openai_trtllm

      Public
      OpenAI compatible API for TensorRT LLM triton backend
      Rust
      •
      MIT License
      •22•0•0•0•Updated Mar 15, 2024Mar 15, 2024

    • trt-llm-as-openai-windows

      Public
      This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
      Python
      •
      Other
      •11•0•0•0•Updated Mar 8, 2024Mar 8, 2024

    • open-foundry

      Public
      R&D experiments
      Jupyter Notebook
      •
      GNU Affero General Public License v3.0
      •1•1•0•0•Updated Mar 1, 2024Mar 1, 2024

    • architecture

      Public
      1•1•0•0•Updated Feb 28, 2024Feb 28, 2024

    • charts

      Public
      This repository contains helm chart for our team
      Smarty
      •0•0•0•0•Updated Feb 20, 2024Feb 20, 2024

    • llama.cpp-avx-vnni

      Public
      Port of Facebook's LLaMA model in C/C++
      C++
      •
      MIT License
      •8.9k•0•0•0•Updated Feb 19, 2024Feb 19, 2024

    • infinity

      Public
      The AI-native database built for LLM applications, providing incredibly fast vector and full-text search
      C++
      •
      Apache License 2.0
      •176•0•0•0•Updated Feb 19, 2024Feb 19, 2024

    • langchainjs

      Public
      TypeScript
      •
      MIT License
      •2k•0•0•0•Updated Feb 19, 2024Feb 19, 2024

    • plugin-catalog

      Public
      JavaScript
      •
      MIT License
      •1•0•0•0•Updated Jan 17, 2024Jan 17, 2024