Rui CarmoThat grand, spacious (and long ignored) branch of computing that I never really found a reason to graduate in (big mistake I only realized 30 years later) and that, these days, deals not just with thinking machines (so-called “hard” AI), but mostly with enhancing the usefulness of machines in general by exploring mechanisms to express and manipulate harvested knowledge.
Or just pretty pictures and sophisticated text generation. Either way, it seems we’re currently between AI winters, with a lot of investment in GPU hardware that still needs to prove itself consistently, measurably useful in real life use cases.
Note: Items pertaining to Large Language Models, Agentic Systems, Model Context Protocol, Speech, Stable Diffusion/Image Generation, MLX/Apple Silicon AI, and Embeddings & Vector Search are now in their own section, as this page was getting too crowded. I will be moving other sections out of here as well as they grow over time, so that this page can focus on the more general aspects of AI and ML.
Resources
| Field | Category | Date | Link | Notes |
|---|---|---|---|---|
| Agentic Systems | Tools | 2026 | NIGHTRUN | UEFI-resident boot-to-LLM environment with no operating system underneath |
| General | Examples | 2025 | edgeai-for-beginners | a collection of tutorials and examples for running AI models on edge devices |
| 2024 | flash-attention-minimal | a minimal implementation of Flash Attention | ||
| Frameworks | 2024 | tinygrad | A 8000 LOC deep learning framework | |
| 2023 | marvin | A generic wrapper for various AI APIs | ||
| Gateways | 2026 | GOModel | high-performance AI gateway in Go — unified OpenAI-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI and Ollama with observability and streaming | |
| Jupyter | 2023 | jupyter-ai | an official Jupyter plugin that can handle multiple AI back-ends (although it seems less flexible than the others right now) | |
| Libraries | 2025 | go-attention | a full attention mechanism and transformer in pure Go | |
| 2023 | unstructured | a library for handling and segmenting unstructured data of various kinds, from text to common file formats | ||
| 2020 | TextHero | an NLP library for large-scale text processing | ||
| 2018 | go-neural | neural network in Go | ||
| goml | stream-oriented ML library in Go | |||
| gonn | neural network in Go | |||
| word2vec | word2vec model support in Go | |||
| golearn | a machine learning library for Go | |||
| neurgo | a neural network library in Go | |||
| 2009 | Alchemy | A toolkit providing a series of algorithms for statistical relational learning and probabilistic logic inference, based on Markov logic representation | ||
| discomll | a ML framework for Disco | |||
| Networking | 2024 | scuda | a GPU over IP bridge that allows remote GPUs to be utilized by CPU-only machines | |
| Tools | 2025 | ClaraVerse | a privacy-first local AI workspace (LLM chat, agents, tool calling, automation, image generation) | |
| 2024 | scrape-it-now | A flexible scraper implemented in Azure | ||
| treescope | An interactive tensor visualizer for IPython notebooks. | |||
| pico-tflmicro | a port of TensorFlow Lite Micro to the Raspberry Pi Pico | |||
| 2023 | basaran | An Open-Source alternative to the OpenAI text completion API, with a compatible streaming API for privately hosted models. | ||
| explainerdashboard | a web app that explains the workings of a (scikit-learn compatible) machine learning model | |||
| NVIDIA Triton Inference Server | A high-performance inference server | |||
| 2022 | Project Bumblebee | Pre-trained and transformer neural models in Elixir. | ||
| 2021 | Perceptilabs | free visual ML model creation tool | ||
| 2020 | netron | a viewer for neural network, deep learning and machine learning models | ||
| Large Language Models | Frameworks | 2025 | NLWeb | an approach to make websites easier to integrate into conversational interfaces |
| 2024 | Pathway | a Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG | ||
| Libraries | 2023 | agency | an LLM library for Go | |
| Models | 2026 | MiniCPM | a small on-device LLM with strong performance for its size | |
| Needle | 26M function-call model that runs on incredibly small devices | |||
| Tools | 2026 | PicoLM | a minimal C11 LLM inference engine for GGUF/LLaMA models that streams weights with mmap on low-RAM edge devices | |
| Reame | CPU-first LLM inference server on llama.cpp with disk KV cache and OpenAI-compatible serving | |||
| 2023 | pykoi | a unified interface for data and feedback collection, comparing models, and doing basic RAG | ||
| Multimodal Models | Libraries | 2024 | zerox | a library that performs OCR on documents and converts them to Markdown |
| Models | 2024 | Hybrid-Net | Real-time audio to chords, lyrics, beat, and melody. | |
| Music Generation | 2025 | NotaGen | a tool for generating music from text prompts | |
| Tools | 2024 | swift-ocr-llm-powered-pdf-to-markdown | a tool that processes PDF files into structured Markdown format | |
| Time Series Forecasting | Models | 2025 | moment | a time series forecasting model |
| Tools | Tools | 2026 | PowerInfer | GPU/CPU hybrid LLM inference engine that preloads hot neurons to the GPU, offloads cold states to CPU, and exposes llama.cpp-compatible examples along with PowerInfer GGUF weights and predictor tooling for fast local serving on consumer GPUs. |
| Vision | Libraries | 2025 | grayskull | a lightweight library for vision operations in resource-constrained devices |
| Tools | 2024 | machina | a CCTV viewer that connects to RTSP streams and performs real-time object tagging using YOLO and ollama |