PythonHub

You Should Probably Pay Attention to Tokenizers This article emphasizes the importance of understanding tokenizers in AI applications, particularly for Retrieval-augmented generation (RAG) systems. The author demonstrates how different tokenizers handle various types of text input, including emojis and misspelled words, and explains how tokenization affects embedding quality and overall performance in natural language processing tasks. https://cybernetist.com/2024/10/21/you-should-probably-pay-attention-to-tokenizers/

Python Hub Weekly Digest for 2024-11-03 https://pythonhub.dev/digest/2024-11-03/

We're thinking of rewriting our go / java API in python, what do we need to think about? https://www.reddit.com/r/Python/comments/1gdavp9/were_thinking_of_rewriting_our_go_java_api_in/

meta-llama / llama-stack-apps Agentic components of the Llama Stack APIs https://github.com/meta-llama/llama-stack-apps

Async Rate Limiter Rate limit async requests to API using credits, computation unit per second (CUPS) or request units https://github.com/Elnaril/credit-rate-limit

BitNet Official inference framework for 1-bit LLMs. https://github.com/microsoft/BitNet

meme_search Index your memes by their content and text, making them easily retrievable for your meme warfare pleasures. Find funny fast. https://github.com/neonwatty/meme_search

ClickHouse User Defined Table Function in Python https://github.com/auxten/SQL-On-Everything

mini-omni2 Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities. https://github.com/gpt-omni/mini-omni2

Replacing Callbacks with Generators: A Case Study in Computer-Assisted Live Music Watch how Matthieu Amiguet transforms a complex callback mess into a readable and efficient system using generators in computer-assisted live music. https://www.youtube.com/watch?v=PkAE6dsqIJw

BugGPT LLM powered vulnerable web page generator for testing and educational purposes. https://github.com/Trivulzianus/BugGPT

Python and Sigstore Seth Larson discusses the implementation of Sigstore in Python, highlighting its benefits for software supply chain security and its integration into CPython's release process. He explains how Sigstore improves upon traditional GPG signatures by providing transparency, ease of use, and better security practices, while also detailing the challenges and future plans for Sigstore adoption i... https://sethmlarson.dev/python-and-sigstore

The Stacktrace Puzzle Explore how Python stacktraces with chained exceptions can become confusing puzzles and solve a few puzzles of your own. https://www.bugsink.com/blog/chained-stacktraces-puzzle/

Why people still using flask after fastapi release https://www.reddit.com/r/Python/comments/1g83rjr/why_people_still_using_flask_after_fastapi_release/

15 Powerful Python Libraries You Should Be Using In this video, 15 impressive Python libraries are showcased that everyone should know about. Whether for data scientists or backend developers, many of these packages will prove to be very useful. https://www.youtube.com/watch?v=OiLgG4CabPo

Hallo2 Long-Duration and High-Resolution Audio-driven Portrait Image Animation. https://github.com/fudan-generative-vision/hallo2

Finstruments - Financial instrument library built with Python https://github.com/kyleloomis/finstruments

zerox Zero shot pdf OCR with gpt-4o-mini. https://github.com/getomni-ai/zerox

Creating a DType for the Next Generation of Scientific Computing From no CPython C API experience to shipping a new DType in NumPy 2.0. https://quansight.com/post/my-numpy-year-creating-a-dtype-for-the-next-generation-of-scientific-computing/

Django and htmx Tutorial: Easier Web Development Christopher Trudeau demonstrates how htmx can add dynamic features like lazy loading and search-as-you-type to Django applications with minimal JavaScript. The tutorial showcases htmx's integration with Django, allowing more server-side logic and potentially better performance compared to traditional single-page applications. https://www.youtube.com/watch?v=i1eMxu_PR5Y