Medium / Medium.com

LLaVA-Phi: Related Work to Get You Caught Up #llms #gemini #gemininano #llavaphi #mobilevlm #blipfamily #llavafamily #mideagroup https://hackernoon.com/llava-phi-related-work-to-get-you-caught-up

How vLLM Prioritizes a Subset of Requests #llms #vllm #pagedattention #gpumemory #cpuram #woosukkwon #zhuohanli #siyuanzhuang https://hackernoon.com/how-vllm-prioritizes-a-subset-of-requests

The Distributed Execution of vLLM #llms #vllm #megatronlm #memorymanager #spmd #modelparallel #kvcachemanager #kvcache https://hackernoon.com/the-distributed-execution-of-vllm

LLaVA-Phi: The Training We Put It Through #llms #llavaphi #clipvitl #llava15 #phi2 #supervisedfinetuning #sharegpt #trainingllavaphi https://hackernoon.com/llava-phi-the-training-we-put-it-through

How vLLM Implements Decoding Algorithms #llms #vllm #decodingalgorithm #algorithms #endtoendservingsystem #gpubasedinference #cuda #python https://hackernoon.com/how-vllm-implements-decoding-algorithms

How Cross-Chain Transfer Protocols Ensure Safe and Smooth Transactions #defi #crosschainoptions #collateralfreeprotocol #blockchaininteroperability #efficientoptiontrading #phantombidattackdefense #hashedtimelockcontracts #optionstrading https://hackernoon.com/how-cross-chain-transfer-protocols-ensure-safe-and-smooth-transactions

How Blockchain Contracts Ensure Fairness, Flexibility, and Compensation for Option Holders #defi #crosschainoptions #collateralfreeprotocol #blockchaininteroperability #efficientoptiontrading #phantombidattackdefense #hashedtimelockcontracts #optionstrading https://hackernoon.com/how-blockchain-contracts-ensure-fairness-flexibility-and-compensation-for-option-holders

Memory Challenges in LLM Serving: The Obstacles to Overcome #llms #llmserving #memorychallenges #kvcache #llmservice #gpumemory #algorithms #decoding https://hackernoon.com/memory-challenges-in-llm-serving-the-obstacles-to-overcome

The HackerNoon Newsletter: Will AI Widen Global Inequality? (12/28/2024) #hackernoonnewsletter #noonification #latesttectstories #opensource #lifehacking #personalgrowth #ai https://hackernoon.com/12-28-2024-newsletter

PagedAttention: Memory Management in Existing Systems #llms #pagedattention #memorymanagement #kv #kvcache #llmservingsystem #memory #llmmemorymanagement https://hackernoon.com/pagedattention-memory-management-in-existing-systems

Our Method for Developing PagedAttention #llms #pagedattention #vllm #llmservingengine #kvcache #memorymanagement #memorychallenges #kvblocks https://hackernoon.com/our-method-for-developing-pagedattention

KV Cache Manager: The Key Idea Behind It and How It Works #llms #pagedattention #kvcachemanager #kvcache #vllm #virtualmemory #kvblocks #gpuworkers https://hackernoon.com/kv-cache-manager-the-key-idea-behind-it-and-how-it-works

Introducing LLaVA-Phi: A Compact Vision-Language Assistant Powered By a Small Language Model #llms #llavaphi #largevisionlanguagemodels #llavaphi3b #mideagroup #yichenzhu #minjiezhu #ningliu https://hackernoon.com/introducing-llava-phi-a-compact-vision-language-assistant-powered-by-a-small-language-model

Decoding With PagedAttention and vLLM #llms #vllm #pagedattention #decoding #whatisvllm #kvblocks #kvcache #woosukkwon https://hackernoon.com/decoding-with-pagedattention-and-vllm