
How a Go Rewrite Made Our WebSocket Proxy 100x More Efficient
Rewriting a Python WebSocket proxy in Go with lock-free connection pooling and event-driven reconciliation
VoicePing benchmarks, methodology, model evaluations, and product research.
50 articles

Rewriting a Python WebSocket proxy in Go with lock-free connection pooling and event-driven reconciliation

How we improved vLLM inference throughput by 82% using AsyncLLMEngine and right-sized continuous batching
Identifying architectural bottlenecks in FastAPI + multiprocessing setup preventing efficient GPU utilization

Building a video preprocessing pipeline for facial analysis, pose estimation, and emotion detection

September 2024 - Development of an efficient async web crawler using Python, aiohttp, and BeautifulSoup for large-scale data collection

Fine-tuning Llama 3.1 for Chinese-to-English translation with hallucination mitigation strategies
Experience communication beyond language barriers with real-time voice translation
Get Started Free