edge-computing

Tag

Cards List
#edge-computing

Where does local AI need to improve on before it has a broader appeal?

Reddit r/LocalLLaMA ↗ · yesterday

A community discussion asking what local AI models must improve on—intelligence, accessibility, or fitting more capable models into smaller hardware—to gain broader appeal, with the poster suggesting local models could complement rather than replace frontier models like Claude.

0 favorites 0 likes
#edge-computing

Pete warden on local AI, open models, voice interfaces, the future of hardware

Hacker News Top ↗ · 2d ago Cached

Podcast episode featuring Pete Warden, co-creator of Moonshine Voice, discussing why AI is shifting to on-device execution, progress in open-weight and quantized models, low-latency voice interfaces, and hardware alternatives to GPU-centric infrastructure.

0 favorites 0 likes
#edge-computing

@HeLi8866: Holy shit! Is this open-source project from Microsoft about to rewrite the rules of the AI industry!?! The project is called bitnet.cpp, and at its core, it uses 1.58-bit ternary quantization to turn massive floating-point computations in large models directly into the integer addition and subtraction that CPUs do best. The result: · On x86 CPUs, inference spee…

X AI KOLs Timeline ↗ · 2d ago Cached

Microsoft’s open-source bitnet.cpp project uses 1.58-bit ternary quantization to convert large models’ floating-point operations into integer operations on CPUs, achieving up to 6.17× faster inference and an 82% reduction in energy consumption on x86 and ARM CPUs, enabling personal devices to run models with hundreds of billions of parameters offline.

0 favorites 0 likes
#edge-computing

Label-Free Role-Aware Segmentation of Classroom Recordings: Recovering the Teacher from Transferable Structure

arXiv cs.LG ↗ · 2d ago Cached

A label-free, on-device pipeline for teacher-student segmentation in classroom recordings that chains lightweight VAD, compact speaker embeddings, agglomerative clustering, and logistic regression to identify the teacher via session-relative structure, matching pyannote performance while running 4.8× faster under GDPR constraints.

0 favorites 0 likes
#edge-computing

Implementing Binary Transformers with Approximate Memories with Permutation Invariance Enabled Selective (PIES) Protection

arXiv cs.LG ↗ · 2d ago Cached

The paper evaluates the dependability of binary Transformers under approximate memory bit errors and proposes a Permutation Invariance Enabled Selective (PIES) scheme that selectively protects critical binary weights, recovering most performance loss at BERs up to 10% with low overhead for low-power edge devices.

0 favorites 0 likes
#edge-computing

Big Brains, Tiny Board: Pupavision, an Agentic Physical AI Instrument for Monitoring Drosophila Pupariation and Lifecycle Transitions

arXiv cs.AI ↗ · 3d ago

Pupavision is a low-cost ($45-75) physical AI instrument built on a single-board Linux computer that runs a frontier coding agent's harness on-device to autonomously monitor Drosophila pupariation, with a deterministic capture layer ensuring reliable image recording across a 26-day pilot deployment.

0 favorites 0 likes
#edge-computing

SLED: Sensor SLicing from Edge to Datacenter

arXiv cs.AI ↗ · 3d ago Cached

The paper introduces Sensor Slicing (SL) and the SLED framework, which provide MAC-level per-sensor isolation across edge, campus, and HPC tiers in O-RAN, demonstrating stable latency under high load and 400x faster implementation via agentic coding.

0 favorites 0 likes
#edge-computing

NVIDIA DGX Spark Developer Kit Turns a Desk Into a Supercomputing Lab

NVIDIA Blog ↗ · 4d ago Cached

NVIDIA at SC26 introduced the DGX Spark HPC Developer Kit, a four-node desktop cluster of DGX Spark systems with 512GB combined memory and 20TB NVMe storage, enabling researchers to run multi-node scientific workloads and large AI models locally without queuing for shared GPU clusters.

0 favorites 0 likes
#edge-computing

@alexzfunk: The future is here. Welcome to the first truly 'smart' home. Turn your Local AI device into more than just a token gene…

X AI KOLs Following ↗ · 2026-11-02 Cached

Alex Funk unveils SparkHome, a local AI-powered smart home harness that runs voice agents, IoT control, and AAA game optimizations (via GameSpark for GB10) on a personal device instead of the cloud.

0 favorites 0 likes
#edge-computing

Don't Just Impute, Detect: Task-Aware Diffusion Pipelines for Edge Anomaly Detection

arXiv cs.LG ↗ · 2026-11-02 Cached

A paper proposing the Task-Aware Diffusion Refiner (TADR), a conditional diffusion model trained against a frozen downstream anomaly detector to fix imputation bias in block-missing IIoT sensor data, improving F1 by 0.338 on SMD while running at 41.4 ms per window on a single CPU core.

0 favorites 0 likes
#edge-computing

An updated 2.3bpw model for qwen 27b + 12 GB cards: ties Qwen3.6 BF16 on LiveCode Bench and reduces error by 37-57% vs a previous checkpoint

Reddit r/LocalLLaMA ↗ · 2026-11-01

An updated 2.3bpw quantized checkpoint of a Qwen 27B model for 12 GB Ampere cards ties Qwen3.6 BF16 on LiveCodeBench (84.3% vs 83.9%) and cuts KLD error by ~40% versus the previous release, using the new AmperInteger+ quant format in llamAmpere.

0 favorites 0 likes
#edge-computing

Things That Go Beep in the Night: Agentic AI Joins the Search for Extraterrestrial Signals

NVIDIA Blog ↗ · 2026-10-30 Cached

Breakthrough Listen and the SETI Institute are deploying agentic AI on the Allen Telescope Array, powered by NVIDIA Holoscan, to autonomously steer the instrument and process terabits per second of sensor data in real time — already achieving the first real-time AI detection of a pulsar in the Crab Nebula.

0 favorites 0 likes
#edge-computing

@Edge0_AI: 1/8 why run ai locally when a cloud api is just one call away? you get more control over your data, fewer network depen…

X AI KOLs Timeline ↗ · 2026-10-30 Cached

Thread discussing the trade-offs of running AI locally on-device versus calling cloud APIs, covering data control, network dependencies, per-token costs, and compute requirements.

0 favorites 0 likes
#edge-computing

Show HN: Lasm – Write formally verified webapps in Lean for Node/serverless/edge

Hacker News Top ↗ · 2026-10-30 Cached

Lasm compiles Lean 4 programs ahead of time to WebAssembly, enabling formally verified web apps that deploy to Node, serverless, and edge platforms from a single code base, with 117 proved theorems in its flagship Conduit example.

0 favorites 0 likes
#edge-computing

@QuixiAI: Congrats @Prince_Canuma Can't wait to see what you build!

X AI KOLs Following ↗ · 2026-10-28 Cached

Neywa Labs 隐身模式出闸,宣布打造可在用户现有设备上运行 AI 的基础设施,主打私密、离线与无限使用,目标是让全球每个人都能用上 AI。

0 favorites 0 likes
#edge-computing

Nvidia Introduces OpenShell Reference Architecture for AI Agent Safety

Reddit r/artificial ↗ · 2026-10-22 Cached

Nvidia announced the OpenShell Reference Architecture, a framework for building, containing, observing, and enforcing safe AI agents across enterprise infrastructure and edge systems throughout the full agent lifecycle.

0 favorites 0 likes
#edge-computing

CoASFL: Coupled Consistency Optimization for Asynchronous Split Federated Learning

arXiv cs.LG ↗ · 2026-10-21 Cached

CoASFL 提出一种面向异步分割联邦学习的不一致性感知框架,通过动态激活合并与一致性感知模型聚合,同时缓解客户端间水平不一致和客户端-服务器垂直不一致,在80设备边缘测试床上将训练加速1.61×至3.74×并提升最高3.26%的准确率。

0 favorites 0 likes
#edge-computing

Nvidia launches new open models to run agents in the enterprise and on PCs 

TechCrunch AI ↗ · 2026-10-19 Cached

Nvidia 发布了面向企业级智能体的 120B 开放权重模型 Nemotron 3.5 Super VL,以及可在 RTX/DGX Spark 本地运行的两款轻量 Bolt 模型,宣称在多项智能体任务上超越 Anthropic 和 OpenAI 的闭源模型。

0 favorites 0 likes
#edge-computing

Noise-shaped Sampling and Annealing for Scalable On-the-edge Training of Binary and Ternary AI Models

arXiv cs.LG ↗ · 2026-10-19 Cached

该论文提出ΣΔ-Sampler优化器,将二值和三值神经网络训练损失映射为高阶Ising模型能量,并通过噪声整形与退火实现高效的边缘设备训练,在CIFAR-10、ImageNet-1k和MatMul-free语言模型上验证了接近全精度的精度,同时将训练内存减少超过50%、速度提升一个数量级。

0 favorites 0 likes
#edge-computing

TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference

arXiv cs.LG ↗ · 2026-10-19 Cached

论文提出 TRACE(Transformer Residual Activation Codebook Encoding),在每个 Transformer 层的后注意力残差处放置向量量化器并预计算码本索引化的键值表示,使分布式边缘设备推理中接收方通过查表直接恢复 K/V,实现通信-计算重叠;在 ViT-Base 与 ViViT-B 上相比最优 VQ 分布式推理框架最高提升 1.89% 精度与 1.27 倍端到端加速,通信开销最高降低 22,624 倍。

0 favorites 0 likes
Next →
← Back to home

Submit Feedback