Microsoft

Open source projects and samples from Microsoft

Microsoft GitHub Findings

Employee Self-Service Agent Developer Kit

Customize your Employee Self-Service (ESS) agent using GitHub Copilot
A monorepo of solutions, samples, and tooling for the Microsoft Employee Self-Service (ESS) agent built on Microsoft Copilot Studio.

This repo is intended as an example or learning tool. It is not a Microsoft product or a supported service. See SUPPORT.md for the support model and SECURITY.md for reporting security issues.

Skill Recorder

Desktop app that records your on-screen work session and uses the GitHub Copilot CLI to reconstruct it as an intent + ordered steps, then builds a reusable Skill or Automation for Microsoft Scout, Microsoft Copilot Cowork, or Copilot Studio.

https://github.com/microsoft/skill-recorder


bitnet.cpp

Official inference framework for 1-bit LLMs
bitnet.cpp is the official inference framework for 1-bit LLMs (e.g., BitNet b1.58). It offers a suite of optimized kernels that support fast and lossless inference of 1.58-bit models on CPU and GPU (NPU support coming next).

Try it out via this online demo, or build and run it on your own CPU or GPU.

bitnet.cpp achieves speedups of 1.37x to 5.07x on ARM CPUs, with larger models experiencing greater performance gains. Additionally, it reduces energy consumption by 55.4% to 70.0%, further boosting overall efficiency. On x86 CPUs, speedups range from 2.37x to 6.17x with energy reductions between 71.9% to 82.2%. Furthermore, bitnet.cpp can run a 100B BitNet b1.58 model on a single CPU, achieving speeds comparable to human reading (5-7 tokens per second), significantly enhancing the potential for running LLMs on local devices. Please refer to the technical report for more details.

https://github.com/microsoft/BitNet

Comments

Post a Comment

Popular posts from this blog

MIT Team Builds a Speech-to-Reality System that Turns Spoken Prompts into Physical Objects Within Minutes

MIT researchers have devloped a system that allows users to speak a request aloud and receive a fabricated object minutes later, demonstrating how natural language, generative AI, and robotics can combine to produce on-demand manufacturing. According to MIT, the work, presented at the ACM Symposium on Computational Fabrication, shows that the system can assemble simple furniture and decorative items from modular parts without requiring users to know 3D modeling or robotic programming. Researchers at MIT’s Center for Bits and Atoms, led by graduate student Alexander Htet Kyaw with collaborators Se Hwan Jeon and Miana Smith, built a workflow that begins with speech recognition and a large language model. The model interprets the user’s request — such as asking for a stool — and passes the result to a 3D generative AI system that produces a digital representation of the object. A voxel-based process then breaks that form into discrete components suitable for robotic assembly. After geomet...
Read more

When to Think Fast and Slow? AMOR: Entropy-Based Metacognitive Gate for Dynamic SSM-Attention Switching Haoran Zheng

Image
 Transformers allocate uniform computation to every position, regardless of difficulty. State Space Models (SSMs) offer efficient alternatives but struggle with precise information retrieval over a long horizon. Inspired by dual-process theories of cognition (Kahneman, 2011), we propose AMOR (Adaptive Metacognitive Output Router), a hybrid architecture that dynamically engages sparse attention only when an SSM backbone is "uncertain"--as measured by prediction entropy. Compared to standard transformers, AMOR gains efficiency by projecting keys and values from SSM hidden states (Ghost KV), reusing the SSM's O(n) computation rather than requiring O(n^2) attention at every layer. On small-scale synthetic retrieval tasks, AMOR outperforms both SSM-only and transformer-only baselines, achieving perfect retrieval accuracy while engaging attention on only 22% of positions. We validate that prediction entropy reliably signals retrieval need, with a gap of 1.09 nats (nearly half t...
Read more