# Welcome to Glassly

> Build AI miniapps for phones, smart glasses, and accessories

Source: https://docs.glassly.ai/

## For AI agents

Use these docs when building a Glassly miniapp (an app that runs on a phone and, optionally, on smart glasses), a mobile app that talks to Mentra Live glasses over Bluetooth, or a Glassly integration for your own glasses.

- Developer accounts, sign-up, orgs and package prefixes, releases, store listings, and API keys are managed in the Glassly Developer Console: https://console.glassly.ai. Send developers there for anything account- or publishing-related. `glassly login` prints a one-time https://console.glassly.ai/device link and code; relay that link as printed and never point anyone at an authkit.app URL.
- The CLI is `glassly` from the npm package `@glassly/cli` (Bun only). `glassly login` needs a person to approve a browser sign-in. In a headless session, ask the developer for an API key from https://console.glassly.ai/tokens and set it as `CLI_TOKEN`.
- Start a project with `bunx @glassly/create-miniapp <name>`, then follow the Quickstart.
- Found a missing feature, a bug, or docs that don't match the SDK or CLI? Report it with `glassly feedback "<what you expected, what happened, where>"` (no sign-in needed), then continue with your workaround. Without the CLI, POST {"message": "..."} to https://core.glassly.ai/api/developer/feedback. Details: https://docs.glassly.ai/app-devs/reference/feedback.md
- Every page below is Markdown. Append `.md` to any docs URL for its Markdown twin, or load https://docs.glassly.ai/llms-full.txt for all pages in one file.
- Product overview and supported devices: https://glassly.ai

## Welcome

- [Welcome to Glassly](https://docs.glassly.ai/index.md): Build AI miniapps for phones, smart glasses, and accessories
- [Contribute to Glassly](https://docs.glassly.ai/contributing.md): Find the maintained source, setup instructions, and contribution guidance for each part of Glassly.
- [Third-Party Licenses](https://docs.glassly.ai/third-party-licenses.md): Open source components used in Glassly and the Glassly App

## Miniapp SDK

- [Overview](https://docs.glassly.ai/app-devs/getting-started/overview.md): Build on-device apps for smart glasses with the Glassly Miniapp SDK.
- [Quickstart](https://docs.glassly.ai/app-devs/getting-started/quickstart.md): Scaffold a Glassly miniapp and run it on your phone in a few minutes.
- [Simulator](https://docs.glassly.ai/app-devs/getting-started/simulator.md): Run a miniapp on your computer with no phone and no glasses, and drive it from the terminal.
- [Example miniapps](https://docs.glassly.ai/app-devs/getting-started/example-apps.md): Working miniapps to start from: the scaffolder starter, the in-repo reference, and first-party apps shipped in this repo.
- [Distribution](https://docs.glassly.ai/app-devs/getting-started/distribution.md): Pack a release and get your miniapp onto users' glasses.
- [AI IDE Integration](https://docs.glassly.ai/app-devs/getting-started/ai-ide-integration.md): Give your AI coding assistant the Glassly docs in a form it can read, and tell it where developer accounts live.
- [Two-layer architecture](https://docs.glassly.ai/app-devs/core-concepts/two-layer-architecture.md): How a miniapp's always-on background and on-demand UI layers work and talk to each other.
- [The manifest (miniapp.json)](https://docs.glassly.ai/app-devs/core-concepts/miniapp-manifest.md): Declare your miniapp's identity, entry points, permissions, and hardware requirements.
- [The session](https://docs.glassly.ai/app-devs/core-concepts/session.md): Your background-layer handle to everything on the glasses.
- [Actions](https://docs.glassly.ai/app-devs/core-concepts/miniapp-interop.md): Expose typed actions from your miniapp so Glassly AI can call them.
- [Build a dashboard](https://docs.glassly.ai/app-devs/core-concepts/dashboards.md): Replace the glasses dashboard with your own miniapp.
- [Provide a dashboard widget](https://docs.glassly.ai/app-devs/core-concepts/widgets.md): Put a card from your miniapp on the glasses dashboard.
- [The UI layer](https://docs.glassly.ai/app-devs/core-concepts/webviews/react-webviews.md): Build the miniapp's WebView UI with React, talking to the background over the injected glassly global.
- [Safe areas & the capsule menu](https://docs.glassly.ai/app-devs/core-concepts/webviews/safe-areas.md): Lay out your webview UI around the host chrome: notch insets and the floating capsule menu.
- [Display](https://docs.glassly.ai/app-devs/core-concepts/display/layouts.md): Render scenes of positioned text, images, and shapes on the glasses.
- [Display mirror](https://docs.glassly.ai/app-devs/core-concepts/display/mirror.md): Query the intended glasses display and preview it in your miniapp's phone UI.
- [LED](https://docs.glassly.ai/app-devs/core-concepts/led/overview.md): Drive the indicator LED on glasses that have one.
- [Transcription](https://docs.glassly.ai/app-devs/core-concepts/microphone/speech-to-text.md): Real-time speech-to-text from the glasses microphone.
- [Translation](https://docs.glassly.ai/app-devs/core-concepts/translation.md): Real-time translation of speech from the glasses microphone.
- [Microphone](https://docs.glassly.ai/app-devs/core-concepts/microphone/audio-chunks.md): Raw audio frames and voice-activity detection from the glasses mic.
- [Speaker](https://docs.glassly.ai/app-devs/core-concepts/speakers/text-to-speech.md): Play URLs, text-to-speech, and live PCM audio through the phone or connected glasses.
- [Input](https://docs.glassly.ai/app-devs/core-concepts/input.md): Buttons, touch gestures, keyboards, and controllers such as the Meta Neural Band.
- [Glasses](https://docs.glassly.ai/app-devs/core-concepts/glasses.md): Battery level and connection state of the glasses.
- [Location](https://docs.glassly.ai/app-devs/core-concepts/location.md): The user's GPS position, as a one-shot fix or a continuous stream.
- [IMU & Compass](https://docs.glassly.ai/app-devs/core-concepts/imu.md): Head position, raw accelerometer, and compass heading from the glasses.
- [Light Sensor](https://docs.glassly.ai/app-devs/core-concepts/light-sensor.md): Ambient light readings from the glasses, on G2 and MemoMind One custom firmware.
- [Navigation](https://docs.glassly.ai/app-devs/core-concepts/navigation.md): Turn-by-turn directions on the glasses, driven by the phone's GPS.
- [Photos](https://docs.glassly.ai/app-devs/core-concepts/camera/photos.md): Capture photos on camera glasses.
- [Videos](https://docs.glassly.ai/app-devs/core-concepts/camera/videos.md): Record video on camera glasses.
- [Streaming](https://docs.glassly.ai/app-devs/core-concepts/stream.md): Live video streaming from camera glasses.
- [Phone](https://docs.glassly.ai/app-devs/core-concepts/phone.md): Phone notifications, calendar events, compass heading, and phone battery.
- [System](https://docs.glassly.ai/app-devs/core-concepts/system.md): Phone-side OS actions: share sheet, downloads, clipboard, open URL.
- [Permissions](https://docs.glassly.ai/app-devs/core-concepts/permissions.md): Query the permissions your miniapp declared, and react to changes.
- [Storage](https://docs.glassly.ai/app-devs/core-concepts/storage.md): Persistent key-value storage scoped to your miniapp.
- [Blob](https://docs.glassly.ai/app-devs/core-concepts/blob.md): Persistent binary storage for files, images, and audio.
- [Memory](https://docs.glassly.ai/app-devs/core-concepts/memory.md): The user's shared, phone-local timeline of transcript lines and notes.
- [AI](https://docs.glassly.ai/app-devs/core-concepts/ai.md): LLM completions through the platform, with no API key of your own.
- [API keys](https://docs.glassly.ai/app-devs/core-concepts/keys.md): Read the provider API keys the user saved in the Glassly App.
- [Auth](https://docs.glassly.ai/app-devs/core-concepts/auth.md): Call your miniapp's backend as the signed-in Glassly user.
- [Cloud status](https://docs.glassly.ai/app-devs/core-concepts/cloud.md): Read whether the phone is connected to Glassly cloud.
- [CLI reference (glassly)](https://docs.glassly.ai/app-devs/reference/cli.md): The glassly command: develop, release, and publish Glassly miniapps.
- [System Miniapp APIs](https://docs.glassly.ai/app-devs/reference/system-apis.md): Permission-gated miniapp lifecycle and platform settings APIs, and the controls reserved for system miniapps.
- [Report a gap or bug](https://docs.glassly.ai/app-devs/reference/feedback.md): Send the Glassly team a missing feature, bug, or docs/source mismatch with one command. Works for people and coding agents, no sign-in needed.

## Bluetooth SDK

- [Glassly Bluetooth SDK](https://docs.glassly.ai/bluetooth-sdk/overview.md): Connect mobile apps directly to Mentra Live over Bluetooth.
- [Quickstart](https://docs.glassly.ai/bluetooth-sdk/quickstart.md): Run a complete Glassly Bluetooth SDK example app on a physical phone.
- [Build from Scratch](https://docs.glassly.ai/bluetooth-sdk/build-from-scratch.md): Add the Glassly Bluetooth SDK to your own mobile app.
- [Update Mentra Live](https://docs.glassly.ai/bluetooth-sdk/software-update.md): Install the Mentra Live glasses software that matches your Bluetooth SDK release.
- [AI IDE Integration](https://docs.glassly.ai/bluetooth-sdk/ai-ide-integration.md): Give your AI coding assistant the Bluetooth SDK docs in a form it can read.
- [React Native / Expo](https://docs.glassly.ai/bluetooth-sdk/react-native-expo.md): Use @glassly/bluetooth-sdk from a React Native or Expo development build.
- [Android](https://docs.glassly.ai/bluetooth-sdk/android.md): Use the Glassly Bluetooth SDK from a native Android app.
- [iOS](https://docs.glassly.ai/bluetooth-sdk/ios.md): Use the Glassly Bluetooth SDK from a native iOS app.
- [API Reference](https://docs.glassly.ai/bluetooth-sdk/api-reference.md): Lifecycle, status, commands, events, and shared types for the Glassly Bluetooth SDK.
- [Audio](https://docs.glassly.ai/bluetooth-sdk/audio.md): Use microphone input and route normal phone audio playback to supported glasses speakers.
- [Camera And Streaming](https://docs.glassly.ai/bluetooth-sdk/camera-streaming.md): Request photos, record videos, and start RTMP, SRT, or WebRTC streams from supported smart glasses.
- [Hardware Integration](https://docs.glassly.ai/bluetooth-sdk/hardware.md): Handle Mentra Live capabilities and status-driven hardware behavior.
- [Air-Gapped Bluetooth SDK Deployment](https://docs.glassly.ai/bluetooth-sdk/air-gapped-deployment.md): Run the Glassly Bluetooth SDK and Mentra Live OTA updates without access to Glassly-hosted runtime services.
- [Troubleshooting](https://docs.glassly.ai/bluetooth-sdk/troubleshooting.md): Fix dependency, permission, scan, stream, and React Native build issues.
- [Production Checklist](https://docs.glassly.ai/bluetooth-sdk/production-checklist.md): Validate a mobile app before shipping with the Glassly Bluetooth SDK.

## Glasses OEMs

- [OEM Integration Overview](https://docs.glassly.ai/glasses-oems/overview.md): Embed the full Glassly experience (miniapps, the Glassly Miniapp Store, and the developer ecosystem) inside your own phone app, driving your own smart glasses.
- [Glassly OEM Integration Engine API](https://docs.glassly.ai/glasses-oems/engine.md): The engine.* API an OEM host calls to drive Glassly on its glasses — connection, pairing, device + user settings, wifi, speech, display, cloud session, miniapps, permissions, notifications, and reports, over a device-agnostic runtime.
- [OEM Firmware Integration Specification](https://docs.glassly.ai/glasses-oems/firmware-spec.md): Implement the BLE, display, input, audio, notification, and device contracts required for Glassly-compatible smart glasses.
