AI Copilot
The built-in AI assistant that answers questions, changes render settings, navigates, and operates an open Layers draft
Last updated: 2026-11-11
Copilot is an AI assistant built into 360 Hextile. It answers questions about the app, changes your render settings for you, navigates you to the right screen, and can operate the draft in an open Layers tool. It can use the bounded context supplied by the current page/tool, such as available hardware, selected settings and relevant Library items. Missing context is not permission to assume values or scan private files.
Open Help > Copilot, or use the chat bubble when visible. Settings > API Keys > AI Copilot > Show Chat Icon controls that icon; the header Help action remains another entry point.
What it can do
- Answer questions about features, pipelines, templates, and settings
- Change your settings — ask for "more detail in the sky" and it proposes the exact parameter changes, shows you what's changing, and applies them on your click
- Take you somewhere — "open my last render", "show me the LoRA batches", "where do I set the output size"
- Operate an open Layers draft — align, arrange, style, duplicate, remove, or run supported per-layer actions using the exact visible stack and selection
- Suggest prompts for a style or scene
- Troubleshoot render problems using your actual hardware and configuration
Copilot can use Generate Layer and Spot Clone only through the guarded flows below. It will not arm a tool for you, choose another render or clone source, or silently land or commit a result. Studio chat does not start an ordinary render. Automation can propose supported generation tools when available, with fresh approval; an active live-tool action still requires that exact tool to be open. Prepare Clone from… on the Spot Selection card before asking Copilot to commit that exact live clone.
Setting it up
Copilot needs a language model. You have two options.
Your own API key. Add a Claude, OpenAI or xAI (Grok) key through the panel. BYOK avoids the Hextile hosted-question quota, but your provider's billing, rate limits and model access still apply. The question and permitted context go to your selected provider; your key is stored locally and encrypted.
Pick from the models actually returned for your key in the panel selector. Refreshing discovery does not guarantee every future provider model supports every tool. If the selected key/model becomes unavailable, choose another supported option explicitly.
No key. With an activated license, Copilot falls back to our hosted assistant — no setup, but limited to 20 questions per hour. Add a key to lift the limit.
Keys are shared with AI Prompt Transform — set one up and both features work.
Changing settings
When you ask for a change, Copilot writes its answer, then shows a change card listing exactly what it wants to modify:
Steps 30 → 45
CFG Scale 7.5 → 6.0
Template Dodecahedron → Truncated_Icosahedron
Values already matching are greyed out as (already set). Expand Raw to see the underlying JSON. Then:
- Apply — merges the changes into your live settings
- Dismiss — hides the card
- Download — saves the config as a
.hextile.jsonfile instead of applying it
Only the listed fields change. Everything else in your configuration is untouched — Copilot merges, it never overwrites your setup with a fresh config.
Undo
After applying, the card turns into Applied ✓ with an Undo button, and an undo counter appears in the panel header. The snapshot lives with the message and survives restarting the app or switching conversations. Undo restores it only when Copilot can prove that the open document is the one that created the snapshot. If old or anonymous history cannot prove that match after a restart, Copilot refuses the restore instead of applying it to the wrong document. Changed your mind again? Redo puts it back while that same document match still holds.
Apply modes
The Off / Ask / Auto toggle in the panel header controls how eager Copilot is.
| Mode | Behavior |
|---|---|
| Off | Never auto-applies settings or navigation. Explicit Layers actions still run immediately after you ask for them. |
| Ask | (default) Always shows the card and waits for your click. |
| Auto | Applies straightforward changes immediately, still asking for anything risky. |
Auto is not enabled in the current build — the button appears greyed out. Ask mode is the intended day-to-day setting; it costs one click and you always see what changed first.
If Copilot proposes switching your pipeline, or if a change triggers a validation warning, it will ask even when it otherwise wouldn't. Pipeline switches reload the model and are never silent.
Working with Layers
Open Layers on the panorama you want to edit, then ask for one concrete action. Copilot can align and distribute selected layers; change pose, size, opacity, blend, visibility, lock, flip, or stack order; duplicate or remove layers; edit effects; and start supported upscale or cutout operations.
Ordinary Layers edits are immediate in every Apply mode because they act on the visible draft, not on the render-settings change card. Before each edit Copilot validates the exact armed tool, panorama, selection, stack, and draft revision it was shown. Generate Layer uses a separate guarded flow: arm Layers yourself, then approve generation, landing the result, and committing the draft as separate actions. Copilot never arms or retargets Layers for you.
The result appears in the conversation and in Layers' live Undo control. Undo reverses a live layer insertion; it does not cancel a generation job. After the draft is committed, use graph history to undo that graph change. The Copilot history is an audit trail, not a replay engine. Long-running upscale and cutout actions report progress and can be cancelled. Closing only the chat panel does not stop them, but a new request, a new conversation, leaving Layers, or changing the active panorama does.
Navigation
Ask Copilot to take you somewhere and it offers a link to that screen — a settings tab, your render library, a specific render, a template, a LoRA batch. It can only link to real places inside the app or to 360hextile.com; it can't be talked into opening anything else.
Studio and Automation
When available, choose Studio for chat, settings and supported edits on the visible tool, or Automation for discovered tool actions. Review the exact target and arguments in each approval. Availability is not permission to run every tool: licensing, installed models, current tool ownership and operation limits still apply.
Generation starts work; landing adds a result to a draft; commit bakes it into history. These are separate actions. Stop Assistant prevents further assistant reasoning/actions but does not cancel a GPU job already admitted. Use that job's Cancel action and wait for its final status. A lost response is uncertain: inspect the original job, draft or graph before authorizing another mutation.
Documentation tools
On an Automation send, and on a native Shader turn, Copilot can call search_docs and read_doc. They are reads, so they do not show an approval card. Search, then read the section you need. A long page with no section comes back as an outline. The result names the bundled docs version, which matches the installed app.
A Studio send does not search the docs. It answers from the built-in knowledge base and the context for the screen you have open.
If Settings → MCP has Enable MCP off, those reads return mcp_disabled, like every other tool.
An external agent uses the same tools while 360 Hextile is open. If the app is closed, it uses get_guide(name="website-index") and https://360hextile.com/llms.txt. The Agent Mode & MCP guide covers that path.
Automation: search saved prompts
Ask “Find saved render or sequence prompts mentioning sunset” to search the global and tile prompts stored with your renders and sequences. Searches need at least two characters; results give the saved item's kind, exact ID, and a short matching snippet. They do not search image pixels, captions, or other metadata.
Automation returns up to 50 hits per page. If a page includes next_cursor, continue with that cursor and the same query and filters until next_cursor is null; an empty page can still have a continuation. You can narrow a search to renders or sequences and to an active, archived, or trashed lifecycle status.
Automation: Generate Layer
An external MCP client can generate a sticker for an exact saved render without opening its viewer. This is local automation through the desktop app. The lifecycle is explicit: get_layer_draft → generate_layer with target: saved → get_layer_generation → land_generated_layer with target: saved → commit_layer_draft with target: saved. Generation produces a job artifact; landing adds it to the draft, and only the separate commit writes the Layers graph operation. Review and approve each change. A saved render currently owned by an open Layers session is not available to this path.
The saved workflow also provides cancel_layer_generation and rematte_layer; both default to execution_target: saved. Cancel targets the exact job and may report that cancellation was requested before the job reaches a terminal state. An external MCP client supplies the retained rgb_draft token for re-matte; Copilot resolves it privately for the approved exact job, without putting it in the conversation. The separate re-matte target field identifies a witnessed take to replace, not whether execution is saved or live. If a start response is lost, check the same request ID as the job ID; do not start a second job. A missing job after an app restart, or an interrupted land/commit, is an unknown outcome: inspect the saved draft and graph before trying again. rematte_layer starts a new job with a server-minted ID, so if its response is lost, inspect local job activity and the draft before making a new, explicit request.
In live Copilot, arm Layers on the intended render first and use Copilot's Automation mode. Approve generate_layer to start the job, then separately approve land_generated_layer after it is ready, and commit_layer_draft only when you want to bake the draft. The live actions are bound to the armed render and draft; Copilot will not arm or retarget them. Approved cancel_layer_generation or rematte_layer with execution_target: live controls only that exact armed session's job; a cancellation request is not proof that GPU work has stopped. Re-matte produces another artifact and, when given a witnessed recovery target, a later approved land replaces that take rather than adding one. Stop or switching away can refuse an action that has not been admitted. Once generation is admitted, Stop does not cancel that GPU job; it may finish as an artifact and will not land or commit by itself. If an admitted land, commit, or re-matte loses its acknowledgment, treat the result as unknown and inspect the exact job, Layers draft, or graph history before a new approved attempt. The Agent Mode & MCP guide covers connecting an external client.
Automation: Spot Clone
An external MCP client can work on an exact saved render without opening its viewer: preflight_spot_clone inspects readiness and mask/source fingerprints, then a separately approved clone_spot writes one node against the expected parent and HEAD. Keep the same node ID for reconciliation; if the reply is lost, inspect that exact ID with get_spot_clone before any new approval. A moved HEAD, changed mask, or changed source requires a fresh preflight. The client does not get to force a bake or silently choose another source or destination.
For live Copilot, first prepare Clone from… yourself in the Spot Selection card. Copilot's approved clone_spot can commit only that already prepared operation while its render, HEAD, source and destination poses, and mask fingerprint still match. It cannot arm Clone, pick a source or destination, redraw the mask, force, or retarget. Stop or switching away can prevent a clone that has not reached the write; it does not undo a bake already started. A completed clone is a graph node, so use graph history for Undo. If the result is uncertain, inspect the exact node receipt rather than retrying with a new ID.
Conversations
Every conversation is saved automatically and titled from its first exchange. The panel header has a history list to switch between them, plus a button for a new conversation. Delete any you don't want to keep.
Drag the panel's left edge to resize it. The width persists.
What Copilot knows about you
Each question is sent with a snapshot of your setup so answers are grounded in reality rather than guesswork:
- GPU model and VRAM
- Installed models and available templates
- License tier
- Your current render configuration and active pipeline
- Bounded relevant/recent Library items when supplied; counts and available fields depend on the current context
None of this leaves your machine when you're using your own API key beyond what goes to your chosen provider.
Working offline
The product knowledge base is cached on disk for 7 days, so recent documentation remains available when 360hextile.com cannot be reached. This cache is documentation, not a local language model: Copilot can answer only while its selected model endpoint is reachable. The hosted assistant needs 360hextile.com; a BYOK model needs that provider. With no documentation cache, Copilot falls back to a minimal built-in reference after it reconnects to a model endpoint.
Examples
- "Why does my sky look muddy?"
- "Bump the steps and lower the guidance a bit"
- "Switch me to SD 3.5 Turbo for a fast test"
- "What pipeline should I use for landscapes?"
- "How do I fix pole distortion in my output?"
- "Open my most recent render"
- "Take me to the output settings"
- "What settings should I use for nighttime scenes?"
- "Align these layers to the horizon"
- "Set the selected logo to 70% opacity and move it behind the title"
Shader Workshop
Shader Workshop edits the same package you do: shader.json, source.glsl and modules. Copilot can change a value or the code. The control marks the change, and the Agent changes panel lists it. You are not asked to approve it. Copilot does not Import a panorama from the shader, and it does not delete the shader asset. Credit text is different: a proposal waits on the Credits card until you apply it.
Asset credits access is separate from access to Shader source. With the current asset permission, Copilot can read the public name, ordered links and, for profile version 2, biography and a PNG avatar descriptor. It can distinguish the live profile from the profile frozen for a pending change. Account identifiers, connection tokens, private drafts, image addresses and image bytes stay out of this context. Copilot cannot upload or choose an avatar for you. Prepare an optional avatar in Settings before starting the change.
The desktop and hosted service negotiate credit_profile_contract: 2 independently of the existing Shader tool protocol_version: "2". Both requests and replies must acknowledge that credit contract. A missing or older acknowledgement means an update is required; Copilot does not remove biography/avatar fields or retry a downgraded proposal. Local/native saved work remains usable. Credits reads use attribution_schema: 2 for the public live/frozen summary; omitted/1 retains the previous read shape.
The host adds your frozen public identity when a saved source edit qualifies for automatic credit. Copilot should preserve earlier authors, source evidence, license text and lineage, and report a skipped or unavailable identity honestly. A selection edit has no broader credit authority. A later human full-source Save may add editor credit; a duplicate agent edit is unnecessary. Credits-only proposals still require the existing review and Apply action.
The canonical /docs/plugins authoring-guide publication is pending its separate owner. Its handoff must carry these explicit negotiation, public-field, prepared-avatar and selection-scope rules; this page does not announce a new plugin guide.
Limitations
Copilot's answers come from documentation and your app state — it can be wrong, and it doesn't know about every edge case. Generate Layer and Spot Clone are limited to the explicitly approved saved or guarded live lifecycles above. Studio settings/chat does not itself start an ordinary render. When available, Automation can propose supported workflow or 360-LoRA generation tools and exact-job cancellation, each through explicit approval. Copilot cannot prepare Clone from… for you, silently operate an unarmed tool or land/commit a result without its required approval. For complex issues, see the Troubleshooting Guide or contact support.