IP-Adapter
Condition supported diffusion renders with a reference image
Last updated: 2026-10-27
Alpha — available for testing and feedback. Behavior and compatibility may change.
The IP-Adapter module uses an IP-Adapter reference image to guide a supported diffusion pipeline. It is an optional render module, not an input source: your selected Input remains the starting panorama.
Supported Pipelines
| Pipeline | IP-Adapter |
|---|---|
| Stable Diffusion XL | [x] |
| Stable Diffusion 1.5 | [x] |
| All other current pipelines | - |
Basic Workflow
- Select Stable Diffusion XL or Stable Diffusion 1.5 as your pipeline.
- Open the IP-Adapter screen/panel for the selected pipeline.
- If weights are missing, open the selected pipeline's IP-Adapter Models catalogue, Install the matching adapter and wait for verified readiness in Downloads. A reference image alone is not the adapter model. Follow any access/repair message; see Model Management.
- Enable the module toggle.
- Select a reference image — the image whose style you want to transfer.
- Choose an IP-Adapter model from the dropdown.
- Adjust IP-Adapter Strength (0.0–1.0) — higher values apply more style influence.
- Render and review. Adjust strength if the style overpowers or is too subtle.
Reference source, mode and fit
Choose the actual Reference Image → Source before rendering:
- Custom Image uses the file you select.
- Input Panorama uses the source panorama.
- Per-Tile uses each tile's reference; it does not need a separate custom picture or expose the same Fit control.
For Custom Image/Input Panorama, Fit Mode offers Cover, Contain or Stretch: compare cropping, padding or distortion in the chosen reference. Where the selected adapter supports it, choose Style, Balanced or Composition to emphasize the corresponding influence. Some adapters apply a single unified influence and disable mode selection; follow that message rather than forcing a saved mode.
Reference Image Tips
- Use images with clear stylistic qualities (painterly, photographic, illustrated)
- Reference conditioning can influence appearance and composition; it is not an exact style-only or object-copy guarantee. Your starting panorama and other conditioning still matter
- Strong, consistent styles (e.g., "oil painting," "anime," "watercolor") work best
Strength Guidelines
| Strength | Effect |
|---|---|
| 0.1–0.3 | Subtle style influence, preserves original look |
| 0.4–0.6 | Balanced style transfer (recommended) |
| 0.7–1.0 | Heavy stylization, may override prompt |
Compatible Pipelines
IP-Adapter is supported on SDXL and SD 1.5. All other pipelines (SD 3.5, FLUX, Qwen, TeleStyle) do not support IP-Adapter.
Relationship with Other Modules
The IP-Adapter tab uses IP-Adapter to condition the diffusion process. It is separate from: - LoRA — LoRA modifies the model weights; IP-Adapter conditions via cross-attention - TeleStyle — TeleStyle is a dedicated style-transfer pipeline; IP-Adapter is a module that works within SDXL/SD 1.5 - ControlNet — ControlNet preserves structure; IP-Adapter transfers style
See Modules & Compatibility before moving a configuration between pipelines.