IP-Adapter

Condition supported diffusion renders with a reference image

Last updated: 2026-10-27

Alpha — available for testing and feedback. Behavior and compatibility may change.

The IP-Adapter module uses an IP-Adapter reference image to guide a supported diffusion pipeline. It is an optional render module, not an input source: your selected Input remains the starting panorama.

Supported Pipelines

Pipeline IP-Adapter
Stable Diffusion XL [x]
Stable Diffusion 1.5 [x]
All other current pipelines -

Basic Workflow

  1. Select Stable Diffusion XL or Stable Diffusion 1.5 as your pipeline.
  2. Open the IP-Adapter screen/panel for the selected pipeline.
  3. If weights are missing, open the selected pipeline's IP-Adapter Models catalogue, Install the matching adapter and wait for verified readiness in Downloads. A reference image alone is not the adapter model. Follow any access/repair message; see Model Management.
  4. Enable the module toggle.
  5. Select a reference image — the image whose style you want to transfer.
  6. Choose an IP-Adapter model from the dropdown.
  7. Adjust IP-Adapter Strength (0.0–1.0) — higher values apply more style influence.
  8. Render and review. Adjust strength if the style overpowers or is too subtle.

Reference source, mode and fit

Choose the actual Reference Image → Source before rendering:

  • Custom Image uses the file you select.
  • Input Panorama uses the source panorama.
  • Per-Tile uses each tile's reference; it does not need a separate custom picture or expose the same Fit control.

For Custom Image/Input Panorama, Fit Mode offers Cover, Contain or Stretch: compare cropping, padding or distortion in the chosen reference. Where the selected adapter supports it, choose Style, Balanced or Composition to emphasize the corresponding influence. Some adapters apply a single unified influence and disable mode selection; follow that message rather than forcing a saved mode.

Reference Image Tips

  • Use images with clear stylistic qualities (painterly, photographic, illustrated)
  • Reference conditioning can influence appearance and composition; it is not an exact style-only or object-copy guarantee. Your starting panorama and other conditioning still matter
  • Strong, consistent styles (e.g., "oil painting," "anime," "watercolor") work best

Strength Guidelines

Strength Effect
0.1–0.3 Subtle style influence, preserves original look
0.4–0.6 Balanced style transfer (recommended)
0.7–1.0 Heavy stylization, may override prompt

Compatible Pipelines

IP-Adapter is supported on SDXL and SD 1.5. All other pipelines (SD 3.5, FLUX, Qwen, TeleStyle) do not support IP-Adapter.

Relationship with Other Modules

The IP-Adapter tab uses IP-Adapter to condition the diffusion process. It is separate from: - LoRA — LoRA modifies the model weights; IP-Adapter conditions via cross-attention - TeleStyle — TeleStyle is a dedicated style-transfer pipeline; IP-Adapter is a module that works within SDXL/SD 1.5 - ControlNet — ControlNet preserves structure; IP-Adapter transfers style

See Modules & Compatibility before moving a configuration between pipelines.

Esc
Searching...
No results found.
Type to search the documentation
↑↓ Navigate ↵ Select Esc Close

We use cookies for analytics to understand how visitors use our site. Privacy Policy