Compare multiple images in a completion

The previous lesson attached a single image. This one attaches two and asks the model to compare them.

The model can hold more than one image in context. The attachments array is the only knob: we add more objects, point each at a different file on disk, and the projection model handles the rest.

We use it for comparisons, "spot the difference", describing a sequence of frames, or any task where the answer is "across" multiple images rather than "about" one.

Each image in attachments becomes one entry in the array. The order in the array is the order the SDK passes the images to the model. We keep that in mind if our prompt references "the first image" or "the second image".

Two image attachments on the same user message, SDK passes them to the projection in attachments order (index 0 is the first image):

const history = [
  {
    role: "user",
    content: "Compare the two newspaper articles. Which one is older?",
    attachments: [
      { path: "./examples/qvac/multimodal/input/article-a.jpg" },
      { path: "./examples/qvac/multimodal/input/article-b.jpg" },
    ],
  },
];

Two images in the history is what makes the call 'compare'. You would call it like so:

const result = completion({ modelId: multimodalId, history, stream: true });

Once the call returns, drain the tokens same as text-only:

for await (const token of result.tokenStream) {
  process.stdout.write(token);
}
process.stdout.write("\n");

The attachments array grows by one entry per extra image; the history itself still has one entry for that turn. completion() and result.tokenStream work the same as a text-only call.

Note: multimodal assistants use modelConfig.projectionModelSrc, not modelConfig.lora. The two are unrelated options.