[Feature]: add snapshotForAI support

[wangzhe0912]

🚀 Feature Request

add snapshotForAI support.
base Python version inplement PlayWright MCP Server。

Example

No response

Motivation

base Python version inplement PlayWright MCP Server。

[Fly-Playgroud]

Now many users use AI driving browser by playwright, add snapshotForAI in python version is important. I support this feature.

[neoncube2]

What would snapshotForAI do?

[wangzhe0912]

https://github.com/microsoft/playwright/blob/bd5a23f88f3c54b6fd15ff1cde0693babfc86285/packages/protocol/src/channels.d.ts#L2095
The JS version of Playwright provides a snapshotForAI method, which converts a Page into a snapshot format. In this format, each page element is assigned a ref-id, enabling models to understand the page and perform actions based on the ref-id.

Currently, the Python version does not expose this method and only supports a snapshot method based on a specified locator. This method differs from snapshotForAI, as some elements (e.g., text elements) are not assigned a ref-id, making it unsuitable for AI to identify elements and perform intelligent operations.

[latifboubyan]

Any updates on this? I have a use case not satisfied by the MCP so I'd like to use the python library directly, but I want to make use of snapshotForAI.

[changshuo08]

@latifboubyan Could you give me some examples for mcp

[wangzhe0912]

Or exposing the forAI parameter in the ariaSnapshot method in the Node version would also work.

Attached is the ariaSnapshot definition from Node version 1.53:

ariaSnapshot:
  title: Aria snapshot
  parameters:
    selector: string
    forAI: boolean?
    timeout: number
  returns:
    snapshot: string
  flags:
    snapshot: true

https://github.com/microsoft/playwright/blob/main/packages/protocol/src/protocol.yml#L2108