Computer

Coordinates are screen pixels. cua-spacesd delegates input to Cua Driver in the guest; these calls need an image with a desktop.

Python programs usually use the high-level API instead: sb.mouse, sb.keyboard, sb.screen.

Desktop methods#

Methods of SpacesdClient.

SpacesdClient.screenshot#

Captures a display.

async def screenshot(self, options: Optional[ScreenshotOptions]) -> Screenshot

Returns Screenshot · Async · Raises CuaError

Example

import asyncio
 
import cua
 
async def main():
    guest = await cua.embedded().spacesd(URL, TOKEN)
    shot = await guest.screenshot(None)  # PNG by default
    await guest.click(shot.width / 2, shot.height / 2)
    print([shot.width > 0, shot.image[:4]])
    # [True, b'\x89PNG']
 
asyncio.run(main())

SpacesdClient.click#

Left click.

async def click(self, x: float, y: float) -> None

Async · Raises CuaError

SpacesdClient.double_click#

Double click.

async def double_click(self, x: float, y: float) -> None

Async · Raises CuaError

SpacesdClient.right_click#

Right click.

async def right_click(self, x: float, y: float) -> None

Async · Raises CuaError

SpacesdClient.move_to#

Moves the pointer.

async def move_to(self, x: float, y: float) -> None

Async · Raises CuaError

SpacesdClient.drag#

Drags with the left button.

async def drag(self, from_x: float, from_y: float, to_x: float, to_y: float) -> None

Async · Raises CuaError

SpacesdClient.scroll#

Scrolls by line deltas.

async def scroll(self, dx: float, dy: float) -> None

Async · Raises CuaError

SpacesdClient.type_text#

Types text.

async def type_text(self, text: str) -> None

Async · Raises CuaError

SpacesdClient.press#

Presses one key (enter, KEY_ESCAPE, a, ...).

async def press(self, key: str) -> None

Async · Raises CuaError

SpacesdClient.hotkey#

Presses a chord (["ctrl", "c"]).

async def hotkey(self, keys: List[str]) -> None

Async · Raises CuaError

SpacesdClient.pointer_json#

Full ComputerService.Pointer from proto3 JSON.

async def pointer_json(self, request_json: str) -> str

Returns String · Async · Raises CuaError

SpacesdClient.keyboard_json#

Full ComputerService.Keyboard from proto3 JSON.

async def keyboard_json(self, request_json: str) -> str

Returns String · Async · Raises CuaError

SpacesdClient.get_clipboard#

Clipboard text.

async def get_clipboard(self) -> Optional[str]

Returns Option<String> · Async · Raises CuaError

SpacesdClient.set_clipboard#

Sets clipboard text; returns the clipboard generation.

async def set_clipboard(self, text: str) -> int

Returns u64 · Async · Raises CuaError

SpacesdClient.cursor_position#

Pointer position.

async def cursor_position(self) -> Point

Returns Point · Async · Raises CuaError

SpacesdClient.displays#

Displays as proto3 JSON ([Display]).

async def displays(self) -> str

Returns String · Async · Raises CuaError

Screenshot record#

A captured screenshot.

Returned by Sandbox.guest_screenshot, Space.screenshot, SpacesdClient.screenshot.

ScreenshotOptions record#

Screenshot options.

ImageFormat enum#

Screenshot encoding.

ImageFormat.PNG
ImageFormat.JPEG
ImageFormat.WEBP

Point record#

A point.

Returned by SpacesdClient.cursor_position.