Skip to main content

AI API

Provides an API to interact with LLMs/ChatGPT 4

ai.codegen

Signatures

codegen(prompt)

Description

Generate lua code from the prompt.

Example:

local codegen = ai.codegen("Navigate home, wait 5 seconds, then press up and enter")

print(codegen)
-- control.home() wait(5000) control.up() control.ok()

ai.prompt

Signatures

prompt(user_prompt, opts \ [])

prompt(arg, prompt, opts)

Description

Runs a prompt with a provided image, or the current screen and returns the response, and the viewpoint of the AI.

Example:

local response, viewpoint = ai.prompt("What is the color of the screen?")

print(response)
-- "The general color of the screen is blue."

ai.run

Signatures

run(prompt, state)

Description

The same as codegen, but runs the generated code immediately.

Example:

ai.run("Navigate home, wait 5 seconds, then press up and enter")