Skip to main content

Vision

Compare Image (experimental)​

Restrictions: "none"

Compare Image

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
baseImageimageThe base image for comparison.YesYes
comparisonImageimageThe image to compare against the base image.YesYes

Outputs​

NameTypeDescription
defaultnull

Wait for Text​

Restrictions: "none"

Wait for Text

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
textstringThe text to wait for.YesNo
timeoutdurationMaximum time waiting for the text to appear.YesNo

Outputs​

NameTypeDescription
defaultbooleanWhether the text was detected or not
timenumberThe actual wait time (ms)
frameimageScreen capture when text was detected (or timed out)

Text Exists (experimental)​

Restrictions: "none"

Text Exists

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
allow_patternstringRegex pattern to match the text in the region. To allow all text, use .{1,}YesNo
allow_case_sensitivebooleanWhether the regex pattern for Allow should be case sensitive.YesNo
reject_patternstringRegex pattern to reject the text in the region. Set to empty to disable.YesNo
reject_case_sensitivebooleanWhether the regex pattern for Reject should be case sensitive.YesNo
regionregionThe region to detect the text from.YesYes
thresholdnumberThe minimum confidence percentage required for a match, from 0 to 100.YesNo

Outputs​

NameTypeDescription
defaultbooleanIf the text in the region matches any word in the allow list and none in the deny list, this will be true.
textstringIf the text in the region matches any word in the allow list and none in the deny list, this will be the first match found.
If text in the region matches any word in the deny list, this will be the first text that caused the match to fail.
detected_textstringThe text that was recognized by the OCR. If no text was recognized, this will be nil.

Wait for Region​

Restrictions: "none"

Wait for Region

Waits to match the intended content.

Inputs​

NameTypeDescriptionRequiredDynamic
matcherregionSelect a region for the selected matcher(s).YesNo
modeenumWait for all or any of them to reach the expected statusYesNo
timeoutdurationMaximum time waiting for the matcher to reach the expected status.YesNo
waitUntilenumSelect the condition to wait for.YesNo

Outputs​

NameTypeDescription
defaultbooleanThe matcher reach the expected status.
timenumberThe actual wait time (ms)
frameframeThe frame where the matcher matched the intended content.

Wait for Screen​

Restrictions: "none"

Wait for Screen

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
screensscreenThe screen(s) to wait for. When multiple screens are selected, it will wait for any of the screens to appear. Screens are matched in order.YesNo
timeoutdurationMaximum time to wait for the screen to appear or disappear.YesNo
transitionTypeenumWhether to wait for screen to enter (appear) or exit (disappear)NoNo
waitForMotionbooleanWait for the screen to be fully rendered (no motion is detected) before continuing.NoNo
motionTimeoutdurationMaximum time to wait for motion to stop. Only used when the Fully Rendered option is enabled.NoNo
motionThresholdnumberMinimum percentage (0-100) of pixels that must change to detect motion. Only used when the Fully Rendered option is enabled.NoNo
stableFramesnumberThe number of stable frames required for the wait for motion to succeed. Only used when the Fully Rendered option is enabled.NoNo
motionIgnoreregionSpecify a region to ignore when detecting motion. This will apply a mask to the specified region, excluding it from motion detection. Only used when the Fully Rendered option is enabled.NoNo
motionOnlyregionSpecify a region to focus on when detecting motion. This will crop the image to the specified region, only detecting motion within it. Only used when the Fully Rendered option is enabled.NoNo

Outputs​

NameTypeDescription
defaultscreenDetected screen (if multiple are selected); nil when error and "Continue on Error" is checked
frameimageScreen capture when screen was detected
timenumberThe total waiting time (ms), including motion detection time when enabled
motionTimenumberThe total waiting time for the motion to stop (ms) when enabled

Detect Text (experimental)​

Restrictions: "none"

Detect Text

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
textstringThe text to detect.YesNo
frameimageThe image frame to search for the text.YesYes

Outputs​

NameTypeDescription
regionregionThe region of the detected text.
defaultnull

Extract Text (experimental)​

Restrictions: "none"

Extract Text

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
patternstringMatch the text against this pattern.YesNo
regionregionThe region to extract the text from.YesYes
case_sensitivebooleanWhether the regex pattern should be case sensitive.YesNo
thresholdnumberThe minimum confidence percentage required for a match, from 0 to 100.YesNo

Outputs​

NameTypeDescription
defaultbooleanIf a match was found.
matched_textstringThe text that matches the regex pattern. If no match was found, this will be nil.
detected_textstringThe text that was recognized by the OCR. If no text was recognized, this will be nil.

Wait for Motion​

Restrictions: "none"

Wait for Motion

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
typeenumWait until motion starts or ends.YesNo
timeoutdurationTimeout if motion is not detected or stopped after this period of time.NoNo
stableFramesnumberNumber of stable frames required. A frame is considered stable if the percentage of pixels that have changed is below the threshold.NoNo
thresholdnumberMinimum percentage of pixels that must change to detect motion.NoNo
includeAudiobooleanWhen detecting motion take audio signals into consideration. Audio is detect at a rms (root-mean-square) above 70 dB.NoNo
ignoreregionSpecify a region to ignore when detecting motion. This will apply a mask to the specified region, excluding it from motion detection.NoNo
onlyregionSpecify a region to focus on when detecting motion. This will crop the image to the specified region, only detecting motion within it.NoNo

Outputs​

NameTypeDescription
defaultimageScreen capture when motion was detected
timenumberThe actual wait time (ms)

Detect Color (experimental)​

Restrictions: "none"

Detect Color

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
colorcolorThe color to detect.YesNo
frameimageThe image frame to search for the color.YesYes

Outputs​

NameTypeDescription
defaultnull

Detect Image (experimental)​

Restrictions: "none"

Detect Image

No docs available

Inputs​

NameTypeDescriptionRequiredDynamic
imageimageThe image to detect within the frame.YesYes
frameimageThe image frame to search within.YesYes

Outputs​

NameTypeDescription
defaultnull