Robie Sr. — Public User Manual v10.5.0

Operating Modes

AI Mode

Command Mode

Walkabout

Keep Watch

Owner/Memory Mode

Robie operates across five practical contexts. AI Mode is the default conversational state and now includes bounded conversational curiosity plus command-only Interview Mode. Command Mode gives direct motor control and allows the active direction to be sped up or slowed down while Robie keeps listening for STOP. Walkabout is explicit, command-only roaming with sensor redirects, no timed session cap, and a wake-word-free stop listener. Keep Watch is silent PIR-only monitoring. Owner/Memory Mode protects personal memory, speaker identity actions, and owner-only idle curiosity.

Quick Reference

The most-used commands at a glance. Best tab to keep open during testing.

Say	Robie does	Mode / sensitivity
hello	Local greeting	AI
goodbye	Goodbye sequence / sleep	CMD AI
shutdown	Goodbye/spin sequence, then halts Linux	⚠ SAFETY AI
command mode	Enters movement command mode	AI
exit	Leaves command mode	CMD
what time is it?	Reports the current local time from Robie's synchronized system clock	AI Local reply
what is today's date?	Reports the current local day and date	AI Local reply
what is the date and time?	Reports the current local day, date, and time together	AI Local reply
where are you?	Reports Robie's selected city and timezone	AI Local reply
set your location to [city]	Looks up a city and asks for owner confirmation before changing Robie's location	✓ OWNER Internet required
tell me the weather	Reports current conditions, temperature, feels-like temperature, daily high/low, and precipitation chance	AI Weather only
what's tomorrow's weather?	Reports tomorrow's conditions, high/low, and precipitation chance for the selected location	AI Local forecast
give me the five-day forecast	Reports a concise forecast for today and the following four days	AI Local forecast
what do I have today? / what's my itinerary?	Reads today's entries from the owner's Calendar	✓ OWNER Read-only
do I have an appointment on Saturday?	Checks Saturday's Calendar entries; it does not infer event type from a title	✓ OWNER Read-only
when is my [event]? / where is my [event]?	Looks for an upcoming named Calendar event	✓ OWNER Read-only
how are you	Short casual reply	AI
what are you doing	Short activity reply	AI
how are you feeling	Short status-style reply	AI
status report	Long detailed status report	AI
battery status	Reports Robie's main battery and the Bluetooth microphone battery or connection state	AI
Bluetooth microphone battery	Reports both battery systems, including the Razer percentage when connected	AI
environment check	Reports internal sensor readings followed by local weather	AI Combined report
air analysis	Runs deeper air analysis	⚠ SAFETY AI
what do you see	Captures a fresh scene image, describes it with grounded visual awareness, and stores it as the current visual reference	◎ CAM May ask one visual question
what did you see last	Describes the most recent scene photo without taking a new one	◎ CAM
look at the last image again	Re-analyzes the current visual reference without capturing a new image	◎ CAM
tell me more about the last image	Uses stored detailed visual context from the latest scene photo	◎ CAM
take a photo	Saves timestamped photo locally	AI
record a video	Records short video locally	AI
send it to me	Emails newest saved camera media	AI
email that / send that / transcribe that	Emails the most recent completed AI answer as text with its exact spoken WAV attached	✓ OWNER AI
draw a picture and send it	Takes a fresh photo, redraws it in a childlike pencil/crayon style, and emails the drawing	◎ CAM AI
interview me / interview me about [topic]	Starts command-only Interview Mode and asks one question at a time	AI Every speaker
stop the interview / end interview mode	Ends Interview Mode	AI
curiosity mode on / off	Temporarily enables or disables all automatic curiosity systems	AI
erase media	Deletes saved camera media	⚠ SAFETY AI
stop	Immediate stop	⚠ SAFETY CMD
go forward / back / left / right	Manual movement in command mode	⚠ SAFETY CMD
faster / go faster / slower / go slower	Adjusts the active Command Mode movement by one bounded speed step	⚠ SAFETY CMD Moving only
override	Disables/re-enables command-mode collision sensors	⚠ SAFETY CMD
walkabout	Starts commanded Walkabout Mode	⚠ SAFETY AI
stop	Stops Walkabout without wake word	⚠ SAFETY WALK
attention mode on/off	Toggles attention scanning/centering	◎ CAM AI
keep watch / enter watch mode	Starts PIR-only silent Watch Mode	◎ CAM WATCH
stop watching	Stops Watch Mode or cancels pending alert	◎ CAM WATCH
look at this	Takes a temporary object image, analyzes why it may be notable, and may ask one grounded question	◎ CAM Visual curiosity
examine / analyze this	Records a 3-second object video, analyzes key frames, and may ask one grounded question	◎ CAM Visual curiosity
tell me more	Uses recent object-inspection context	AI
describe yourself	Fuller Robie description	AI

New / Updated Commands v10.5.0

Changes and additions highlighted in the latest build and command reference.

Command	Update	Note
today / tomorrow / this week / next seven days	Owner-only read-only Calendar lookup, including named weekdays and morning, afternoon, or evening checks	A direct Calendar answer spoken in Alan's usual voice
what's my itinerary? / tell me what I have scheduled today	Natural aliases for today's Calendar; a named weekday changes the day checked	Travel-itinerary questions without a calendar day remain normal conversation
appointment follow-ups	After a Calendar answer, a relevant follow-up can use that recent answer for conversational continuity	Owner only; brief in-memory window; not an automatic reminder
what's tomorrow's weather?	Adds tomorrow's expected conditions, high/low, and precipitation chance for the selected location	Direct local weather response; internet required
give me the five-day forecast	Adds a concise forecast for today and the following four days, using weekday names	Follows the selected location; results are cached briefly
today's date	Calendar days are now spoken as natural ordinals: first, second, third, twenty-fifth, thirty-first, and so on	Speech-formatting change only; clock, timezone, and date calculations are unchanged
what's the weather like today?	New natural “today” aliases route directly to the same selected-location weather-only report	Does not invoke internal environmental sensors or ordinary AI conversation
set your location to [city]	Resolves the requested city, reads back the full match and timezone, and changes location only after owner confirmation	Owner-only; internet required for lookup; the confirmed location persists across restarts
where are you? / what city are we in?	Reports Robie's currently selected city and timezone	Local reply available to every speaker
return to your home location	Restores Robie's configured home city and timezone	Owner only; no geocoding lookup required
time / date / date and time	Reports the current time, day, and date in Robie's selected location	The synchronized clock uses the selected location's timezone and follows daylight-saving changes
live conversational time context	Every normal AI request receives a fresh local date, time, timezone, UTC offset, and selected-location label	Supports accurate references to today, yesterday, tomorrow, and date-sensitive questions while travelling
weather / tell me the weather	Reports current conditions and temperature, humidity-and-wind-adjusted feels-like temperature, today's high/low, and maximum precipitation probability	Weather only; follows the selected location; results are cached briefly
environment / environmental check	Reports Robie's internal temperature, humidity, pressure, and air-quality status, followed by the selected location's weather	Combined internal-and-outdoor report; weather failure does not suppress available sensor readings
autonomous visual curiosity	During an eligible quiet owner conversation, Robie now has a 50% trigger chance to briefly look at the room and begin one grounded conversation about something worth noticing	Normally enabled; owner only; conservative cooldowns and a per-startup limit prevent frequent interruptions
shutdown / shut down	Shutdown now uses a small exact local whitelist so recognition remains dependable without accepting loose conversational matches	Negated wording such as `don't shut down` is rejected; use one approved standalone phrase
enter watch mode	New alias for starting PIR-only Keep Watch mode	Same behavior and safety rules as `keep watch`
Bluetooth already connected at startup	Robie routes input to the Bluetooth microphone immediately but defers its spoken connection/battery notice until after the first wake gesture and welcome	Preserves the normal startup wake sequence
Razer Seiren BT microphone	Automatically becomes Robie's only active voice-input path when connected; the internal lavalier resumes automatically when it disconnects	Supported Razer Seiren BT microphone using the HFP mSBC capture profile
Bluetooth microphone connected	Robie announces a confirmed connection and the current microphone battery percentage	Queued only in a safe speech slot so it does not overwrite a user turn or pending reply
Bluetooth microphone off / disconnected	Robie announces the loss and confirms that he is using his internal microphone	Audio input changes automatically without changing the selected speaker output
Bluetooth microphone battery	Battery questions and status reports now include the Razer connection state and battery percentage	The microphone may report battery level in coarse steps
low Bluetooth microphone battery	Robie warns once when the reported microphone battery reaches 20% or lower	Warning re-arms only after recovery to 30% or higher
USB speaker routing	Robie's speaker remains on its configured USB audio adapter during every microphone transition	Bluetooth audio output is never selected as Robie's production speaker
faster / go faster / slower / go slower	Adjusts an active forward, backward, left, or right Command Mode movement in 0.05 steps without stopping or restarting it	Local control only; bounded per direction, ignored while stationary, and each new direction resets to its normal starting speed
visual curiosity	Scene View, Object Inspect, and Object Examine now add one grounded significance observation when supported and may ask one visible-evidence follow-up question	No second AI request; questions remain occasional and are spaced to avoid interruptions
conversational curiosity	Robie may ask one relevant question, then one deeper question if the speaker gives a meaningful answer	Normally enabled for every active speaker; two-question ceiling outside Interview Mode
interview me / interview me about [topic]	Starts command-only Interview Mode for the current speaker	Available to everyone; asks exactly one question per turn and never starts spontaneously
stop interview / end interview mode / stop asking me questions	Ends an active Interview Mode session	Does not disable ordinary curiosity when it is ending an active interview
idle curiosity	After a recent owner conversation and a quiet lull, Robie may first ask permission to pose one question	Owner only; may draw safely from open loops, episodic context, or a general question
curiosity mode on / off	Temporarily enables or disables conversational, reactive visual, idle, and autonomous visual curiosity	Curiosity is enabled by default after each service restart; an explicit Interview Mode command remains separately available
email that / send that / transcribe that	Emails the last completed owner AI response as a dated text transcript with the exact Piper WAV attached	Owner-only; applies to the most recent completed AI answer
draw a picture and send it	Asks the subject to hold still, captures and redraws the scene, adds Robie's signature, then emails a borderless 3000×2000 JPEG and asks for feedback	Randomized opening and success lines; exact 3:2 ratio at 300 DPI
Robie name variants	Direct-address variants such as Ruby, Rubi, Roby, Robby, Robbie, and Rudy are interpreted as Robie in safe contexts	Does not rewrite ordinary conversation about a real person with that name
automatic episodic memory	Maintains bounded owner-only conversational continuity	Owner-only private context; protected controls are documented separately
resident streaming Piper	Keeps the voice loaded and begins playback as synthesized audio arrives	Internal speech-performance behavior, not a spoken command
latest visual reference	Robie keeps the latest scene image as his current visual reference until a new scene photo replaces it	v5.4.9 visual-reference persistence
what did you see last	Uses the last captured scene image or stored detailed observation	Does not take a new photo
look at the last image again	Re-analyzes the existing the current visual reference	Useful when the first spoken summary was too short
tell me more about the last image	Gives a fuller answer from detailed visual context	Short spoken view plus deeper follow-up detail
state watchdog wake guard	Protects active wake sequence from false stale-state resets caused by wall-clock jumps	v5.4.8
right / left / forward / backward	No longer trigger AI-mode movement when heard as standalone words	v5.4.7; command mode remains direct-control
AI-mode movement phrases	Now require short, direct movement wording before Robie moves	v5.4.5 safety hardening
go back	No longer acts as a bare AI-mode backward trigger	Use `back up`, `go backward`, or `go back a bit` for AI-mode movement
go back outside / go back to...	Stays conversational and does not trigger motors	Prevents accidental backward movement
walkabout	Starts command-only Walkabout Mode	v5.4.0
Walkabout duration	The former 120-second automatic stop has been removed	Walkabout now continues until stopped through its wake-word-free stop listener
go for a walk	Starts command-only Walkabout Mode	No automatic boredom trigger
stop	Stops Walkabout without wake word while Walkabout is active	Safety-sensitive
what are you doing	Short activity reply	v5.3.1 identity-routing fix
describe yourself	Fuller Robie identity/self-description reply	Separate from activity questions
how are you feeling	Short system-status style reply	Not the full status report
status report	Long detailed status report	Use for full diagnostic report
air analysis	Remains a deeper internal air-quality/VOC analysis rather than a weather report	Longer on-demand sampling
internal air analysis	Deep air-quality analysis with VOC trend detection	New accepted phrase
erase media	Deletes saved camera media	Now accepted by cleanup detector
facts memory status	Checks facts-memory file health	Direct local status check

Core Modes

Wake, sleep, shutdown, command mode entry/exit, live date/time, and Robie identity Shutdown halts Linux after goodbye/spin sequence

⚠ Shutdown noteThe shutdown command triggers a goodbye/spin sequence and then halts the Linux OS. Keep physical access nearby when testing this command.

helloLocal greeting

▶

Accepted phrases / pattern

hellohi

What Robie does

Local greeting

Mode / context

AI mode

Note AI mode special command

goodbyeGoodbye sequence / sleep

AI + CMD

▶

Accepted phrases / pattern

goodbyebyethe byethe by

What Robie does

Goodbye sequence / sleep

Mode / context

AI / command mode

Note Works in AI mode and command mode

shutdownGoodbye/spin sequence, then halts Linux

⚠ Safety AI

▶

Accepted exact phrases

shutdownshut downplease shut downshut down pleaseRobie shut downokay shut downOK shut downso shut down

What Robie does

Goodbye/spin sequence, then halts Linux

Mode / context

AI / exact local handler

Note Higher-risk command. The phrase must stand alone after normal wake-word cleanup. Conversational or negated wording such as don't shut down is rejected. Keep physical access nearby.

Any phrase containing command/control modeEnters movement command mode

▶

Accepted phrases / pattern

Any phrase containing control mode, command mode, or man mode

What Robie does

Enters movement command mode

Mode / context

AI / local handler

Note Normalizer also maps enter commando and commando mode to command mode

exitLeaves command mode

CMD

▶

Accepted phrases / pattern

exitconversation modeexit control modeexit command modeexit mode

What Robie does

Leaves command mode

Mode / context

Command mode

Note Command mode only

what time is it?Reports the current local time

▶

Accepted phrases / pattern

timecurrent timewhat time is itwhat is the timewhat's the timetell me the time

What Robie does

Reports the current time in Robie's selected timezone.

Mode / context

AI / local handler

Note Uses the synchronized system clock through the selected location's timezone and automatically follows daylight-saving changes. It does not call an external time API for each question.

what is today's date?Reports the current local day and date

▶

Accepted phrases / pattern

datetoday's datewhat date is itwhat is the datetell me today's datewhat day is itwhat day is todaywhat day of the week is it

What Robie does

Reports the current local weekday, month, and date.

Mode / context

AI / local handler

Note Reads the current clock when the command is handled, so the answer remains current as days pass. The calendar day is spoken as an ordinal, such as twenty-fifth, rather than a cardinal number.

what is the date and time?Reports the current local date and time together

▶

Accepted phrases / pattern

date and timewhat is the date and timewhat date and time is ittell me the date and timewhat is today's date and timewhat day and time is it

What Robie does

Reports the selected location's current weekday, date, and time in one reply.

Mode / context

AI / local handler

Live AI context Normal AI requests also receive a fresh local date, time, timezone, UTC offset, and selected-location label. This helps Robie reason about today, yesterday, tomorrow, and date-sensitive topics while travelling.

where are you?Reports Robie's selected city and timezone

▶

Accepted phrases / pattern

where are youwhat city are you inwhat city are we inwhat is your current locationwhat location are you usingwhat time zone are you in

What Robie does

Reports the fully qualified selected location and its timezone.

Mode / context

AI / local handler / every speaker

Note Location is explicitly selected rather than inferred from GPS or casual travel conversation.

set your location to [city]Looks up and stages a travel-location change

✓ Owner AI

▶

Accepted phrases / pattern

set your location to [city]set location to [city]change your location to [city]change location to [city]

What Robie does

Looks up a fully qualified city and timezone, then asks for a clear yes/no confirmation.

Mode / context

AI / owner only

Safety Nothing changes until the owner confirms. A declined, expired, failed, or invalid request keeps the existing location.

return to your home locationRestores Robie's configured home location

✓ Owner AI

▶

Accepted phrases / pattern

return to your home locationreturn to home locationgo back to your home locationset your location to homeuse your home location

What Robie does

Restores Robie's configured home city and timezone.

Mode / context

AI / owner only

Note This uses Robie's built-in safe home record and does not require an online lookup.

describe yourselfGives fuller Robie identity/personality description

▶

Accepted phrases / pattern

describe yourselftell me about yourselftell me who you arewho are youwhat are youwhat can you dowhat do you dowhat kind/sort of robot are youtell me what you areexplain what you are

What Robie does

Gives fuller Robie identity/personality description

Mode / context

AI / local handler

Note v5.3/v5.3.1 exact/anchored matching prevents what are you doing misroute

Conversation & Curiosity

Conversational questions, commanded visual follow-ups, autonomous camera observations, explicit Interview Mode, and permission-based idle questions Conversational, reactive visual, and interview features work for everyone; autonomous visual and idle curiosity are owner-only

Five deliberately different behavioursConversational curiosity may add one relevant question to a normal answer and, after a meaningful reply, one deeper probe. Reactive visual curiosity may add a grounded observation or question when someone explicitly asks Robie to look. Autonomous visual curiosity may quietly capture the room after an eligible owner conversation and speak only when something worthwhile supports one grounded question. Interview Mode asks one question at a time but begins only after an explicit command. Idle curiosity may approach only the owner during a quiet conversational lull and must ask permission before posing its actual question.

🔒 Speaker privacyGuests may receive conversational and commanded visual follow-ups and may use Interview Mode, but their current-session conversation does not gain access to the owner’s private facts, open loops, or episodic memory. Autonomous visual curiosity and idle curiosity never activate for a guest speaker.

conversational curiosityMay ask one relevant question and one deeper probe

▶

Accepted phrases / pattern

No activation phrase. This is normally enabled for every active speaker during ordinary AI conversation.

What Robie does

After fully answering, Robie may end with exactly one short question relevant to what the speaker just said. If the speaker gives a clear, meaningful answer, Robie may acknowledge it and ask exactly one more specific question about a detail in that answer.

Mode / context

AI conversation / every speaker

Note A 25% chance gate and a three-turn cooldown keep the opening question occasional. The deeper probe is available only on the immediate meaningful answer, expires after 120 seconds, and never rearms itself. Vague or garbled replies, reluctance, refusals, questions back to Robie, commands, subject changes, and sensitive topics receive no deeper probe. Ordinary curiosity therefore has a hard ceiling of two related questions; sustained questioning still requires explicit Interview Mode. Both questions use their normal AI response requests, so curiosity adds no separate API call.

reactive visual curiosityShows grounded awareness of what Robie was asked to see and may ask one visual question

◎ Camera AI

▶

Activation phrases / paths

what do you seewhat is in front of youlook at thisinspect thisexamine thisanalyze thisanalyse this

What Robie does

Describes visible facts and, when clearly supported, adds one cautious observation about what appears notable, useful, unusual, or relevant. He may then ask exactly one short question grounded in visible evidence.

Mode / context

Scene View, Object Inspect, and Object Examine / every speaker

Note The significance observation is requested on every clear visual result; the question remains occasional. Visual questions remain occasional and are spaced to avoid interruptions. Visual curiosity uses the existing vision request and therefore adds no second API request. Robie must omit the observation or question when it would require guessing, and must not infer identity, private circumstances, health, emotion, relationships, ownership, value, or intent from appearance.

autonomous visual curiosityMay notice the surroundings and begin one grounded conversation

◎ Camera ✓ Owner only AI

▶

How it begins

There is no activation phrase. After an eligible completed owner AI-conversation turn and a quiet period, Robie may run one background visual-curiosity attempt.

What Robie does

Briefly pulses his eyes, captures one temporary image, and analyzes it in the background. He speaks only when the image contains a worthwhile, clearly visible detail: a short “I notice...” observation followed by one grounded question. Otherwise he remains silent.

Mode / context

AI / authorized owner only / automatic

Conservative limits Chance gates, quiet-time and cooldown limits, a per-startup spoken limit, and automatic cancellation prevent frequent or stale interruptions. This feature is independent of ordinary idle curiosity and does not replace it. Robie keeps listening while background analysis runs; new speech or an incompatible mode discards the observation. The temporary image is deleted after analysis. Exact identity and timing values remain in the private owner/service manual.

interview meStarts command-only Interview Mode

▶

Accepted phrases / pattern

interview meinterview me about [topic]ask me questionsask me some questionsask me questions about [topic]start interviewstart an interviewstart interview modestart interview mode about [topic]

What Robie does

Begins interviewing the current speaker, briefly acknowledges each response when appropriate, and asks exactly one concise next question per turn.

Mode / context

AI conversation / every speaker

Note Interview Mode never begins spontaneously. If no topic is supplied, the interview develops naturally from the person's answers. Robie avoids invasive medical, financial, sexual, and authentication questions.

stop the interviewEnds Interview Mode

▶

Accepted phrases / pattern

stop interviewstop the interviewend interviewend the interviewend interview modeexit interview modethat's enough questionsno more questionsstop asking questionsstop asking me questions

What Robie does

Ends the current interview and returns to ordinary AI conversation.

Mode / context

Active Interview Mode

Note When an interview is active, stop asking me questions ends that interview without turning off the normally enabled conversational-curiosity preference.

curiosity mode on / offControls every automatic curiosity system for the current service session

▶

Accepted on phrases

curiosity mode oncuriosity onturn curiosity onbe more curiousyou can ask me questions

Accepted off phrases

curiosity mode offcuriosity offturn curiosity offstop being curiousstop asking me questionsdon't ask me questionsdo not ask me questions

What Robie does

Temporarily enables or disables conversational follow-ups, reactive visual questions, owner-only idle offers, and owner-only autonomous visual observations.

Mode / context

AI / runtime preference

Note Curiosity is on by default after every service restart. Turning it off cancels active or pending curiosity delivery, including a background autonomous observation. It does not disable the separate Interview Mode command; a new explicit interview me command can still start one.

owner idle curiosityMay politely ask the authorized owner for permission to pose one question

✓ Owner only AI

▶

How it works

During an appropriate quiet conversational moment, Robie may ask permission before posing one bounded curiosity question. Guests do not receive owner-memory-based idle questions.

What Robie does

Accepts a clear yes or no and continues normally.

Mode / context

AI / authorized owner only

Note Exact identity, eligibility, timing, and recovery behavior is documented only in the private owner/service manual.

automatic curiosity cancellationPrevents question modes from leaking into incompatible states

⚠ State safety

▶

Trigger

New user speech, speaker change, sleep, shutdown, Command Mode entry, Keep Watch start, Walkabout start, movement, or another incompatible operating state.

What Robie does

Clears Interview Mode, any pending deeper conversational probe, any idle-curiosity permission request, and any pending autonomous visual delivery.

Mode / context

Automatic state protection

Note This does not erase memory or permanently change the curiosity preference. It clears active question state and discards stale background observations so the next turn or operating mode begins cleanly.

Status & Battery

Casual status, short status, full reports, facts memory status, local weather, combined environment checks, air analysis, main battery, and Bluetooth microphone battery Use tell me the weather for weather only; environmental check for sensors plus weather

Status routing notehow are you is casual. how are you feeling is a short status-style reply. status report or system report produces the long detailed report.

Bluetooth microphone operationWhen the paired Razer Seiren BT connects, Robie automatically uses it as the active microphone and stops using the internal lavalier. When the Razer powers off or disconnects, Robie automatically returns to the internal lavalier. The configured USB audio output remains Robie's speaker throughout. If Bluetooth is already connected when the service starts, microphone routing becomes active immediately, but its spoken connection/battery notice waits until after Robie's first wake gesture and welcome message.

Battery warningRobie warns when the reported microphone battery reaches 20% or lower. The warning resets after the microphone has been recharged sufficiently. Battery readings may appear in coarse steps.

how are youGives short casual banter/status reply

▶

Accepted phrases / pattern

how are youhow are you doingare you okayare you okare you alrightyou okayyou okyou alright

What Robie does

Gives short casual banter/status reply

Mode / context

AI / local handler

Note Separate from how are you feeling

what are you doingGives short activity reply

▶

Accepted phrases / pattern

what are you doingwhat are you up towhat you doingwhat are you working on

What Robie does

Gives short activity reply

Mode / context

AI / local handler

Note v5.3.1 fix: should not trigger identity/self-description

how are you feelingGives short status-style health/environment summary

▶

Accepted phrases / pattern

how are you feelinghow do you feelare you feelingyou feelinghow are your systemshow do your systems feelhow are your systems feelinghow do you feel todayhow are you holding up

What Robie does

Gives short status-style health/environment summary

Mode / context

AI / local handler

Note Kept separate from full report by design

status reportReports detailed system/camera/memory/audio/main-battery/Bluetooth-microphone/environment status

▶

Accepted phrases / pattern

status reportsystem reportsystem statusrobot statusdiagnostic reportdiagnostic statusdiagnostic checkfull status reportfull system reportdetailed status reportdetailed system reportcheck yourselfrun diagnostics

What Robie does

Reports detailed system, camera, memory, USB audio, main battery, Bluetooth microphone connection and battery, and environment status

Mode / context

AI / local handler

Note Longer report remains available only through explicit report wording

memory statusReports facts-memory file health

🔒 Privacy AI

▶

Accepted phrases / pattern

memory statusfacts memory statusfact memory statusfacts statusare your memory files okayare your facts memory files okayis your facts memory okayis facts memory okaycheck facts memorycheck memory files

What Robie does

Reports facts-memory file health

Mode / context

AI / local handler

Note Direct local status check

battery statusReports Robie's main battery plus Bluetooth microphone state and battery

▶

Accepted phrases / pattern

battery statusbattery levelbattery percentagehow much batteryhow much powerhow much chargepower remainingcharge remainingare you chargedare you low on batterydo you need chargingBluetooth microphone batteryBluetooth mic batterymicrophone batteryRazer batterySeiren battery

What Robie does

Reports Robie's main battery and the Razer battery percentage when connected; otherwise reports that the Bluetooth microphone is off or disconnected

Mode / context

AI / local handler

Note Reports the installed main-battery monitor and the connected microphone battery

tell me the weatherReports selected-location weather without internal sensor readings

▶

Accepted phrases / pattern

weatherlocal weatherweather reportcurrent weatherweather todaytoday's weatherwhat is the weatherwhat is the weather todaywhat is the weather likewhat's the weather like todayhow is the weatherhow's the weather todaytell me the weathertell me today's weathertell me about the weathergive me the weather reportgive me today's weather reportwill it rain todaywhat is the chance of rainwill it snow todaywhat is the chance of snow

What Robie does

Reports current conditions and temperature, apparent temperature with local humidity and wind factored in, today's high and low, and the maximum precipitation probability for today.

Mode / context

AI / local handler / weather only

Location and caching Uses Robie's confirmed location and does not speak the city in the current/today report. Successful five-day results are cached briefly and shared by the weather commands to improve repeat-response speed.

what's tomorrow's weather?Reports tomorrow's selected-location forecast

▶

Accepted phrases / pattern

weather tomorrowtomorrow's weathertomorrow's forecastforecast for tomorrowwhat's tomorrow's weatherwhat's the weather tomorrowwhat will the weather be like tomorrowtell me tomorrow's weathergive me tomorrow's forecastwill it rain tomorrowwill it snow tomorrow

What Robie does

Reports tomorrow's expected condition, high and low temperatures, and precipitation chance, naming the selected location.

Mode / context

AI / local handler / weather only

Note Uses the same confirmed location and cached online weather data as the current-weather report.

give me the five-day forecastReports today plus the following four days

▶

Accepted phrases / pattern

five day forecast5 day forecastfive day weather forecastwhat's the five day forecastgive me the five day forecasttell me the five day forecastweather for the next five daysforecast for the next five dayswhat's the weather for the next five days

What Robie does

Names the selected location and gives a concise daily summary for today and the following four days, including conditions, high/low, and precipitation chance.

Mode / context

AI / local handler / weather only

Forecast window “Five-day” means today plus the next four calendar days. Internet access is required for a fresh forecast.

environment checkReports internal sensor readings followed by local weather

▶

Accepted phrases / pattern

environmentenvironment checkenvironmental checkenvironment statusenvironmental statuscheck environmentcheck the environmentrun environment checkrun environmental check

What Robie does

Reports internal temperature, humidity, pressure, and air-quality status, then appends the same selected-location weather report used by the weather-only command.

Mode / context

AI / local handler / combined report

Resilient separation Internal readings are explicitly identified as Robie's sensor values. If online weather is unavailable, available sensor readings are still reported; if the sensor is unavailable, Robie still attempts the weather report. Air analysis remains separate and internal-only.

air analysisRuns deeper on-demand air/VOC trend analysis

⚠ Safety AI

▶

Accepted phrases / pattern

air analysisrun air analysisanalyze airanalyse airdeep air analysisinternal air analysisrun internal air analysis

What Robie does

Runs deeper on-demand air/VOC trend analysis

Mode / context

AI / local handler

Note Takes a longer sampling window; not passive conversation

Calendar & Appointments

Owner-only, read-only Google Calendar questions and short conversational follow-ups AI Mode; spoken in Alan's normal voice

🔒 Private and read-onlyRobie reads the owner's primary Calendar when asked. He cannot add, move, cancel, or delete events. Guests cannot retrieve the owner's schedule. Calendar answers do not cause movement or start a reminder.

what do I have today?Reads the requested day's Calendar entries

✓ Owner-only AI

▶

Say

what do I have today?what do I have tomorrow?what's on my calendar this week?what's coming up over the next seven days?do I have anything Thursday?what's happening Thursday afternoon?tell me, what do I have scheduled today?what's my itinerary?what's my itinerary for Saturday?

What Robie does

Reads matching Calendar entries for today, tomorrow, a named weekday, this week, or the next seven days.

Context

AI Mode / owner / internet required

Day and timeCalendar day words use Toronto time. A bare “what's my itinerary?” means today's Calendar. A travel-itinerary question about a place is ordinary AI conversation.

when is my [event]?Finds a named upcoming Calendar event

✓ Owner-only AI

▶

Say

when is my MRI?where is my MRI?when is my tennis?what's my next appointment?what's my next event?

What Robie does

Searches upcoming event titles or locations, or names the next scheduled commitment.

Context

AI Mode / owner / read-only

Wording mattersUse “my” or an explicit event word for a named lookup. A bare “When is Christmas?” remains a general question. “Next appointment” means the next future timed entry marked busy; a title such as “Dentist” counts, but so can a busy restaurant reservation.

am I free Thursday afternoon?Checks Calendar availability or a dated appointment phrase

✓ Owner-only AI

▶

Say

am I free Thursday afternoon?do I have plans Saturday evening?do I have an appointment on Saturday?check my calendar for Saturday appointments

What Robie does

Checks entries for the day or daypart. Availability uses whether Calendar marks an event busy or free.

Context

AI Mode / owner / read-only

Not an appointment classifierAppointment-worded day queries show that day's entries; Calendar does not reliably label which ones you personally consider appointments. “Free” means no busy Calendar event was found, not that you have no offline commitments.

how should I prepare for it?Continues a recent Calendar conversation

✓ Owner-only AI

▶

After a Calendar answer, try

how should I prepare for it?what should I bring?I'm nervous about it

What Robie does

Uses a brief recent Calendar snapshot to understand a relevant follow-up without changing his usual voice or personality.

Context

AI conversation / owner only

Privacy and limitsA relevant follow-up may send the recent Calendar answer to the AI service, and the resulting conversation can appear in Robie's normal memory. Robie does not automatically announce future appointments or assume that a scheduled event already happened. Ask a fresh Calendar question if an event may have changed.

Camera, Media & Sharing

Vision description, current visual reference, transcript sharing, child-style drawing, photo/video capture, email sending, cleanup Scene View stays separate from Object Inspect/Examine

◎ Camera privacy noteScene View, Object Inspect, Object Examine, and Keep Watch are separate camera paths. Scene View describes the room and stores the most recent scene photo as Robie's current visual reference. Object modes focus on what is being shown. Keep Watch captures evidence after PIR motion.

◎ Current visual referenceAfter what do you see?, Robie keeps the current visual reference file as his current visual reference until a new scene image replaces it, the service restarts, or the file is deleted. Follow-up questions can use the stored detailed observation or re-analyze the same image.

Exact sharing phrases matteremail that, send that, email me that, send me that, and transcribe that refer to Robie's most recent completed AI answer. Phrases such as send that to me, email that to me, or send it to me remain camera-media commands.

email that / send that / transcribe thatEmails the most recent completed AI answer as text with its exact spoken WAV

🔒 Privacy ✓ Owner-only AI

▶

Accepted phrases / pattern

email thatemail me thate mail me thatmail me thatsend thatsend me thattranscribe thatemail me that answersend me that answeremail me the last answersend me the last answeremail me your answersend me your answeremail the last answer to mesend the last answer to me

What Robie does

Emails a dated transcript containing the owner’s question and Robie's answer, with the exact completed Piper speech WAV attached

Mode / context

AI / owner-only local handler

Note Only the latest completed AI-generated answer is available. A newer completed answer replaces it. If email fails, the transcript and WAV are retained for another try.

draw a picture and send itTakes a fresh photo, redraws it like a child's pencil/crayon picture, and emails the JPEG

◎ Camera AI

▶

Accepted phrases / pattern

draw a picture and send itdraw a picture and send it to medraw me a picture and send itdraw me a picture and send it to medraw a picture and email itdraw a picture and email it to medraw me a picture and email itdraw me a picture and email it to me

What Robie does

First speaks one of several hold-still messages explaining that the task may take a minute or two. After that message finishes, he captures one new camera photo, submits it to GPT Image 2 with the installed child-drawing style reference, crops the result to an exact 3:2 frame that removes Robie's lower shell, adds Robie's transparent signature at bottom-right, and saves a borderless 3000×2000 JPEG tagged at 300 DPI. Following confirmed email delivery, he speaks one of several completion messages and asks what the recipient thinks.

Mode / context

AI / camera and image-generation task

Note Opening and successful-completion lines are randomized without deliberately repeating the immediately previous personality line. The feedback invitation is spoken only after successful email delivery. The generated image is natively 1536×1024; print preparation crops it to the approved framing and upscales it, so it does not create additional native detail. The file itself contains no added white borders. At 300 DPI its native print size is 10×6.67 inches. Because 3:2 and 8×10 paper have different shapes, filling an entire 8×10 sheet requires printer-side cropping; fitting the whole image on that sheet produces paper margins. This billable generative request may take about a minute, during which Robie pauses normal listening and can appear idle. If the style file is unavailable, prompt-only styling is used. If the signature file is unavailable, the drawing continues without it and records the issue in the journal. A failed redraw or print-preparation step preserves the source photo; a failed email preserves the finished drawing; successful delivery deletes the local drawing.

what do you seeCaptures fresh `latest_view.jpg`, describes it, and stores it as current visual reference

◎ Camera

▶

Accepted phrases / pattern

what do you seewhat can you seewhat are you seeingwhat do you see Robiewhat can you see Robiedescribe what you seedescribe the roomdescribe your viewtell me what you seelook aroundtake a lookuse your cameralook with your camera

What Robie does

Captures a fresh scene image, describes it, and stores it as the current visual reference

Mode / context

Scene View

Note No identity guessing; wide room/view camera path. Also updates Robie's current visual reference.

last image referenceUses or re-analyzes the most recent scene photo

◎ Camera

▶

Accepted phrases / pattern

what did you see lastwhat was in the last imagedescribe the last phototell me more about the last imagewhat else did you seelook at the last image againanalyze the last photo

What Robie does

Uses stored detailed visual context or re-analyzes the current visual reference file without taking a new photo

Mode / context

Scene View / current visual reference

Note The current visual reference remains available until a new scene photo replaces it, Robie restarts, or the image file is deleted.

what do you see in front of youDescribes front camera view

◎ Camera

▶

Accepted phrases / pattern

what do you see in front of youwhat can you see in front of youtell me what is in front of youtell me what's in front of youdescribe what is in front of youdescribe what's in front of you

What Robie does

Describes front camera view

Mode / context

Scene View

Note Updates Robie's current visual reference for later follow-up questions.

take a photoSaves timestamped photo locally

▶

Accepted phrases / pattern

take a phototake phototake a picturetake picturesnap a photosnap a pictureshoot a photocapture a photocapture photo

What Robie does

Saves timestamped photo locally

Mode / context

AI / local handler

Note Stored in camera photo directory

send/email + photo requestTakes photo, emails it, then deletes local copy if send succeeds

▶

Accepted phrases / pattern

Any send, email, or mail request that also includes photo, picture, image, or pic, such as take a photo and send it

What Robie does

Takes photo, emails it, then deletes local copy if send succeeds

Mode / context

AI / local handler

Note Uses the configured email service

record a videoRecords short video locally

▶

Accepted phrases / pattern

record a videorecord videotake a videotake videorecord a short videotake a short videocapture a videocapture video

What Robie does

Records short video locally

Mode / context

AI / local handler

Note Stored in camera video directory

send/email + video requestRecords video, emails it, then deletes local copy if send succeeds

▶

Accepted phrases / pattern

Any send, email, or mail request that also includes video or clip, such as record a short video and send it

What Robie does

Records video, emails it, then deletes local copy if send succeeds

Mode / context

AI / local handler

Note Uses the configured email service

send latest mediaSends newest saved photo/video

▶

Accepted phrases / pattern

sendemailmailcamera medialast medialatest media

What Robie does

Sends newest saved photo/video

Mode / context

AI / local handler

Note Sends newest camera media file

send latest photoSends newest saved photo

▶

Accepted phrases / pattern

sendemailmailphotopictureimagepiclast photolatest photo

What Robie does

Sends newest saved photo

Mode / context

AI / local handler

Note Photo-specific latest-media send

send latest videoSends newest saved video

▶

Accepted phrases / pattern

sendemailmailvideocliplast videolatest video

What Robie does

Sends newest saved video

Mode / context

AI / local handler

Note Video-specific latest-media send

send it to meSends newest camera media file

▶

Accepted phrases / pattern

send it to meemail it to mesend that to meemail that to mesend the fileemail the file

What Robie does

Sends newest camera media file

Mode / context

AI / local handler

Note Works after recent photo/video capture

erase mediaDeletes saved camera photos/videos

⚠ Safety AI

▶

Accepted phrases / pattern

Delete words delete, erase, clear, remove, clean, cleanup, purge, wipe, or trash plus camera/photo/video/media wording; examples: erase media, delete all photos, delete camera files, clear camera media, delete photos and videos, delete videos

What Robie does

Deletes saved camera photos/videos

Mode / context

AI / local handler

Note Conservative: only camera photo/video directories; does not touch the current visual reference or object temp files

Scene ViewGeneral wide-angle view and regular camera media functions

◎ Camera

▶

Accepted phrases / pattern

what do you see

What Robie does

General wide-angle view and regular camera media functions

Mode / context

Scene View

Note This is the normal room/view camera path; not object-specific

look at thisCaptures temporary object image and answers about the presented object

◎ Camera

▶

Accepted phrases / pattern

look at thislook at this objectinspect thisinspect this objectcheck thischeck this outwhat is thiswhat's thiswhat am I holdingwhat is in my handwhat's in my handread thisread this labelread the labellook at this labellook at this recordlook at this albumlook at this coverlook at this capacitorlook at this resistorlook at this transistorlook at this tubelook at this partlook at this componentcan you see this

What Robie does

Captures temporary object image and answers about the presented object

Mode / context

Object Inspect

Note Object-focused prompt; no permanent image storage; no identity certainty

examine thisRecords temporary 3-second video, extracts frames, analyzes object across angles

◎ Camera

▶

Accepted phrases / pattern

examine thisexamine this objectexamine this partexamine this recordexamine this capacitorexamine this labelanalyze thisanalyze this objecttake a closer looktake a close looklook at this closelyinspect this videovideo inspect thisvideo examine this

What Robie does

Records temporary 3-second video, extracts frames, analyzes object across angles

Mode / context

Object Examine

Note Robie says: Alright. Hold it steady and rotate it slowly.

tell me moreContinues discussion using recent object context

◎ Camera

▶

Accepted phrases / pattern

tell me morewhat does it sayis it damagedwhat should I checkwhat value is itcan you read it

What Robie does

Continues discussion using recent object context

Mode / context

Object Inspect / Object Examine

Note Temporary only; separate from Scene View visual context

keep watchStarts silent PIR-only room-monitoring mode

◎ Camera Watch

▶

Accepted phrases / pattern

keep watchstart watchstart watchingstart keep watchstart watch modeenter watch modewatch modewatch the roomwatch this roomkeep an eye on thingskeep an eye on the room

What Robie does

Starts silent PIR-only room-monitoring mode

Mode / context

Keep Watch

Note Suspends Attention Mode/idle sleep; LEDs off; no normal AI chat

stop watchingStops Watch Mode or cancels pending alert

◎ Camera Watch

▶

Accepted phrases / pattern

stop watchingstop watchend watchend watchingstop keep watchend keep watchstop watch modeend watch modewatch mode offkeep watch offturn off watchturn off watchingturn off keep watchcancel watchcancel watchingcancel watch modecancel keep watchdisable watchdisable keep watchdisarmdisarm watchdisarm keep watchstand down

What Robie does

Stops Watch Mode or cancels pending alert

Mode / context

Keep Watch

Note Restores previous Attention Mode state; uses an owner-authorized alert-cancellation control

PIR motion detectedEmails one event photo plus one 10-second event video

◎ Camera Watch

▶

Accepted phrases / pattern

PIR-only trigger while Keep Watch is armed

What Robie does

Emails one event photo plus one 10-second event video

Mode / context

Keep Watch

Note AI summarizes already-captured alert photo for email when enabled; no face recognition

Object Inspection

Look at this / Examine this / Analyze this object-helper commands Object Examine is now 3 seconds

◎ Object mode noteObject Inspect uses a still photo. Object Examine now records a temporary 3-second video and extracts key frames. Neither mode is for identity certainty.

look at thisTakes a temporary still image and analyzes the presented object

◎ Camera

▶

Accepted phrases / pattern

What Robie does

Takes a temporary still image and analyzes the presented object

Mode / context

Object Inspect

Note Robie says: Hold it steady.

examine thisRecords 3-second temporary video, extracts key frames, analyzes the object from multiple angles

◎ Camera

▶

Accepted phrases / pattern

What Robie does

Records 3-second temporary video, extracts key frames, analyzes the object from multiple angles

Mode / context

Object Examine

Note Robie says: Alright. Hold it steady and rotate it slowly.

tell me moreUses recent object-inspection/examination context for follow-up answers

▶

Accepted phrases / pattern

tell me morewhat does it sayis it damagedwhat should I checkwhat value is itcan you read it

What Robie does

Uses recent object-inspection/examination context for follow-up answers

Mode / context

AI mode

Note Temporary context only; no permanent image/video storage

look at this capacitorUses camera plus audio context to help inspect parts/markings

⚠ Safety ◎ Camera

▶

Accepted phrases / pattern

look at this capacitorlook at this resistorlook at this transistorlook at this tubelook at this partlook at this componentread this partwhat value is thiscan you see this transistor number

What Robie does

Uses camera plus audio context to help inspect parts/markings

Mode / context

Object Inspect / Object Examine

Note Double-check values with a meter/schematic when stakes matter

look at this recordUses camera to identify/describe record sleeves, labels, or condition clues

◎ Camera

▶

Accepted phrases / pattern

look at this recordlook at this albumlook at this album coverlook at this coverwhat record is thisexamine this record

What Robie does

Uses camera to identify/describe record sleeves, labels, or condition clues

Mode / context

Object Inspect / Object Examine

Note Pressing details may require label/runout close-up

object/person shownAvoids identity claims

◎ Camera 🔒 Privacy

▶

Accepted phrases / pattern

If a person is shown, describe only visible non-sensitive details

What Robie does

Avoids identity claims

Mode / context

Object Inspect / Object Examine

Note No face recognition, no identity certainty

Command Movement

Manual forward/back/left/right, dynamic speed adjustment, stop, sensors, override Physical motor kill switch remains the real-world safety layer

⚠ Physical safetyAlways place Robie on the floor before issuing movement commands. Keep the physical motor kill switch within reach. Re-entering Command Mode resets sensors back ON.

Any command-mode phrase containing stopImmediate stop

⚠ Safety CMD

▶

Accepted phrases / pattern

Any command-mode phrase containing stop, halt, freeze, enough, or cancel; grammar also includes stop stop, please stop, stop it

What Robie does

Immediate stop

Mode / context

Command mode

Note Broad by design for safety

go forward...Drives forward

⚠ Safety CMD

▶

Accepted phrases / pattern

go forwardgo straightforwardstraightcome herego forwardsforwardsstreet

What Robie does

Drives forward

Mode / context

Command mode

Note Sensors active unless override

go backward...Drives backward

⚠ Safety CMD

▶

Accepted phrases / pattern

go backwardgo backwardsbackwardbackwardsgo backback up

What Robie does

Drives backward

Mode / context

Command mode

Note Rear sensor active

go left...Turns left

CMD

▶

Accepted phrases / pattern

go leftturn leftmove leftleft

What Robie does

Turns left

Mode / context

Command mode

Note Command mode

go right...Turns right

CMD

▶

Accepted phrases / pattern

go rightturn rightmove rightright

What Robie does

Turns right

Mode / context

Command mode

Note Command mode

faster / go faster · slower / go slowerAdjusts the active movement speed

⚠ Safety CMD

▶

Accepted phrases / pattern

fastergo fasterslowergo slower

What Robie does

Raises or lowers the currently active forward, backward, left, or right speed by 0.05 through a smooth motor ramp

Mode / context

Command Mode while moving

Note Commands are ignored while stationary. Forward is bounded from 0.25 to 0.80, backward from 0.20 to 0.70, and turns from 0.15 to 0.45. Each new direction resets to its normal speed. Robie gives no spoken acknowledgement so he remains ready to hear an urgent STOP command.

overrideDisables command-mode collision sensors until cancelled or mode exit

⚠ Safety CMD

▶

Accepted phrases / pattern

overrideover rideover rightoverridedsensor overridesensors overrideoverride sensorsforce overrideignore sensorsignore sensorsensor offsensors off

What Robie does

Disables command-mode collision sensors until cancelled or mode exit

Mode / context

Command mode

Note Re-entering command mode resets sensors ON

sensors onRe-enables command-mode collision sensors

⚠ Safety CMD

▶

Accepted phrases / pattern

sensors onsensor onenable sensorsactivate sensorsactivate sensorarm sensorsarm sensorsensors activecancel overridecancel sensor override

What Robie does

Re-enables command-mode collision sensors

Mode / context

Command mode

Note Command mode

AI Movement & Gestures

AI movement, dance, show-off, spin, look-both-ways, duration modifiers Gestures are not navigation; AI movement now requires direct command wording

⚠ Gesture noteAI movement and gestures are short timed actions, not navigation. In this build, AI movement ignores collision sensors by design.

⚠ v5.4.5 AI movement safetyAI-mode movement should only fire from short, direct commands such as back up, go backward, go back a bit, move forward, turn left, or turn right. Conversational phrases such as I want to go back outside, go back to the old version, or move forward with the idea should remain conversation and should not move Robie.

Any AI-mode phrase containing stopStops motion

⚠ Safety AI

▶

Accepted phrases / pattern

Any AI-mode phrase containing stop, halt, or freeze

What Robie does

Stops motion

Mode / context

AI mode

Note AI mode

danceDance/show-off gesture

⚠ Safety AI

▶

Accepted phrases / pattern

dancedance for medo a danceshow me your dance movesshow your dance movesdo a little dancegive me a little dancedo a wiggledo a little wiggleboogiebust a move

What Robie does

Dance/show-off gesture

Mode / context

AI mode

Note No navigation intent

spin aroundSpin/show-off gesture

⚠ Safety AI

▶

Accepted phrases / pattern

spin aroundturn arounddo a spinspinshow offshow off for me

What Robie does

Spin/show-off gesture

Mode / context

AI mode

Note Uses tuned dance/spin settings

look both waysLook-both-ways gesture

◎ Camera AI

▶

Accepted phrases / pattern

look both wayslook left and rightcheck both wayscheck left and rightlook aroundhave a look around

What Robie does

Look-both-ways gesture

Mode / context

AI mode

Note Note: look around is checked as camera vision before AI motion in special parsing

come hereShort timed forward motion

⚠ Safety AI

▶

Accepted phrases / pattern

come herecome over herecome closermove closerget closercome to mecome toward mecome towards memove forwardgo forwardgo straightmove straightforwardstraightstreet

What Robie does

Short timed forward motion

Mode / context

AI mode

Note v5.4.5 direct-command hardening suppresses conversational uses such as move forward with the idea or other non-physical wording.

back upShort timed backward motion

⚠ Safety AI

▶

Accepted phrases / pattern

back upbackupback a bitmove backmove back a bitgo back a bitgo backwardgo backwardsmove backwardmove backwardsback awaymove awayreversegive me some spacegive me spacebackwardbackwards

What Robie does

Short timed backward motion

Mode / context

AI mode

Note v5.4.5 removes bare go back as an AI-mode trigger. Use go back a bit, go backward, or back up for intentional AI-mode backward movement. AI movement ignores collision sensors by design in this build.

go leftShort timed left turn

⚠ Safety AI

▶

Accepted phrases / pattern

go leftturn leftmove leftleft

What Robie does

Short timed left turn

Mode / context

AI mode

Note AI mode

go rightShort timed right turn

⚠ Safety AI

▶

Accepted phrases / pattern

go rightturn rightmove rightright

What Robie does

Short timed right turn

Mode / context

AI mode

Note AI mode

Phrases containing tiny/short/longAdjusts AI movement duration

⚠ Safety AI

▶

Accepted phrases / pattern

Phrases containing tiny, small, little, short, quick, slightly, bit, long, far, etc.

What Robie does

Adjusts AI movement duration

Mode / context

AI / local handler

Note Parsed by _motion_duration()

User response after Robie asks for dance feedbackClassifies feedback positive/negative/neutral

⚠ Safety AI

▶

Accepted phrases / pattern

User response after Robie asks for dance feedback

What Robie does

Classifies feedback positive/negative/neutral

Mode / context

AI / local handler

Note Only inside short feedback window

Walkabout Modev5.4.0

Command-only roaming mode, obstacle redirect, wake-word-free stop Never starts automatically; say stop to end

⚠ Walkabout test-build noteWalkabout is command-only. It never starts from boredom or idle behaviour. While active, say stop without the wake word to end the session. The former 120-second automatic session cap has been removed.

walkaboutStarts commanded Walkabout Mode

⚠ Safety AI

▶

Accepted phrases / pattern

walkaboutwalk aboutwalk a boutwalkabout modestart walkaboutstart walk aboutstart walkabout modego walkaboutgo walk aboutgo for a walkgo for a little walktake a walktake a little walkgo on a walktake yourself for a walkgo for a strolltake a strollgo for a wanderhave a wanderwander aroundroam aroundgo roaminggo roam around

What Robie does

Starts commanded Walkabout Mode

Mode / context

AI / local handler

Note No idle/boredom auto-trigger; refuses if busy, speaking, moving, in Keep Watch, command mode, shutdown, or not fully awake

stopStops Walkabout Mode

⚠ Safety Walkabout

▶

Accepted phrases / pattern

Wake-word-free stop listener accepts command-mode stop phrases: stop, halt, freeze, enough, cancel; grammar also includes please stop, stop it, stop stop

What Robie does

Stops Walkabout Mode

Mode / context

Walkabout Mode

Note Does not require saying Robie first. With the timed session cap removed, this is the normal way to end Walkabout.

obstacle detectedStops, backs up if safe, turns gently, and tries another path

⚠ Safety Walkabout

▶

Accepted phrases / pattern

Front sensors trigger redirect; rear sensor protects backup

What Robie does

Stops, backs up if safe, turns gently, and tries another path

Mode / context

Walkabout Mode

Note Softer v5.4.0 tuning: forward 0.35, turn 0.30, turn window 0.30–0.65s; current forward direction-change interval is WALKABOUT_MAX_FORWARD_SECONDS = 6.0

start/redirect/complete linesKeeps Walkabout mostly quiet

Walkabout

▶

Accepted phrases / pattern

Start confirmation; low-chance redirect comments; stop/complete line

What Robie does

Keeps Walkabout mostly quiet

Mode / context

Walkabout Mode

Note Quiet by design so speech does not fight STOP recognition

Attention & Watch

Attention Mode and PIR-only Keep Watch start/stop/disarm behaviour Keep Watch and Walkabout suspend Attention Mode while active

◎ Watch/attention noteKeep Watch and Walkabout suspend Attention Mode while active. Keep Watch is PIR-only, quiet by design, and suppresses normal AI chat until stopped or disarmed.

attention mode onEnables quiet-gap camera centering/attention behaviour

◎ Camera AI

▶

Accepted phrases / pattern

attention mode ontension mode onattention onturn attention onenable attention modeenable attentionattention mode start

What Robie does

Enables quiet-gap camera centering/attention behaviour

Mode / context

AI / local handler

Note Tiny corrections only; no chasing, no hard turns, no follow mode

attention mode offDisables attention scanning/centering

▶

Accepted phrases / pattern

attention mode offtension mode offattention offturn attention offdisable attention modedisable attentionattention mode stop

What Robie does

Disables attention scanning/centering

Mode / context

AI / local handler

Note Use if you want Robie completely still during tests

keep watchStarts silent PIR-only Watch Mode after arming settle window

◎ Camera Watch

▶

Accepted phrases / pattern

keep watchstart watchstart watchingstart keep watchstart watch modeenter watch modewatch modewatch the roomwatch this roomkeep an eye on thingskeep an eye on the room

What Robie does

Starts silent PIR-only Watch Mode after arming settle window

Mode / context

Keep Watch

Note Robie says only the explicit start confirmation; LEDs stay off afterward

stop watchingStops Watch Mode

◎ Camera Watch

▶

Accepted phrases / pattern

What Robie does

Stops Watch Mode

Mode / context

Keep Watch

Note Reliable escape hatch; can be checked during Keep Watch suppression

PIR motion detectedCaptures event photo + 10-second event video, emails both

◎ Camera Watch

▶

Accepted phrases / pattern

No spoken command; PIR-only trigger while Watch Mode is armed

What Robie does

Captures event photo + 10-second event video, emails both

Mode / context

Keep Watch

Note AI summary can be added to email from already-captured photo; no identity recognition

continued/new PIR motionSends repeat alert packages only after cooldown if PIR motion continues or recurs

◎ Camera Watch

▶

Accepted phrases / pattern

No spoken command; automatic while Watch Mode remains active

What Robie does

Sends repeat alert packages only after cooldown if PIR motion continues or recurs

Mode / context

Keep Watch

Note Phase 2 PIR-only; retired baseline/FOV comparison constants remain harmlessly present

Owner Memory & Privacy

Robie can maintain owner-authorized conversational continuity and personal preferences.

🔒 Privacy Personal and project memory is restricted to the authorized owner. Protected recovery, disclosure, modification, and deletion phrases are documented only in the private owner/service manual.

Guest separation Guest conversations do not receive access to the owner’s private facts, project notes, or episodic history.

Speaker Identity

Guest speaker switching and Robie spoken-name variants. Protected owner recovery and unit identity controls are omitted from this public edition.

Robie spoken-name variantsTreats likely speech-recognition variants as “Robie” when clearly used to address or identify the robot

▶

Accepted names in safe context

RubyRubiRobyRobbyRobbieRudy

What Robie does

Normalizes the variant to Robie in greetings, direct address, robot-name questions, and common courtesy phrases

Mode / context

AI / speech normalization

Note Context-bound for safety: “Rudy, turn left” can address Robie, while “Rudy is my friend” and “you are talking to Rudy” retain the real person's name and speaker meaning.

you are talking to [name]Sets non-owner speaker mode

🔒 Privacy AI

▶

Accepted phrases / pattern

you are talking to [name]you are speaking to [name]this is [name] speakingswitch speaker to [name]change speaker to [name]

What Robie does

Sets non-owner speaker mode

Mode / context

AI / local handler

Note Strict to avoid accidental identity changes

describe yourselfGives fuller Robie description

▶

Accepted phrases / pattern

describe yourselftell me about yourselftell me who you arewho are youwhat are youwhat can you dowhat do you dowhat kind/sort of robot are youtell me what you areexplain what you are

What Robie does

Gives fuller Robie description

Mode / context

AI / local handler

Note Separate from what are you doing activity reply

Math & Feedback

Simple arithmetic and dance feedback handling Feedback only inside short dance-response window

what is X plus YAnswers simple spoken arithmetic

▶

Accepted phrases / pattern

what is X plus YX plus Ywhat is X minus YX minus Ywhat is X times YX times YX multiplied by YX divided by YX over Y

What Robie does

Answers simple spoken arithmetic

Mode / context

AI / local handler

Note Supports number words and digits

Aliases & Safety Notes

Vosk mishears, overlapping phrases, safety caveats Read before testing Walkabout, Watch, and camera modes

⚠ Read before testingThese mappings document Vosk mishears, overlapping phrases, and safety caveats for movement, Walkabout, Watch, and camera modes.

Alias / Phrase	Maps to / Means	Notes
street	Movement	Safety-sensitive
enter commando, commando mode	Mode switch
Ruby / Rubi / Roby / Robby / Robbie / Rudy	Robie spoken-name variant when used in direct-address or robot-identity context	Context-bound; ordinary references to real people remain unchanged
email that / send that / transcribe that	Email last AI answer transcript + WAV	Owner-only; distinct from `send that to me` camera-media routing
look around	AI mode	Camera/media-sensitive
erase media	Camera cleanup	Camera/media-sensitive
go for a walk / walkabout	Walkabout Mode	Safety-sensitive
motor kill switch	Hardware	Safety-sensitive
pause/restore attention	Attention mode	Camera/media-sensitive
no AI chat while watching	Keep Watch	Camera/media-sensitive
PIR-only	Keep Watch	Camera/media-sensitive
Scene View vs Object Inspect vs Object Examine vs Keep Watch	Camera modes	Camera/media-sensitive
hold steady and rotate slowly	Object Examine	Camera/media-sensitive
go back outside / go back to...	Conversation only in AI mode	v5.4.5: should not trigger backward movement
go back	Command-mode backward phrase; not a bare AI-mode trigger	In AI mode use `go back a bit`, `go backward`, or `back up`
latest_view.jpg	Current visual reference	Replaced by each fresh Scene View capture; not durable memory