Embedded Files
Guide to Desktop App
The desktop application contains all of the tools for clinicians to use during a session.
Opening and Closing ExpandXR
Welcome Screen
Start Button
Opens the home screen
How to Guide
An external link out to the manual
Home Screen
Top Navigation
Server Status (Connected or Disconnected)
Network Mode (Local or Remote)
More Button (indicated with the three dots)
Connection Panel (Right-side)
Client ID
A user-entered field that allows you to identify individual sessions in the client data folder
Select a Headset
Includes ‘Simulator’ to run a practice session without a Headset. This can also be used for training practice by clinicians
Note: this currently shows ALL headsets that are connected to ExpandXR at any given time, make sure you only select YOUR headset from the list
Begin Session
Live Headset View (Left-side)
If a headset is connected, this shows a top-down view of the room
Welcome Screen
Home Screen
Top Navigation Panel (Home Screen)
More Button
PC Settings
Opens the settings menu
How to Guide
A link to the manual
Toggle Window Mode
This will enable a window mode so you can access the Windows navigation menu (i.e. not Full Screen)
Client Data
This will open the folder where client data is saved on your computer
Quit ExpandXR
This will close the application
More Button Menu
Connecting to Your Headset
Begin by launching the ExpandXR application on the headset.
Your headset ID should appear in the Connection Panel, on the right side of the screen.
Select it to begin a connection request between the desktop application and the Headset.
A successful connection will load the room data (a map of the room where the patient is) from the headset into Live Headset View on the PC/Mac application.
The final step is to set the room boundary:
You’ll need to drag each corner to the desired room size. Note each corner must be correctly positioned corresponding to its name ‘Top Right’ or ’Bottom Left' and so on. If this is incorrectly done it will cause complications to the room layout during the Scenarios. The virtual door through which the characters enter, will appear between the “Top Left” and “Top Right” corners. It is better to have the width of the room between these corners.
If you encounter any problems you can always reset the boundary corners with the ‘restart’ icon (bottom left icon)
The ideal layout is with the Headset/Patient positioned in the center near the bottom (back) of the room boundary. This is because each Scenario has been designed to fill the space in front of the Headset/Patient. It is recommended that the area within the set boundaries is not cluttered and is empty of furniture.
When ready to proceed please click ‘Begin Session’.
If you are having trouble connecting your headset to the desktop app, please check the troubleshooting page.
Home Screen During Scanning
Scenarios
Scenarios are predetermined scripted scenarios that follow an order of events (called Intensity Levels). These scenarios are written by expert clinicians in PTSD and exposure therapy to follow hierarchies that start from easiest and gradually advance to more challenging but still safe. Each scenario follows a similar sequence where each level increase will trigger new characters to enter the room. As the level is increased and more characters enter the room, the more imposing and intense the scenario will become.
Scenario Selector
From this selector screen the clinician can select between creating a custom scenario for the patient or using a premade scenario.
Default Tab
Contains various premade scenarios.
Military Tab
Contains premade scenarios where some characters have military theming.
Custom Tab
Allows clinicians to select from previously saved custom scenarios or create a new one.
Scenario Selector Screen
Grocery Store Scenario
Scenario Features
Intensity Levels
The operator can increase the level of the scenario by pressing the + button. A preview of the next level can be read alongside the button.
Once the level has been increased, new character(s) will walk through the door, find their position, and if relevant begin a conversation with another character.
You can go back one level by pressing the - button. The outcome is a hard reset to the previous level (i.e. new character will disappear from the scene). This is not an elegant solution and therefore should be used when absolutely necessary.
SFX
The complete library of SFX is available in the bottom panel.
To add a SFX to the Manager press the + icon next to it (note this does NOT mean the SFX will play)
The selected SFX now appears in the top panel.
Each SFX has the following controls:
Play
Stop
Loop
Sound Level
SFX can be played at any time, and play on top of any other audio, such as background music or dialogue.
To remove a SFX from the manager press ‘X’
SFX Panel
SUDS (Subjective Unit of Distress Signal)
A scale from 0-10 for measuring the subjective intensity of disturbance or distress currently experienced by an individual.
Clinicians can ask patients for their SUDS score and log it in the client data by using the input in the bottom left.
SUDS Input Field
Custom Scenario Generator
The custom scenario generator allows clinicians to have a much more fine-tuned level of control over what the patient is experiencing.
Custom Scenario Tab
'Create New Scenario' Button
Creates a new custom scenario
Scenario List
Displays all of the custom scenarios saved to the current device
Click on the 'X' to the right of the scenario name to delete it forever
Search Bar
Used to search for specific custom scenarios
The button to the right of the search bar refreshes the scenario list
Custom Scenario Tab
Saving Custom Scenarios
In order to save a created custom scenario for future sessions, you simply need to change the scenario's name by clicking on it and typing your new name, then click the 'SAVE' button to the right of the scenario name.
Scenario Name and Save Button
Blank Custom Scenario
Props
The complete library of Props are available in the bottom panel.
To add a Prop to the Props Manager press the + icon next to it (note this does NOT mean the Prop will appear in the scene or camera view)
The selected Prop now appears in the Props Manager (top panel)
Note it does not appear in the scene or camera view until it has been manually placed.
Making sure the prop is selected (green highlight), tap inside the camera view where you’d like to place the prop (give consideration to the size of the prop, i.e. a table may require more distance from other characters or the patient).
Once the prop appears inside the camera view you can rotate it using the rotate controls (note the prop must still be selected in the top panel).
To remove a prop simply press the ‘X’ in the Props manager.
Some Props can Talk using Text to Voice functionality. A prop that can talk is a character who is a prop; they’re likely sitting in a chair or at a desk. Go to the ‘Voice’ tab and the ‘Speaking Props’ sub-tab, to find available talking props. You can select the prop and then write a message in the Text to Voice section.
Prop being added to a Scenario
Example of a Speaking Prop
Character Library
Select a Character to preview by clicking on the Characters panel. You will see relevant tags (i.e. Police or Male) alongside them to help selection. The character will be previewed on the right side.
To confirm selection press the + icon.
You will now see the character you selected in the top panel (see “Phil” in the screenshot), please note the character will not appear in the camera view until you have clicked to place them.
Making sure the character is highlighted (green highlight), tap inside the camera view where you’d like to place the character in relation to the patient (icon represented with circle and headset).
The character will now be seen by the patient.
Character Library
Moving The Character
Make sure the character is highlighted in the top panel (green highlight). You should also see inside the camera view the selected character also has a green circle around it.
Next select the ‘Move’ toggle inside the camera view (top right corner under “Zoom”).
Now click where you want the character to go by clicking inside the camera view. You should see the character move to that position.
Turning The Character
Make sure the character is highlighted in the top panel (green highlight). You should also see inside the camera view the selected character also has a green circle around it.
Next select the ‘Turn’ toggle inside the camera view (top right corner under “Zoom”).
Now click where you want the character to turn to by clicking inside the camera view. You should see the character turn in the direction of that position.
Adding AI Characters
AI characters can be added to custom scenarios to enable patients to engage in non-scripted conversations with realistic chat-bots.
Before adding an AI character to the room:
First teach and instruct the patient on how to interact with these characters. Make sure the patient will talk without pauses. If they pause and then continue to speak, the AI will see each section of their conversation, as a separate phrase, and respond in a confusing way. When they complete their sentence, they should remain silent until the AI character finishes responding, and then talk. Also, if the patient talks with real people in the room, or they talk to the patient, AI will perceive that as it is being talked to. So in summary: Talk without pauses, wait for AI to finish its response, and do not talk to others in the room.
When you add any character into the scene, you’ll see an ‘AI+’ button across from their name, near the ‘X’ button.
Clicking on the AI+ button will allow you to pick their ‘Brain’. The brain that you choose will determine the personality of the character. Depending on the brain that is chosen some options may exist for you to further customize the personality of the AI character.
Note: Selecting the brain labeled 'Full Custom' provides you with the maximum level of customization. Full Custom is recommended for those looking to have an AI character act a specific way.
AI Brain Selection Popup
Once enabled the button will change to reflect an active AI character ‘AI ENABLED’.
You can turn it off by simply pressing the ‘AI Enabled’ button again.
Note: AI Characters will NOT be able to hear any noise until the 'Start Listening' button is clicked in the AI Manager panel.
Disable AI Popup
AI Manager Panel
The AI manager panel can be accessed through the 'Voice' tab while having an AI enabled character selected.
Listening Button
Located at the top right of the AI manager panel. This is used to enable or disable the AI's ability to hear. Listening is disabled automatically when AI is added to a character and will need to be enabled before conversation can begin.
AI Settings
This section contains settings that can be tweaked to change the AI characters behavior. Some or all of these settings may be disabled (greyed out) depending on the customization ability of the chosen AI brain.
Name
Gender
Voice
Traits
Traits shape how an AI character thinks, speaks, and behaves durin a session. Each trait is a short description that the AI will try and adhere to. Use multiple traits to build out the role you'd like the AI to play.
Example: "Sarah is a med school student stressed about midterms."
'Restore Defaults' Button
Restores all of the AI settings to their default state
Apply Button
Applies the changes made to the AI settings, these changes will NOT be applied unless this button is pressed. If it is greyed out then there are no changes to apply.
The AI Manager Panel with Sarah selected and the 'Full Custom' brain
Chat
The 'Chat' section of the AI manager panel can be accessed by selecting its tab at the top of the panel.
Text-To-Speech
Make the AI say something specific, you can use this to force the conversation to go a certain way.
Combined with the listening toggle, clinicians can take over for the AI in the middle of a conversation, then tag back out whenever they want without the patient knowing.
Conversation Transcript
Contains a record of the current conversation so far
Chat Tab of the AI Manager
Other Features
Voice
Click on the ‘Voice’ panel to enable a character to talk.
Make sure the intended Character is selected in the top panel (green highlight).
If the selected character is AI-enabled the AI manager panel will show up.
In the bottom panel, inside the dialogue box, you enter what you want the selected character to say.
The dropdown box is preselected with a voice that has been chosen for that character. You can change the voice by selecting from the dropdown box.
Voice Tab
Animations Library
To give the character more specific animations click on the Animations tab (see the panel is similar to the Character panel).
Make sure a Character is selected in the top panel (green highlight). Then in the Library panel below, pick an animation. Note that Animations will play on the highlighted character immediately.
Animations have fixed timelines that cannot be interrupted, so the next animation selected will play once the first animation has finished.
Animations Library
SFX
SFX in custom scenarios work exactly the same as in premade ones.
Settings
AI Characters
This screen is for relevant application settings.
Inworld API Key
Do not change!
API Secret
Do not change!
Experimental Features
Features that are in-development or otherwise aren't fully implemented into the app, feel free to enable some of these if you want a sneak peak at future features.
AI Character Settings
Network Settings
This screen is used to change the network modes of the Headset.
Remote Server URL
The default server is ‘https://devexpandxr.com’. You should not need to change this.
Network Mode Selection
Local
Local Mode is when the application is going to be run inside a private network and or a network without internet connection. Please note some features will not work without an internet connection.
Remote
Remote Mode is the preferred networking mode, but does require an internet connection. This mode offers the flexibility for the device and the PC to be in separate locations.
Local IP Address:
This is the IP address of your computer.
‘Save Changes’ Button. Once you have provided a name and chosen the network mode you can press the ‘Save to Headset’ to set the headset. If this is successful you should see these new settings appear in the gray box area on the left panel.
Network Settings
Report abuse