Skip to content

Commit

Permalink
updating post-task survey
Browse files Browse the repository at this point in the history
  • Loading branch information
mlisnic committed Feb 13, 2024
1 parent 7846d5b commit cddc175
Show file tree
Hide file tree
Showing 12 changed files with 185 additions and 7 deletions.
90 changes: 90 additions & 0 deletions public/viz-guardrails/config-viz-guardrails.hjson
Original file line number Diff line number Diff line change
Expand Up @@ -145,9 +145,95 @@
"required": true
}
]
},
"post-survey": {
"type": "markdown",
"response": [
{
"id": "viz",
"type": "likert",
"location": "belowStimulus",
"prompt": "How familiar are you with data visualizations?",
"required": true,
"leftLabel": "Not familiar",
"rightLabel": "Very familiar",
"preset": 5,
},
{
"id": "notice",
"type": "radio",
"location": "belowStimulus",
"prompt": "Did you notice a guardrail in place in some of your tasks?",
"required": true,
"options": [
{
"label": "No",
"value": "no"
},
{
"label": "Yes",
"value": "yes"
}
]
},
{
"id": "understand",
"type": "radio",
"location": "belowStimulus",
"prompt": "Did you understand what exactly the guardrail was showing?",
"required": true,
"options": [
{
"label": "No",
"value": "no"
},
{
"label": "Somewhat",
"value": "somewhat"
},
{
"label": "Yes",
"value": "yes"
}
]
},
{
"id": "difficulty",
"type": "likert",
"location": "belowStimulus",
"prompt": "How did the guardrail affect the difficulty of performing the task, compared to no guardrail?",
"required": true,
"leftLabel": "More difficult",
"rightLabel": "Easier",
"preset": 5,
},
{
"id": "experience",
"type": "shortText",
"location": "belowStimulus",
"prompt": "Describe how, if at all, the guardrail impacted your experience performing the task:",
"required": true,
}
]
}
},
"components": {
"post-sd": {
"baseComponent": "post-survey",
"path": "viz-guardrails/post-sd.md"
},
"post-ss": {
"baseComponent": "post-survey",
"path": "viz-guardrails/post-ss.md"
},
"post-jd": {
"baseComponent": "post-survey",
"path": "viz-guardrails/post-jd.md"
},
"post-js": {
"baseComponent": "post-survey",
"path": "viz-guardrails/post-js.md"
},
"introduction": {
"type": "markdown",
"path": "viz-guardrails/introduction.md"
Expand Down Expand Up @@ -437,6 +523,7 @@
}
]
},
"post-sd"
]
},
{
Expand Down Expand Up @@ -528,6 +615,7 @@
}
]
},
"post-ss"
]
},
{
Expand Down Expand Up @@ -619,6 +707,7 @@
}
]
},
"post-jd"
]
},
{
Expand Down Expand Up @@ -710,6 +799,7 @@
}
]
},
"post-js"
]
}
]
Expand Down
2 changes: 1 addition & 1 deletion public/viz-guardrails/consent.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

**Contact Information: maxim.lisnic@utah.edu**

## Title of Research Study: Exploring Interventions Against Cherry-picking in Interactive Data Visualizations
## Title of Research Study: Exploring Guardrails in Interactive Visualizations
## Introduction
You are being asked to participate in a research study. Before you
agree, however, you must be fully informed about the purpose of
Expand Down
Binary file added public/viz-guardrails/images/example-jd.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added public/viz-guardrails/images/example-n.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added public/viz-guardrails/images/example-sd.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added public/viz-guardrails/images/example-ss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
6 changes: 3 additions & 3 deletions public/viz-guardrails/introduction-stock.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
We start with Scenario 1. It consists of 2 tasks.
Welcome to the "Financial Advisor" Scenario. It consists of **2 tasks**.

## Instructions for Scenario 1
## Instructions for the "Financial Advisor" Scenario

The following instructions describe the tasks pertaining to Scenario 1. If you need to refer
The following instructions describe the tasks pertaining to this scenario. If you need to refer
to these instructions during the experiment, please click on help at the top of the page.

**Scenario**: You are a financial advisor. Your client approached you asking for help in
Expand Down
6 changes: 3 additions & 3 deletions public/viz-guardrails/introduction-viral.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
We are now moving on to Scenario 2. It consists of 2 more tasks.
Welcome to the "Celestial Sniffles" Scenario. It consists of **2 tasks**.

## Instructions for Scenario 2
## Instructions for the "Celestial Sniffles" Scenario

The following instructions describe the tasks pertaining to Scenario 2. If you need to refer
The following instructions describe the tasks pertaining to this scenario. If you need to refer
to these instructions during the experiment, please click on help at the top of the page.

**Background**: You live in a fantasy world that consists of your home country, as well as other
Expand Down
22 changes: 22 additions & 0 deletions public/viz-guardrails/post-jd.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
# Post-study survey

Thank you for completing the tasks! This is the last page of the assingment.

After completing the questions below and clicking the "Next" button, you will be redirected back to Prolific.

## Visualization Guardrails

You may have noticed that the interactive visualization looked different between different tasks.

In the image below, you can see a simple interface (at the top) and a **guardrail interface** (at the bottom).

<img src='./images/example-n.png' width='500'>
<img src='./images/example-jd.png' width='500'>

Notice that the guardrail version of the visualization *shows a miniature version of all the data on the side*.

## Questions

Please answer the questions below about your experience completing the tasks *with* and *without* the guardrail enabled.

___
22 changes: 22 additions & 0 deletions public/viz-guardrails/post-js.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
# Post-study survey

Thank you for completing the tasks! This is the last page of the assingment.

After completing the questions below and clicking the "Next" button, you will be redirected back to Prolific.

## Visualization Guardrails

You may have noticed that the interactive visualization looked different between different tasks.

In the image below, you can see a simple interface (at the top) and a **guardrail interface** (at the bottom).

<img src='./images/example-n.png' width='500'>
<img src='./images/example-js.png' width='500'>

Notice that the guardrail version of the visualization *shows the range of values for all the data on the side*.

## Questions

Please answer the questions below about your experience completing the tasks *with* and *without* the guardrail enabled.

___
22 changes: 22 additions & 0 deletions public/viz-guardrails/post-sd.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
# Post-study survey

Thank you for completing the tasks! This is the last page of the assingment.

After completing the questions below and clicking the "Next" button, you will be redirected back to Prolific.

## Visualization Guardrails

You may have noticed that the interactive visualization looked different between different tasks.

In the image below, you can see a simple interface (at the top) and a **guardrail interface** (at the bottom).

<img src='./images/example-n.png' width='500'>
<img src='./images/example-sd.png' width='500'>

Notice that the guardrail version of the visualization *automatically shows all items from the selected groups*.

## Questions

Please answer the questions below about your experience completing the tasks *with* and *without* the guardrail enabled.

___
22 changes: 22 additions & 0 deletions public/viz-guardrails/post-ss.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
# Post-study survey

Thank you for completing the tasks! This is the last page of the assingment.

After completing the questions below and clicking the "Next" button, you will be redirected back to Prolific.

## Visualization Guardrails

You may have noticed that the interactive visualization looked different between different tasks.

In the image below, you can see a simple interface (at the top) and a **guardrail interface** (at the bottom).

<img src='./images/example-n.png' width='500'>
<img src='./images/example-ss.png' width='500'>

Notice that the guardrail version of the visualization *also shows the average value of all the data, and the area where 50% of the data falls*.

## Questions

Please answer the questions below about your experience completing the tasks *with* and *without* the guardrail enabled.

___

0 comments on commit cddc175

Please sign in to comment.